--- description: NVIDIA Groq 3 LPX is in full production, hitting 3,400 output tokens per second on 100K-token context with 256 LP30s per rack. title: "NVIDIA Groq 3 LPX Enters Full Production: 3,400 Tokens per Second at 100K Context, 256 LP30s per Rack" image: https://www.storagereview.com/wp-content/uploads/2026/08/LPX02-Groq3LPX_Compute_Tray.jpeg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [End User Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » NVIDIA Groq 3 LPX Enters Full Production: 3,400 Tokens per Second at 100K Context, 256 LP30s per Rack # NVIDIA Groq 3 LPX Enters Full Production: 3,400 Tokens per Second at 100K Context, 256 LP30s per Rack by Harold Fritts on August 24, 2026 [AI](https://www.storagereview.com/enterprise/ai)  ◇  [Enterprise](https://www.storagereview.com/enterprise) NVIDIA [announced the production release](https://nvidianews.nvidia.com/news/nvidia-groq-3-lpx-now-in-full-production-with-world-class-speed-for-agentic-ai) of the [NVIDIA Groq 3 LPX](https://www.storagereview.com/news/nvidia-groq-3-lpx-everything-we-know), a dedicated interactive inference accelerator built to complement the Vera Rubin NVL72 platform. As enterprise AI workloads shift from raw model pre-training toward real-time reasoning and autonomous agent orchestration, infrastructure requirements are changing. Agentic workflows require iterative, multi-step execution where latency during token generation can compound across automated reasoning paths, external tool queries, and multi-agent communications. ![NVIDIA Groq 3 LPX compute tray diagram: a 1U liquid-cooled tray with eight Groq 3 LPUs, host CPU, BlueField-4 DPU or ConnectX-9 NIC, and 400Gb/s Ethernet](https://www.storagereview.com/wp-content/uploads/2026/08/LPX02-Groq3LPX_Compute_Tray.jpeg) The Groq 3 LPX architecture specifically excels at this decode phase. Each 2U liquid-cooled compute tray carries sixteen Groq 3 LPUs alongside a host CPU, fabric expansion logic and DRAM, and either a BlueField-4 DPU or a ConnectX-9 NIC, with 32 LPU chip-to-chip optical links and 400Gb/s Ethernet on the front. In a heterogeneous deployment alongside Vera Rubin NVL72 systems, NVIDIA Rubin GPUs handle context ingestion and prefill calculations across massive input datasets, while the Groq 3 LPX units process latency-sensitive token output generation. ## Architecture and Benchmark Performance In standard Artificial Analysis performance evaluations running the open-source Gemma 4 31B model with an active 100,000-token context window, the Groq 3 LPX reached an output rate of 3,400 tokens per second. NVIDIA notes that this throughput level is 4x faster than the nearest alternative platform on identical long-context parameters, and Artificial Analysis records it as the fastest result measured for the model. The comparison is worth reading carefully: NVIDIA’s figure came from a private pre-release endpoint measured on August 21, while the competing numbers are live serverless production endpoints. Maintaining extreme generation velocity across 100k-token windows is essential for enterprise agent architectures that continuously parse extensive code repositories, complex API schemas, and dense technical documentation. ![NVIDIA Groq 3 LPU package render showing the die used in the Groq 3 LPX inference accelerator]() ![Artificial Analysis chart showing the NVIDIA Groq 3 LPX at 3,401 output tokens per second on Gemma 4 31B at 100K context, about 4x the nearest platform]() From a physical system architecture perspective, a rack-scale Groq 3 LPX deployment incorporates up to 256 LP30 accelerators linked through high-speed, direct chip-to-chip interconnects. ## Cloud Deployments and Systems Ecosystem Early commercial adoption is underway across specialized cloud service providers. Nebius has been named the initial AI cloud partner to deploy Groq 3 LPX, with plans to bring the hardware into its Nebius Token Factory production inference service. This architecture is designed to allow developers to access real-time inference acceleration via existing API interfaces without migrating codebases to new framework abstractions. Inference provider Groq expects to be among the platform’s earliest adopters. ![NVIDIA chart claiming up to 30x token throughput per megawatt for Vera Rubin NVL72 versus GB300 NVL72 on a 140K-context agentic coding workload]() ![NVIDIA chart plotting tokens per second per megawatt against user interactivity, showing Groq 3 LPX extending Vera Rubin NVL72 into the lowest latency region]() NVIDIA pairs the launch with updated platform math for the rack it plugs into, claiming up to 30x the token throughput per megawatt for Vera Rubin NVL72 against GB300 NVL72 on a 140,000-token agentic coding workload, with the advantage widening as per-user interactivity targets rise. The hardware implementation fits within NVIDIA’s full-stack Rubin AI factory infrastructure, which spans seven discrete chips across five purpose-built rack configurations. ![NVIDIA Vera Rubin rack family render showing the five purpose-built rack configurations in the AI factory platform]() System elements operating alongside Rubin and LPX compute clusters include NVIDIA Vera CPU racks, Vera BlueField-4 STX storage arrays, and NVIDIA Spectrum-6 SPX networking fabrics. ## What NVIDIA and Nebius Say “Inference is the growth engine of AI. NVIDIA Grace Blackwell and NVL72 revolutionized large language model inference with an unprecedented leap in performance and efficiency,” said Jensen Huang, founder and CEO of NVIDIA. “Vera Rubin extends that vision with workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation.” Nebius framed the value in terms of where latency actually lands for users. “Generation is the phase of inference that determines how responsive an AI system actually is, and that’s exactly what NVIDIA Groq 3 LPX is built to accelerate,” said Danila Shtan, chief technology officer of Nebius. “As the first AI cloud bringing it to production via Nebius Token Factory, we’re making sure every step of an agent’s loop feels instant, through the same API developers are already using, with no migration to a new stack.” ## Spectrum-X Multiplane and Scale-In Infrastructure To support the massive networking demands of these inference factories, NVIDIA highlighted its [Spectrum-X Multiplane Ethernet architecture.](https://www.storagereview.com/news/nvidia-spectrum-x-ethernet-photonics-enters-full-production-with-4x-fewer-lasers-and-a-five-vendor-cpo-supply-chain) Traditional cluster expansion beyond modern density limits often requires adding a third switching tier, which introduces latency penalties, optical cabling costs, and power overhead. Spectrum-X Multiplane circumvents this by splitting host network interfaces into multiple independent planes, each running a flat, two-tier network that scales to 512,000 GPUs. ![NVIDIA Spectrum-X Multiplane topology slide showing multi-rail SuperNIC planes scaling to 512,000 GPUs with 11x faster recovery]() Traffic management and failure mitigation are handled in silicon by the NVIDIA ConnectX-9 SuperNIC, which supports network speeds up to 1,600 Gb/s per GPU when paired with 102.4 Tb/s Spectrum-6 Ethernet ASICs. Spectrum-XGS Ethernet extends the same codesign between facilities, which NVIDIA says accelerates multi-site NCCL collectives by 1.9x. In an eight-plane topology, hardware failover reroutes traffic instantly around failed paths, maintaining roughly 90 percent of aggregate network bandwidth. NVIDIA puts hardware recovery at 11x faster than software-based multiplane load balancing, which it says translates to 1.6x higher AI factory output. ![NVIDIA Scale-In networking slide showing DOCA services, BlueField-4, and Spectrum-X Ethernet for AI factory security and data acceleration]() In parallel, NVIDIA introduced its Scale-In networking pillar, combining BlueField-4 data processing units with the [DOCA software stack](https://www.storagereview.com/news/nvidia-gtc-2026-rubin-gpus-groq-lpus-vera-cpus-and-what-nvidia-is-building-for-trillion-parameter-inference). Scale-In targets the north-south infrastructure fabric, offloading multi-tenant isolation, line-rate in-silicon encryption, telemetry, and high-performance storage data paths from host processors. ## NVLink Fusion for Custom Silicon Integration NVIDIA also introduced NVLink Fusion for hyperscale operators requiring hybrid architectures. The framework allows third-party custom XPUs and CPUs to integrate directly with NVIDIA’s sixth-generation NVLink and NVLink-C2C scale-up networking fabrics. By leveraging modular NVIDIA MGX chassis blueprints and management software, data center operators can standardize on shared power, thermal, and networking rack designs while adjusting the specific ratio of GPUs, LPUs, and custom silicon as workloads evolve. NVIDIA made a second Vera Rubin announcement at Hot Chips: [SpaceXAI is adopting Vera CPUs](https://www.storagereview.com/news/spacexai-adopts-nvidia-vera-cpus-for-grok-with-a-vera-rubin-nvl72-bound-for-orbit-in-starmind) for the agentic workloads behind Grok, and plans to put an optimized Vera Rubin NVL72 in orbit aboard its first-generation Starmind satellite. **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Harold Fritts I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology. Previous post: [Intel Hot Chips 2026: 256-Core Diamond Rapids, Crescent Island With 480GB for Inference, and Wildcat Lake at the Edge](https://www.storagereview.com/news/intel-hot-chips-2026-256-core-diamond-rapids-crescent-island-with-480gb-for-inference-and-wildcat-lake-at-the-edge) Next post: [SpaceXAI Adopts NVIDIA Vera CPUs for Grok, With a Vera Rubin NVL72 Bound for Orbit in Starmind](https://www.storagereview.com/news/spacexai-adopts-nvidia-vera-cpus-for-grok-with-a-vera-rubin-nvl72-bound-for-orbit-in-starmind) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp) Ubiquiti ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp) Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack","url":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack","name":"NVIDIA Groq 3 LPX Enters Full Production: 3,400 Tokens per Second at 100K Context, 256 LP30s per Rack - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/08\/LPX02-Groq3LPX_Compute_Tray.jpeg","datePublished":"2026-08-24T20:26:28+00:00","dateModified":"2026-08-24T20:35:28+00:00","description":"NVIDIA Groq 3 LPX is in full production, hitting 3,400 output tokens per second on 100K-token context with 256 LP30s per rack.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/08\/LPX02-Groq3LPX_Compute_Tray.jpeg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/08\/LPX02-Groq3LPX_Compute_Tray.jpeg","width":1746,"height":966,"caption":"NVIDIA Groq 3 LPX compute tray diagram: a 1U liquid-cooled tray with eight Groq 3 LPUs, host CPU, BlueField-4 DPU or ConnectX-9 NIC, and 400Gb\/s Ethernet"},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/nvidia-groq-3-lpx-enters-full-production-3400-tokens-per-second-at-100k-context-256-lp30s-per-rack#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"NVIDIA Groq 3 LPX Enters Full Production: 3,400 Tokens per Second at 100K Context, 256 LP30s per Rack"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```