By Kif Leswing
Publication Date: 2026-08-24 15:00:00
The Nvidia Groq 3 LPU chip during the Nvidia GTC conference in San Jose, California, March 18, 2026.
David Paul Morris | Bloomberg | Getty Images
Nvidia announced on Monday that its Groq 3 LPX rack is in full production, marking the commercialization of technology from the company’s largest acquisition on record.
The Groq rack will be deployed alongside Vera central processors and Rubin graphics processors at neocloud Nebius, and will be online later this year, Nvidia senior director Dion Harris told reporters.
Nvidia’s race to manufacture Groq’s chip and make it available to customers highlights the growing importance of low-latency inference that’s needed to make AI agents feel responsive without long lags for users, especially for coding. Cloud companies can charge more for these kind of tokens, Nvidia says.
“For folks who are serving tokens, it unlocks the ability to offer premium tiers of service for those users and those customers who actually demand the most latency-sensitive” service agreements, Harris said on the call.
In December, Nvidia bought assets from chip startup Groq for $20 billion, the company’s largest purchase..
The Groq architecture includes 500 megabytes of speedy SRAM on the chip’s die itself to reduce memory-related bottlenecks. Groq chips are manufactured by Samsung, while Taiwan Semiconductor Manufacturing makes Nvidia’s GPUs.
Nvidia packages 256 individual Groq 3 chips into its LPX racks. Nvidia said that its Groq 3 LPX rack can deliver 3,400…
