Hot Chips 2026: Nvidia presents Groq 3 LPX architecture and unveils its first third-party inference benchmark — LP30-based rack already in production, company says

This Tom’s Hardware Premium article is free to read with a Tom’s Hardware account; no payment necessary. We’re offering free access from August 23 to 26 so you can read all of our reporting from Hot Chips.

Groq’s former chief architect stood on stage at Hot Chips 2026 and presented his former company’s inference chip as Nvidia silicon. Igor Arsovski, now Nvidia’s VP of hardware, presented the Groq 3 LPX rack’s architecture and published the first third-party benchmark of the hardware: Artificial Analysis measured it at 3,431 output tokens per second on a 100K-context Gemma 4 31B reasoning workload, roughly four times the 870 tokens per second of the next-fastest public endpoint. Arsovski said the rack is already in production, built on the LP30 chip Nvidia obtained through its $20 billion Groq deal in December 2025, the same deal that pushed the Rubin CPX it replaced off Nvidia’s roadmap.

SRAM without HBM