Supermicro, IBM And NVIDIA Launch AI System Claiming 56-Fold Faster Responses – The 420.in

Supermicro, IBM And NVIDIA Launch AI System Claiming 56-Fold Faster Responses – The 420.in

By The 420 Team
Publication Date: 2026-11-05 17:44:00


Follow us on Google News



Supermicro has launched a new artificial intelligence infrastructure solution developed with IBM and NVIDIA, claiming that the technology can help large AI models begin responding up to 56 times faster when processing lengthy prompts.

Announced on November 5, 2026, the system uses a method called key-value caching, or KV caching, to store information that AI models have already processed. This allows the models to reuse previous calculations instead of repeatedly performing the same work.

The companies say the technology could reduce delays, improve the use of expensive graphics processing units (GPUs) and allow data centres to serve more AI requests without increasing computing resources at the same rate.

The solution combines Supermicro’s Petascale storage servers, IBM Storage Scale software, NVIDIA’s Dynamo inference framework and NVIDIA Spectrum-X Ethernet networking.

Joint testing showed substantial performance improvements,…