By The 420 Team
Publication Date: 2026-11-05 17:44:00
Supermicro has launched a new artificial intelligence infrastructure solution developed with IBM and NVIDIA, claiming that the technology can help large AI models begin responding up to 56 times faster when processing lengthy prompts.
Announced on November 5, 2026, the system uses a method called key-value caching, or KV caching, to store information that AI models have already processed. This allows the models to reuse previous calculations instead of repeatedly performing the same work.
The companies say the technology could reduce delays, improve the use of expensive graphics processing units (GPUs) and allow data centres to serve more AI requests without increasing computing resources at the same rate.
The solution combines Supermicro’s Petascale storage servers, IBM Storage Scale software, NVIDIA’s Dynamo inference framework and NVIDIA Spectrum-X Ethernet networking.
Joint testing showed substantial performance improvements,…


