Supermicro Launches KV Cache Solution with IBM and NVIDIA Demonstrating Significant Inference Performance Benefits

• The KV (key-value) cache solution integrates Supermicro Petascale storage servers, IBM Storage Scale software, NVIDIA Dynamo inference software, and NVIDIA Spectrum-X Ethernet switches
• Performance testing shows that the KV cache solution reduces Time-to-First-Token (TTFT) for long-context windows compared to systems with no KV cache
• Customers can dramatically improve inference efficiency through higher GPU utilization, throughput, and infrastructure scalability

SAN JOSE, Calif., Nov. 5, 2026 /PRNewswire/ — Supermicro, Inc. (SMCI), an AI, Enterprise, Storage, and 5G/Edge Total IT Solution Provider featuring Data Center Building Block Solutions® (DCBBS), today announced a new KV cache storage solution with IBM and NVIDIA. The joint solution integrates Supermicro Petascale all-flash storage servers using AMD EPYC 9005 Series processors (“Turin”), IBM Storage Scale software, along with NVIDIA Dynamo inference framework software and Spectrum-X Ethernet networking.

Together, these…