Nutanix, Supermicro Target AI Token Costs

AI pilots may start small, but running models across everyday business operations can quickly change the economics.

Nutanix and Supermicro announced plans on Oct. 21 to develop a private AI inference system designed to help enterprises reduce their cost per token and deploy AI workloads on customer-owned infrastructure.

For channel partners, the collaboration could create opportunities beyond hardware sales, including infrastructure deployment, application integration, and managed AI services. But whether private inference delivers savings will depend on how efficiently customers use the computing capacity they purchase.

Eight Blackwell Ultra GPUs form the hardware foundation

Four main infrastructure components make up the planned jointly engineered system:

• GPU compute. Each server node will house eight NVIDIA Blackwell Ultra GPUs for inference processing.
• Management cluster. A dedicated Nutanix NX-8170-G10 cluster will provide a resilient single-tenant control plane, protecting GPU execution during management-service failures.
• Storage cluster. An NX-8150-G10 Unified Storage cluster will deliver high-bandwidth data access for AI ingestion and checkpointing, with cache warming and context caching to support model serving.
• Networking. NVIDIA Spectrum-X Ethernet will connect GPU nodes through Spectrum-4 switches and ConnectX-7/8 SuperNICs. BlueField-3 DPUs will offload infrastructure functions and enable in-band management.

Supermicro’s…