IBM And Together AI Sign $240 Million Multi-Year Deal For Large-Scale NVIDIA B300 AI Inference Cluster

IBM And Together AI Sign 0 Million Multi-Year Deal For Large-Scale NVIDIA B300 AI Inference Cluster

By Amit Chowdhry
Publication Date: 2026-08-21 20:04:00

IBM has signed a multi-year $240 million agreement with Together AI to deploy a large-scale artificial intelligence inference cluster on IBM Cloud using NVIDIA HGX B300 systems. The cluster is expected to become available in the first quarter of 2027 and will help Together AI provide open-source model inference for enterprise customers.

IBM said the deployment will be the first dedicated, large-scale inference cluster on IBM Cloud built with NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking.

According to NVIDIA, the infrastructure is designed to deliver up to 30 times more AI factory output than prior generations.

Together AI plans to use the cluster to improve inference performance and token economics as enterprises move larger AI workloads into production.

The company is focused on open-source artificial intelligence and operates an AI Native Cloud platform spanning inference, training, fine-tuning and agentic workflows.

Together AI recently raised an…