xAI’s Colossus supercomputer cluster uses 100,000 Nvidia Hopper GPUs — and it was all made possible using Nvidia’s Spectrum-X Ethernet networking platform

xAI’s Colossus supercomputer cluster uses 100,000 Nvidia Hopper GPUs — and it was all made possible using Nvidia’s Spectrum-X Ethernet networking platform


  • Nvidia and xAI collaborate on Colossus development
  • xAI has markedly cut down ‘flow collisions’ during AI model training
  • Spectrum-X has been crucial in training the Grok AI model family

Nvidia has shed light on how xAI’s ‘Colossus’…

Article Source
https://www.techradar.com/pro/xais-colossus-supercomputer-cluster-uses-100-000-nvidia-hopper-gpus-and-it-was-all-made-possible-using-nvidias-spectrum-x-ethernet-networking-platform

More From Author

Vegas trip led to Cisco manager’s firing, but what happened in Vegas?

Vegas trip led to Cisco manager’s firing, but what happened in Vegas?

Google accidentally leaked a preview of its Jarvis AI that can take over computers

Google accidentally leaked a preview of its Jarvis AI that can take over computers

Listen to the Podcast Overview

Watch the Keynote