xAI’s Colossus supercomputer cluster uses 100,000 Nvidia Hopper GPUs — and it was all made possible using Nvidia’s Spectrum-X Ethernet networking platform
Nvidia and xAI collaborate on Colossus development xAI has markedly cut down ‘flow collisions’ during AI model training Spectrum-X has been crucial in training the Grok AI model family Nvidia has shed light on how xAI’s ‘Colossus’… Article Source https://www.techradar.com/pro/xais-colossus-supercomputer-cluster-uses-100-000-nvidia-hopper-gpus-and-it-was-all-made-possible-using-nvidias-spectrum-x-ethernet-networking-platform