Meta is using more than 100,000 Nvidia H100 AI GPUs to train Llama-4 — Mark Zuckerberg says that Llama 4 is being trained on a cluster “bigger than anything that I’ve seen”

Meta is using more than 100,000 Nvidia H100 AI GPUs to train Llama-4 — Mark Zuckerberg says that Llama 4 is being trained on a cluster “bigger than anything that I’ve seen”

Mark Zuckerberg said on a Meta earnings call earlier this week that the company is training Llama 4 models “on a cluster that is bigger than 100,000 H100 AI GPUs, or bigger than anything that I’ve seen reported for what others are doing.”…

Article Source
https://www.tomshardware.com/tech-industry/artificial-intelligence/meta-is-using-more-than-100-000-nvidia-h100-ai-gpus-to-train-llama-4-mark-zuckerberg-says-that-llama-4-is-being-trained-on-a-cluster-bigger-than-anything-that-ive-seen

More From Author

Juniper Networks Shines With Stellar Quarterly Results

Juniper Networks Shines With Stellar Quarterly Results

OpenAI Rolls Out ChatGPT Search, Google Shares Slide – Alphabet (NASDAQ:GOOGL)

OpenAI Rolls Out ChatGPT Search, Google Shares Slide – Alphabet (NASDAQ:GOOGL)

Listen to the Podcast Overview

Watch the Keynote