Microsoft Commits Maia to Multi-Gigawatt Inference, and Its Efficiency Metric Draws Questions

Microsoft will scale its Azure Maia family to multi-gigawatt deployments starting in 2027, making Maia “the primary inference system for Microsoft products and services.” The architecture behind that commitment is unusually specific about data movement. The efficiency claim leading the announcement is not, and practitioners have said so.

Maia 200 is already in production, serving Microsoft Copilot and the MAI team, with GitHub Copilot and Microsoft Foundry to follow by the end of the year. It is deployed across the United States, Europe, and Australia, and Microsoft says it delivers up to 1.7 times more tokens per watt for built-in AI in Teams and Copilot than leading GPU infrastructure. Maia 300 begins production deployments in 2027.

Maia 300 is inference-first, aimed at long-context, memory-intensive, and decode-heavy work rather than training, which neither announcement mentions. Each accelerator carries eight HBM4 stacks, providing 288 GB…