Amazon Web Services plans to deploy more than one million Nvidia GPUs, including Blackwell and Rubin GPU architectures, within the next 12 months.
Amazon said that it currently offers the broadest collection of Nvidia GPU-based instances of any cloud provider.
This February, AWS CEO Matt Garman said that the company was still running six-year-old Nvidia A100 servers, and had yet to retire any of the chips, due to there being “so much more demand than supply.”
AWS made the latest Nvidia Blackwell Ultra GPUs generally available last December, and plans to roll out Rubin when it is launched later this year.
At the same time, the company said that it would continue to invest in Trainium, its own in-house AI accelerator effort.
In February, OpenAI announced that it would spend $2bn on Trainium compute (as well as GPUs on AWS), following a $50bn investment from Amazon.