The partnership aims to deliver the world’s fastest AI inference for large language models (LLMs).
Unmatched Speed Through Disaggregation
The new solution integrates AWS Trainium chips with Cerebras CS-3 systems. By using “inference disaggregation,” the system splits workloads. Trainium handles “prefill” (input processing), while the CS-3 focuses on “decode” (output generation).
David Brown, Vice President at AWS, stated, “The result will be inference that’s an order of magnitude faster and higher performance than what’s available today.”
Exclusive Access via Amazon Bedrock
The technology will be deployed within AWS data centers. Customers can access these speeds through Amazon Bedrock starting in the next couple of months.
AWS is the first cloud provider to offer Cerebras’ specialized hardware for disaggregated inference. Later this year, AWS will add support for Amazon Nova and other open-source models using this infrastructure.
“Partnering with AWS… will…
