Amazon.com Inc. today introduced TorchNeuron, an open-source toolkit that enables developers to run PyTorch workloads on its AWS Trainium chips.
PyTorch is the industry’s most popular artificial intelligence development framework. Until now, running AI projects powered by the tool on Trainium-based Amazon Web Services instances involved a significant amount of manual work. That increased development costs and thereby created an entry barrier for users.
TorchNeuron makes it possible to run PyTorch projects on Trainium chips without extensive code changes. According to Amazon, developers only have to configure a setting that informs workloads which chip they should use. TorchNeuron supports Trainium2 and Trainium3, the two latest additions to the accelerator series. The chips support both training and inference use cases.
Trainium3, the more capable of the two processors, features eight computing cores. Each core comprises four modules that are each optimized for a different…
