Amazon announced Trainium 2 and Graviton 4 chips for training and running AI models
Amazon
AWS, Amazon's cloud computing division, has unveiled updated versions of its AI chips designed to train machine learning algorithms and then deploy finished models.
Here's What We Know
The Trainium 2 chip shows a four-fold increase in performance and a two-fold increase in power efficiency compared to the first version. This will enable faster and cheaper training of neural networks. Anthropic has already announced the use of Trainium 2.
The Graviton 4 processor is focused on running off-the-shelf AI models. It promises a 30% performance boost over its peers with lower power consumption. This should reduce cloud computing costs for AWS customers when running AI.
AWS Graviton 4 and AWS Trainium 2 prototypes
The new chips will become available in the AWS cloud in the coming months. In parallel, Amazon will continue its co-operation with NVIDIA.
Source: Amazon