AWS Unveils Trainium3 Chip and Nvidia-Compatible Roadmap at re:Invent 2025

Amazon Web Services (AWS) unveils its latest AI training chip, Trainium3, at the annual AWS re:Invent conference. The new chip, along with the upcoming Trainium4, promises significant performance improvements and compatibility with Nvidia’s high-speed interconnect technology.

Trainium3 UltraServer Launches with Impressive Specs

AWS introduces the Trainium3 UltraServer, powered by the 3 nanometer Trainium3 chip. The system offers a 4x increase in speed and memory for both AI training and inference compared to its predecessor. Thousands of UltraServers can be linked together, providing up to 1 million Trainium3 chips, a 10x improvement over the previous generation. Each UltraServer can host 144 chips.

The new chip and system are also 40% more energy efficient, addressing the growing concern of power consumption in data centers. This efficiency not only aligns with AWS's sustainability goals but also reduces costs for customers.

Customer Success and Future Roadmap

Early adopters, including Anthropic, LLM Karakuri, SplashMusic, and Decart, have already seen significant cost savings with the third-generation chip and system. AWS highlights that these companies have reduced their inference costs, making the new technology an attractive option for AI cloud customers.

AWS also provides a glimpse into the future with the announcement of Trainium4, which is currently in development. The next-generation chip will support Nvidia’s NVLink Fusion technology, enabling interoperability with Nvidia GPUs. This compatibility aims to attract more AI applications built on Nvidia’s CUDA architecture to Amazon’s cloud platform.

Industry Impact and Future Outlook

The launch of Trainium3 and the roadmap for Trainium4 position AWS as a formidable player in the AI hardware market. By offering high-performance, energy-efficient solutions, AWS continues to innovate and meet the evolving needs of its customers.

While the exact timeline for Trainium4 remains undisclosed, AWS typically follows a yearly cycle for major announcements. Industry experts and customers eagerly await further details at next year’s re:Invent conference.

References

• Amazon releases an impressive new AI chip and teases an Nvidia-friendly roadmap | TechCrunch