Amazon Web Services (AWS) has introduced a new version of its custom-designed AI chip — Trainium3. It has also announced the development of the next version, Trainium4. The company reported the launch of the UltraServer system, which is based on the advanced 3-nm Trainium3 processor and internal networking technology.
Both solutions demonstrated a significant increase in performance for training and inference of AI compared to second-generation semiconductors.
The system shows a fourfold increase in performance and also has four times the memory. This allows not only training artificial intelligence but also servicing AI applications during peak load periods.
The UltraServer consists of 144 Trainium3 chips. Systems can be combined into a structure that can accommodate up to 1 million semiconductors in total.
The energy efficiency of the new solution has improved by 40%. The company reported that its clients, including Anthropic, LLM Karakuri, SplashMusic, and Decart, are already using third-generation chips. As a result, they have significantly reduced computing costs.
