Introduction:
In a much-anticipated move, Amazon Web Services (AWS) has officially introduced its fourth-generation Graviton processor during the recent re:Invent conference. CEO Adam Selipsky revealed the Graviton4, showcasing notable enhancements and advancements over its predecessor. This latest addition to the Graviton CPU lineup, based on Arm Ltd’s “Demeter” Neoverse V2 core, is set to make waves with its improved performance and innovative features.
Graviton4 Specifications and Architecture:
The Graviton4, built on the Armv9 architecture, inherits the Demeter V2 core, offering a 13% boost in instructions per clock compared to the previous Zeus V1 core. Contrary to expectations, Selipsky did not display the Graviton4 chip during his keynote, but a press release included a revealing chip shot.
The Graviton4 features 96 V2 cores, marking a significant 50% increase from the Graviton3 and Graviton3E. The shift from a 5-nanometer to a more mature 4-nanometer process, shared with Nvidia’s Grace CPU and Hopper GH100 GPUs, suggests a denser configuration.
The Graviton4 boasts twelve DDR5 controllers, up from eight in its predecessor, with a 16.7% increase in DDR5 memory speed, reaching 5.6 GHz. This results in an impressive 536.7 GB/sec of memory bandwidth per socket, a 75% improvement over the prior Graviton processors.
Performance Metrics and Applications:
According to AWS, generic web applications run 30% faster on the Graviton4 than on the Graviton3, while databases demonstrate a 40% speed increase. Large Java applications, in particular, showcase a notable 45% performance boost. The potential implementation of simultaneous multithreading (SMT) remains a speculation, although AWS’s mention of improved application speeds suggests optimizations beyond core count.
R8g Instances and Two-Socket Implementation:
AWS introduced the R8g instances, powered by the Graviton4, boasting up to 3 times more vCPUs and 3 times more memory than the current R7g instances. This hints at a two-socket implementation of the Graviton family, supported by the increased core count and memory controllers. The Graviton4’s architecture aligns with AWS’s commitment to providing scalable and powerful solutions for a diverse range of workloads.
Two-Chiplet Package Speculation:
Examining the chip shot, it’s speculated that the Graviton4 follows a two-chiplet package design, with one chiplet rotated 180 degrees from the other. This innovative approach could address yield concerns associated with monolithic die designs and potentially optimize manufacturing costs.
Conclusion:
The Graviton4’s unveiling marks a significant milestone in AWS’s processor development journey. With enhanced core counts, improved memory capabilities, and notable performance gains, AWS continues to push the boundaries of cloud-based computing. As more details emerge, the tech community eagerly anticipates the practical implications of the Graviton4 across various applications and industries. AWS’s deployment of over 2 million Graviton processors underscores the growing influence of in-house chip development, challenging traditional suppliers in the hyperscaler market.
