Title

AWS re:Invent 2023 - AWS Graviton: The best price performance for your AWS workloads (CMP313)

Summary

AWS has been investing in custom chips, including Nitro cards, AI/ML chips (Inferentia, Tranium), and Graviton-based servers.
Graviton processors have evolved from Graviton1 in 2018 to the newly announced Graviton4, offering significant performance improvements and energy efficiency.
Graviton2 and Graviton3 have been widely adopted, with over 50,000 customers and all top 100 EC2 customers using Graviton-based instances.
Graviton4 offers up to 30% higher compute performance and larger instance sizes compared to Graviton3.
Customers like Pinterest have successfully migrated to Graviton, seeing cost reductions and performance improvements across various workloads.
The software ecosystem for ARM64 and Graviton has grown, with major Linux distributions, AWS tools, and third-party software supporting Graviton.
AWS provides resources like the Getting Started Technical Guide, Graviton Fast Start program, and porting advisor tool to help customers transition to Graviton.

AWS's investment in custom chips like Graviton is driven by the need for specialization, speed, innovation, and security.
The Graviton journey shows a consistent pattern of performance improvements and energy efficiency gains with each new generation.
Graviton's adoption is not limited to external customers; Amazon also uses Graviton internally for events like Prime Day.
Graviton4's introduction is a response to customer demand for more compute performance and larger instance sizes.
The software ecosystem's support for Graviton is crucial for customer adoption, and AWS has made significant strides in ensuring compatibility and support across various software and tools.
Customer stories, such as Pinterest's, provide real-world evidence of the benefits of migrating to Graviton, including cost savings and performance gains.
AWS's commitment to helping customers transition to Graviton with resources and programs indicates a strategic focus on making Graviton a mainstream option for EC2 workloads.