AWS re:Invent 2022
Aws Graviton Deep Dive the Best Price Performance for Aws Workloads Cmp327

Title

AWS re:Invent 2022 - AWS Graviton deep dive: The best price performance for AWS workloads (CMP327)

Summary

  • Presenters: Sudhir Raman (Amazon EC2 Core Compute Product Management Lead) and Oran Barak (Core Compute Engineering Head at Stripe).
  • AWS Graviton: AWS has been investing in custom chips, including Graviton processors, for specialization, efficiency, speed, innovation, and security.
  • Graviton Journey: Started in 2018 with EC2 A1 instances, Graviton2 in 2019 offered 2x performance per core and 4x the number of cores. Graviton3 further improved performance.
  • Graviton2: Delivers up to 40% better price performance for a broad spectrum of workloads. 12 different instance types are available, with significant customer adoption and momentum.
  • Graviton3: Offers 25% better compute performance, 2x higher floating point, and 3x better machine learning performance over Graviton2. It's the first to enable DDR5 memory in the cloud.
  • Graviton3 Architecture: Features over 50 billion transistors, a chiplet-based architecture, and supports PCIe Gen 5 for I/O connectivity.
  • Performance Results: Graviton3 shows significant performance improvements in Spark SQL, video processing, and machine learning workloads.
  • New EC2 Instances: C7gn (network optimized) and HPC7g (optimized for HPC workloads) powered by Graviton3 and Graviton3e processors respectively.
  • ARM Software Ecosystem: Growing support for ARM architecture across operating systems, containers, databases, and other software.
  • Transitioning to Graviton: AWS provides tools and SDKs for transitioning, with best practices and a free trial available.
  • Stripe's Graviton Adoption: Stripe shared their experience adopting Graviton, highlighting significant performance improvements and cost savings.

Insights

  • Custom Chips: AWS's investment in custom chips like Graviton is a strategic move to optimize their infrastructure for performance, cost, and security.
  • Performance Gains: The iterative improvements from Graviton to Graviton3 demonstrate AWS's commitment to delivering higher performance and efficiency with each generation.
  • Customer Adoption: The widespread adoption of Graviton2 by top EC2 customers indicates a strong market acceptance and the potential for cost savings.
  • Sustainability: Graviton processors contribute to sustainability goals with their energy efficiency, which is a growing concern for many organizations.
  • Software Ecosystem Maturity: The ARM software ecosystem is maturing, with broad support from major operating systems and software vendors, making the transition to Graviton more accessible.
  • Real-world Application: Stripe's experience with Graviton underscores the real-world benefits of transitioning to ARM-based instances, including performance improvements and cost savings.
  • Challenges in Transition: While Graviton offers significant benefits, companies must consider the effort required to build and maintain ARM-compatible software and infrastructure.
  • Future Plans: The ongoing development of Graviton and the introduction of new instance types suggest that AWS will continue to innovate in this space, offering more options and potentially greater benefits for cloud workloads.
Aws for Industrial Smart Manufacturing Supply Chain in the Cloud Mfg208 LAws Impact Accelerator Being the Megaphone Dei207