Optimizing Amazon Eks for Performance and Cost on Aws Con324

Title

AWS re:Invent 2022 - Optimizing Amazon EKS for Performance and Cost (CON324)

Summary

  • Speakers: Alex Kessner (Product Manager, Amazon EKS) and Raghav Tripathi (Engineering Lead, Amazon EKS).
  • Amazon EKS Overview: Elastic Kubernetes Service (EKS) is a managed Kubernetes service focused on security, reliability, and integration with AWS services.
  • Customer Needs: Customers want to innovate rapidly, reduce operational costs, and ensure performance and security for enterprise-grade workloads.
  • Cost Optimization Challenges: Visibility into granular costs, allocation of costs across teams, and balancing cost efficiency with performance and availability.
  • Cost Sources: Over 90% of Kubernetes costs come from cluster compute and memory.
  • Cost Visibility and Allocation: AWS partnered with KubeCost for fine-grained cost visibility and allocation.
  • Optimization Strategies: Utilizing AWS Graviton for better price performance, adopting EC2 Spot for cost savings, and using Carpenter for intelligent cluster autoscaling and compute management.
  • Carpenter: An open-source solution that automates cost optimization practices and integrates with Kubernetes and AWS innovations.
  • Customer Case Studies: Adobe, Snap Inc., and Airtel have successfully adopted AWS cost optimization strategies in their EKS environments.

Insights

  • AWS Graviton: AWS Graviton processors offer significant cost savings and performance improvements for compatible workloads. Customers can migrate applications to Graviton with minimal effort, especially if using languages and ecosystems that are multi-architecture aware.
  • EC2 Spot Instances: Spot instances can provide significant cost savings for suitable workloads. Best practices include diversifying instance types and using Spot for short-lived and interruptible workloads.
  • Carpenter: Carpenter is a key tool for optimizing EKS clusters. It provides rapid scaling, integrates with Kubernetes scheduling, and automates the use of EC2 Spot and Graviton. Its consolidation feature can further reduce costs by intelligently rescheduling workloads to more cost-efficient nodes.
  • FinOps Cycle: The financial operations cycle is a continuous process of understanding costs, optimizing resources, and iterating on these steps to maintain cost efficiency in a dynamic environment.
  • Customer Adoption: The case studies presented demonstrate that large-scale, performance-sensitive applications can successfully leverage AWS cost optimization strategies without compromising on their operational requirements.