Title

AWS re:Invent 2022 - Observability the open-source way (COP301-R)

Summary

• Nick, the GM for open source observability at AWS, introduces the session and highlights the importance of observability in complex systems.
• Amazon Managed Prometheus (AMP) and Amazon Managed Grafana are discussed as fully managed open-source services for observability.
• Rodrigue, a specialist solutions architect, demonstrates how to instrument an application using OpenTelemetry, including setting up tracing, metrics, and logging.
• Amaya, a principal solution architect, discusses deploying OpenTelemetry Collector on Amazon ECS and EKS, including various patterns and configurations.
• The AWS Observability Accelerator, a Terraform module, is introduced to automate the setup of observability on EKS, including dashboards and alerting rules.
• The session concludes with an invitation to engage with the AWS team at the observability booth and to participate in hands-on sessions and workshops.

Insights

• AWS emphasizes the shift from traditional monitoring to observability, highlighting the need for deep instrumentation and analysis to predict and prevent failures in complex systems.
• OpenTelemetry is presented as a vendor-agnostic instrumentation library that simplifies the collection and routing of telemetry data.
• AWS offers managed services like Amazon Managed Prometheus and Amazon Managed Grafana to provide high availability, scalability, and ease of use while maintaining the benefits of open-source software.
• The session provides practical examples of instrumenting applications with OpenTelemetry and deploying collectors on ECS and EKS, showcasing the flexibility and power of AWS's observability tools.
• AWS is actively contributing to the open-source community and encourages collaboration on projects like Cortex metrics.
• The AWS Observability Accelerator is a significant tool for AWS customers, providing a quick and standardized way to set up observability on EKS clusters.
• AWS's approach to observability is inclusive of both proprietary AWS services like CloudWatch and open-source tools, catering to a wide range of customer preferences and scenarios.