Modernize Your Data Archive with Amazon S3 Featuring Stripe Stg205

Title

AWS re:Invent 2022 - Modernize your data archive with Amazon S3, featuring Stripe (STG205)

Summary

  • The session covered the importance of archiving with AWS, particularly using Amazon S3 Glacier.
  • Gayla, a TPM on Glacier, introduced the session alongside Andrew and Kaushik from Stripe.
  • Amazon S3 Glacier celebrated its 10th anniversary, highlighting its role in data archiving.
  • The cloud has significantly reduced the cost of compute and storage, leading to businesses storing more data.
  • IDC forecasted over 101 zettabytes of data created and stored in the current year.
  • The session emphasized data retention, compliance, and disaster recovery as key use cases for archiving.
  • AWS offers multiple benefits for archiving, including ease of data movement, business agility, insights, and low costs.
  • NASCAR's journey with AWS S3 Glacier was highlighted, showcasing their transition from tape to cloud storage.
  • AWS S3 offers a range of storage classes for different use cases, including Glacier Instant Retrieval, Glacier Flexible Retrieval, and Glacier Deep Archive.
  • Lifecycle policies and S3 Intelligent Tiering were discussed as tools to manage and optimize storage costs.
  • Andrew discussed best practices for retrieving archival data and reducing costs.
  • Stripe shared their journey with AWS S3, highlighting their transition to Intelligent Tiering and Deep Archive Access, resulting in significant cost savings.
  • The session concluded with resources for further learning about AWS S3 archival storage classes.

Insights

  • The exponential growth of data necessitates efficient and cost-effective data archiving solutions.
  • AWS S3 Glacier's range of storage classes caters to various access patterns and retention periods, allowing for tailored archiving strategies.
  • Lifecycle policies and Intelligent Tiering can automate the process of moving data to colder storage, optimizing costs without manual intervention.
  • Real-world examples, such as NASCAR and Stripe, demonstrate the practical benefits of transitioning from on-premises or traditional storage methods to AWS's cloud-based archiving solutions.
  • The session highlighted the importance of understanding data access patterns and object sizes when considering archiving strategies to maximize cost savings.
  • AWS continues to innovate in the archival space, as evidenced by the introduction of higher retrieval throughput and the Intelligent Tiering Deep Archive Access tier.
  • Stripe's experience underscores the importance of regularly revisiting storage assumptions and strategies to ensure cost-effective data management as the volume of data grows.