Title

AWS re:Invent 2023 - What’s new with Amazon S3 (STG204)

Summary

Amazon S3 Express One Zone: A new high-performance storage class with single-digit millisecond latency, up to 10x faster data access, and 50% reduction in request costs.
Directory Buckets: A new bucket type introduced for S3 Express One Zone with three principal differences: single AZ placement, different request scaling model, and session-based authentication.
Single-Step Batch Operations: An improvement to S3's batch operations system, allowing easy data movement from regional to directory buckets.
Security Enhancements: Encryption by default, disabling ACLs by default, and block public access by default for new buckets. Introduction of S3 Access Grants for data lake permissions.
Open Source Contributions: AWS SDK Common Runtime (CRT), Mountpoint for Amazon S3, and a new Amazon S3 connector for PyTorch.
Observability Tools: Date-based partitioning for S3 Server Access Logs and new features in S3 Storage Lens, including activity level metrics at the prefix level and storage lens groups.
Backup and Archive Improvements: Easier enablement of S3 Object Lock, new CloudWatch metric for replication troubleshooting, cross-account support for S3 multi-region access points, improved Glacier restore performance, and Glacier support for Amazon Athena.

Performance Focus: AWS has shifted S3 to cater to performance-intensive applications like analytics, machine learning, and AI, which require low latency and high throughput.
New Storage Paradigms: The introduction of directory buckets and the S3 Express One Zone storage class indicates AWS's commitment to evolving storage solutions to meet diverse customer needs.
Security Simplification: AWS is simplifying security best practices by setting encryption, ACLs, and public access blocks as defaults, reducing the complexity of securing S3 buckets.
Open Source Emphasis: AWS is increasingly contributing to and creating open-source tools to improve client-side experiences, such as Mountpoint for S3 and the S3 connector for PyTorch.
Enhanced Observability: AWS is investing in tools to provide better visibility and insights into S3 usage, which can lead to cost savings and improved data management.
Backup and Archive Evolution: AWS is responding to customer needs for more efficient data protection and archive access, making it easier to protect, replicate, and restore data, as well as integrate archived data with analytics workloads.