Title

AWS re:Invent 2022 - What’s new in AWS streaming (ANT207)

Summary

Anusha, a principal software engineer, and Divya Sridhar, a senior product manager, discuss AWS streaming services.
They highlight the importance of data as a perishable resource and the need for timely processing.
Nextdoor's transformation to real-time analytics using AWS services is showcased as an example.
AWS streaming portfolio includes Kinesis Data Streams, Kinesis Video Streams, Kinesis Data Analytics, Kinesis Data Firehose, and Amazon MSK.
New launches and themes discussed: hands-off capacity management, ease of use, AWS integrations, and open source community work.
MSK Serverless and tiered storage for MSK are introduced to handle scaling and long-lived data storage.
New CloudWatch metrics for Kinesis Data Analytics are available for better visibility and scaling management.
Ease of use improvements include Kinesis Data Streams data viewer in the AWS Management Console, customizable maintenance windows for Kinesis Data Analytics, and improved performance with logging.
AWS integrations enhancements include new sources and destinations for Kinesis Data Firehose, private DNS support for Amazon MSK Connect, and native integration of Amazon Redshift with Kinesis Data Streams and Amazon MSK.
Contributions to the open source community, such as the asynchronous sync framework in Apache Flink 1.15.2, are highlighted.
Future AWS streaming directions focus on scalability, price performance, and out-of-the-box support for operations and resiliency.

AWS recognizes the critical role of streaming data in modern business intelligence and analytics, emphasizing the need for speed and real-time processing.
The company is committed to reducing the operational overhead for customers by offering serverless and managed services that handle scaling and infrastructure management.
AWS is actively contributing to the open source community, ensuring that improvements in their managed services also benefit the broader ecosystem.
The introduction of MSK Serverless and tiered storage for MSK indicates AWS's response to customer feedback, focusing on cost efficiency and ease of data retention.
AWS is enhancing the user experience by providing tools for better observability, performance, and integration within their streaming services.
The company is planning to continue investing in scalability, cost-effectiveness, and ease of use to support the growing and diverse needs of AWS streaming service users.