Title

AWS re:Invent 2022 - NYSE: Protecting markets through real-time data processing (FSI310)

Summary

Joe Cho, a technical account manager at AWS, introduces the session with Anand Pradhan and Vinil Bhandari from the New York Stock Exchange (NYSE).
The session covers trade surveillance, its importance in maintaining market trust, and the NYSE's cloud migration journey.
Anand Pradhan, Senior Director of Technology at NYSE, discusses the challenges of trade surveillance, including processing vast amounts of data in real-time and regulatory requirements.
The NYSE's cloud migration aimed to improve performance, scalability, accessibility, and cost-effectiveness while meeting strict regulatory requirements.
Vinil Bhandari, Director of Technology at NYSE, details the AWS architecture used, including storage, compute, orchestration, and the lessons learned during the migration.
The NYSE leveraged various AWS services, optimized costs, and improved performance through strategic changes and AWS partnerships.
The session concludes with insights into future optimizations and the importance of continuous training and automation for the team.

The NYSE's cloud migration was driven by the need to handle increasing data volumes and complexity in trade surveillance.
The hybrid architecture utilized AWS for its elasticity and scalability while leveraging NYSE's expertise in low-latency, high-throughput systems.
The migration to AWS allowed the NYSE to optimize costs significantly, with a 40% reduction in costs over six months due to strategic changes and AWS services.
The NYSE's approach to cloud migration emphasized the importance of senior management support, team expertise, and continuous training.
The use of AWS services like EFS, S3, EC2, and Airflow enabled the NYSE to process and analyze vast amounts of data efficiently.
The NYSE's cloud infrastructure is designed with resiliency and uptime in mind, reflecting the critical nature of trade surveillance in financial markets.
The session highlighted the ongoing nature of cloud optimization, with plans to explore further AWS offerings like FSx and QuickSight for improved performance and analytics.