Title

AWS re:Invent 2023 - Magellan’s strategic cloud journey to drive operational insights (NTA209)

Summary

Keith Bryan, a senior sales leader at AWS, introduces Magellan's cloud journey.
Magellan, now part of One Oak, is an oil and gas pipeline company with significant infrastructure.
Bhupesh, Magellan's CIO, details their digital transformation, focusing on customer experience, operational efficiency, employee experience, and data.
Magellan chose AWS for its cloud services due to industry experience, breadth of data technologies, incentives, executive support, and mature management practices.
Stan Tan, a key data engineer at Magellan, presents a technical deep dive into their data pipeline architecture using AWS services.
The data pipeline was designed to securely transfer operational technology data to AWS, ensure near real-time data availability, and backfill data gaps.
AWS services used include IoT Core, Glue, Timestream, and Kinesis Data Firehose.
The key takeaways from Stan's presentation emphasize the low cost of failure in experimenting with AWS services and the importance of leveraging AWS expertise through Technical Account Managers or solutions architects.

Magellan's journey to AWS cloud was driven by a strategic need to innovate and improve operational efficiency, not just a desire to adopt new technology.
The company's digital transformation was comprehensive, involving education on digital fluency, creating a digital strategy and roadmap, and fostering an innovative culture.
Magellan's selection of AWS was influenced by AWS's experience in the midstream oil and gas industry, comprehensive data services, and a partnership approach.
The technical solution presented by Stan Tan illustrates how AWS services can be integrated to solve specific industry challenges, such as secure data transfer from operational technology systems.
The presentation highlights the importance of serverless services in enabling data engineers to focus on pipeline development without managing infrastructure, optimizing costs, and increasing agility.
AWS's support structure, including solutions architects and Technical Account Managers, is a critical component in helping customers successfully navigate their cloud journey.