Easily and Securely Prepare Share and Query Data Ant324

Title

AWS re:Invent 2023 - Easily and securely prepare, share, and query data (ANT324)

Summary

  • The session focused on the importance of data sharing and breaking down data silos within organizations.
  • Navneet, a principal specialist at AWS, discussed data strategies with biopharma healthcare companies.
  • Jason Berkowitz, from AWS, talked about Lake Formation, Glue Data Catalog, Crawlers, and new announcements related to data sharing.
  • Raj Kumar from Salesforce discussed data cloud product lead responsibilities and the partnership with AWS.
  • The agenda included discussions on breaking down data silos, using Amazon Data Zone for data governance, zero ETL data sharing patterns, and Salesforce's approach to data sharing.
  • The speakers emphasized the importance of treating data as an organizational asset and the role of data-driven organizations in achieving growth.
  • AWS's data governance framework was introduced, focusing on understanding, protecting, and curating data.
  • Different data sharing patterns were discussed, including hub and spoke, data mesh, business to business, and partner collaboration.
  • Amazon Data Zone was highlighted as a service that helps govern data access and enables data collaboration.
  • Jason delved into AWS Glue Data Catalog and Lake Formation, discussing new features and the open approach to data sharing.
  • Raj presented Salesforce Data Cloud's capabilities and the zero ETL data sharing integration with AWS, including a demo of the process.

Insights

  • Data silos are a significant challenge for organizations, and AWS is providing solutions to integrate and share data across different domains securely.
  • The AWS data governance framework is central to modern data strategies, emphasizing the importance of understanding, protecting, and curating data.
  • Amazon Data Zone is a new service that facilitates data governance and collaboration, indicating AWS's commitment to simplifying data management and sharing.
  • AWS's open approach to data sharing, including partnerships with companies like Salesforce, demonstrates a trend towards more integrated and seamless data ecosystems.
  • The zero ETL data sharing pattern is gaining traction, reducing the complexity and cost associated with traditional ETL processes and enabling real-time data access and insights.
  • Salesforce's integration with AWS for data sharing showcases the potential for SaaS providers to securely share data with customers and partners, highlighting a move towards more collaborative and interconnected data services.
  • The session's focus on data sharing, governance, and collaboration tools reflects the growing need for organizations to leverage data as a strategic asset and the increasing demand for tools that can support these objectives.