Title
AWS re:Invent 2022 - Matillion: Increasing data productivity without infrastructure (PRT076)
Summary
- Ed Thompson, CTO and co-founder of Matillion, along with VP Product Laura Malins, introduced the Matillion Data Productivity Cloud.
- The talk focused on the challenges faced by data teams, such as cloud data constraints, difficulty in hiring and retaining data teams, and the complexity of data integration products.
- Matillion's Data Productivity Cloud aims to improve productivity by enabling data teams to load, transform, sync, and orchestrate data pipelines without worrying about infrastructure.
- The cloud-based designer integrates version control based on Git, allowing for seamless integration with CI/CD pipelines and data ops.
- Matillion's unlimited scale agent can handle any volume of data and complexity, offering flexibility for data sovereignty models.
- Laura Malins demonstrated loading and transforming Jira data into Snowflake using Matillion's intuitive UI, showcasing the ease of use and scalability.
- The demonstration also covered version control integration, the ability to commit changes to a source control system, and the deployment of pipelines using GitHub Actions.
- The Data Productivity Cloud is in private preview, and attendees were invited to join and visit Matillion's booth for further discussion.
Insights
- Matillion is addressing a significant pain point in the data industry by simplifying the process of managing and transforming data, which is traditionally complex and resource-intensive.
- The emphasis on a no-code/low-code approach and the integration with modern CI/CD practices indicate a shift towards more agile and DevOps-oriented data management.
- The unlimited scalability and flexible deployment options (SaaS or hybrid) cater to businesses with varying needs for data processing and sovereignty.
- The live demonstration of the product in action serves as a practical example of how the Data Productivity Cloud can streamline data operations, which is likely to resonate well with potential customers.
- Matillion's partnership with major cloud data platforms like Amazon Redshift, Snowflake, Databricks, Azure Synapse, and Google BigQuery suggests a broad compatibility and appeal to users across different cloud ecosystems.
- The private preview phase indicates that Matillion is seeking early feedback to refine their offering, which is a common practice for SaaS products to ensure market fit and user satisfaction before a wider release.