In data & people we trust: Building a reliable data platform with Trino and data observability – Datanova 2023

It’s one thing to have data, but how do you know your company can rely on it? Assurance is an online distribution platform for insurance and financial products that operates between consumers who are looking for coverage, the agents that have the expertise to educate on the available products, and the actual interface into the many products available. To ensure that data is reliable and delivers quick value to customers and internal stakeholders alike, Assurance needed a way to monitor, alert to, and resolve data issues in a scalable and automated way across their Trino-powered data platform. In this tech talk, Mitchell Posluns and Zhi Zhang will share how they rolled out a comprehensive data observability strategy to improve visibility, data quality, and collaboration between data producers and consumers. They’ll also demonstrate how their data observability platform helped them identify and resolve compute-intensive and deteriorating queries run by their Trino-powered query engine, and share what’s next on their data platform roadmap.