Data Contracts and Data Quality has been a hot topic in my circle of data discussions in 2023. I wanted to summarise and provide a handy set of notes for data engineers. Here is a slide deck that provides a few incentives and tips to ensure that teams are setup for success beyond the technical implementations of data quality.
At the heart of it, relationships between Data Producers and Consumers is key:
Healthy working agreements - regular planning processes around tracking plans, instrumentation and retrospectives on past successes and failures.
Quicker feedback loops - Data quality validation for data producers as close to the source as possible.
Celebrating wins! Appreciate the hard work of all in keeping data warehouses squeaky clean.