Monitoring Data Quality

This page explains the processes we follow to fix data quality issues that we actively monitor for.

• Reporting Tasks - the Python scripts that generate our data quality reporting datasets, and where to find their outputs.
• Config Evening Pipeline and GitHub Actions - the nightly GitHub Actions pipeline that runs entity assignment, deduplication and MHCLG data retirement automatically, and the individual jobs it runs.
• Data Quality Analysis and Investigations - a record of one-off data quality investigations, what was tried, the results, and what came of it.