Skip to main content

Trigger collection manually

Data collection pipelines are executed via Airflow.

Collections are usually run on a scheduled-basis by having them selected in the scheduling configuration of airflow-dags repo. However, if you want to execute a collection run manually, you can do so by
navigating to the Airflow UI, finding the relevant collection DAG and clicking the corresponding play button (blue triangle) to trigger an execution e.g.

Airflow DAG play button execution

Depending on the collection, this can take a while but after it has finished running you can check on datasette if the expected data is on the platform.