Skip to main content
Digital Land
Technical Documentation
Planning Data Wiki
Architecture And Infrastructure
‹
Alerting and Monitoring Strategy
Architecture Review Checklist
Architecture Decision Records
Continuous Integration(CI)/Continuous Delivery(CD) Strategy
Data Architecture
‹
Batch Processing & Our Pipelines
Processes
‹
Collect
Plan
Transform
Infrastructure
‹
Code Repositories
Infrastructure deployment diagrams
How To Guides
‹
Change an Airflow task environment variable
Change an application environment variable
Change permissions for an application
Change permissions for a GitHub CI user
Setup aws vault
Security
Proposals
‹
Open Design Proposal 001 - Publish service - Async
Open Design Proposal 002 - Data Pipelines Migration
Open Design Proposal - 003 - Querying on Complex geometries
Open Design Proposal - 010 - Data Pipeline API
Open Design Proposal - 00X - Title (Template)
Semantic Versioning Strategy (`SEMVER.md`)
Solution Design
‹
Solution design - Check Service
Solution design - Data Pipelines
Solution design - DNS
Solution design - Planning Data Platform
Data Operations Manual
‹
Explanation
‹
Key Concepts
‹
Airflow & DAGs
Introduction
Data quality framework
Endpoint URL Types and Plugins
Organisation
Pipeline configuration
Pipeline process / data model
Specification Repo
Operational Procedures
How To Guides
‹
Adding
‹
Add a new dataset and collection
Add an endpoint
Endpoint URL Types and Plugins
Configure an endpoint
Maintaining
‹
Assign Entities
Merge Entities
Trigger collection manually
Retiring
‹
Retiring individual endpoints
Retire entities
Retire resources
Testing
‹
Building a collection locally
What are expectations?
Validating
‹
Validating an endpoint
Reference
‹
Index
Performance Database Table Construction Documentation
Tutorials
‹
Standard process
Purpose
Monitoring Data Quality
Onboarding
Development
‹
Best Practice
‹
Frontend Build Best Practices
Deploy And Release Procedure
How To Guides
‹
Installing GDAL
Installing Make
Installing SQLite
Make Python Virtual Environments
Setting up on Windows
Set Up WSL
Using Multiple Python Versions
Key Principles
Live Service
‹
Debugging Live Services
Metrics & Reporting
Raising a Live Service Request
Team Structure and Guidance
Bug Triage Process
Monitoring
Onboarding Checklist
Quality Control
‹
AI Code Reviewing with CodeRabbit
Using Preview Links with Heroku for Quality Control Testing
Testing Guidance
Tutorials
‹
Running A Data Collection Pipeline
Setting up a Mac for use on our project
Set up our main application and load data into it
Working on the Submit Service
Useful Links
Product
‹
Google Analytics User Tracking Documentation
Smartlook User Tracking Documentation
Run Book
‹
How to resolve certain issues
Managing technical incidents
Incident response history
Tutorials
You will find a list of tutorials here:
Adding Data
Maintaining Data
Monitoring Data Quality