Ingestion sources and enrichment reference data¶
Inventory of data sources ingested by the platform and external reference datasets cloned for enrichment.
See also: Consolidation flow, Airflow, dbt.
Actor sources¶
All sources below are exposed as individual Airflow DAGs (manual trigger, schedule None) under data-platform/dags/sources/dags/.
Category |
Airflow DAG |
Source / endpoint |
Stream |
|---|---|---|---|
Eco-organisme |
|
ALIAPUR ( |
Tyres |
Eco-organisme |
|
BATRIBOX ( |
Batteries |
Eco-organisme |
|
CITEO |
Packaging & paper |
Eco-organisme |
|
COREPILE |
Batteries |
Eco-organisme |
|
CYCLEVIA |
Lubricants |
Eco-organisme |
|
ECODDS |
DIY & garden items, chemicals |
Eco-organisme |
|
ECOLOGIC |
ABJ, ASL, EEE |
Eco-organisme |
|
ECOMAISON |
ABJ, furniture, toys, PMCB |
Eco-organisme |
|
ECOPAE |
Chemicals |
Eco-organisme |
|
ECOSYSTEM |
EEE |
Eco-organisme |
|
PYREO |
Chemicals |
Eco-organisme |
|
REFASHION |
Textiles, linens, shoes |
Eco-organisme |
|
SOREN |
EEE |
Eco-organisme |
|
VALDELIA |
PMCB |
Eco-organisme |
|
OCAB |
OCA / PMCB |
Eco-organisme |
|
OCAD3E (QualiRépar label) |
EEE |
API |
|
CMA Réparacteurs ( |
|
API |
|
Ordre National des Pharmaciens ( |
Medicines |
ADEME |
|
ADEME SINOE ( |
Recycling centres |
Custom |
|
S3 bucket |
Ad-hoc Excel files |
Cloned enrichment reference data¶
External data cloned into the database via clone_* DAGs, then cross-referenced by dbt.
Business workflow of clone DAGs and dbt normalization logic: Clone — Enrichment reference data.
Reference data |
Source |
Usage |
|---|---|---|
BAN |
|
Actor geocoding ( |
Annuaire Entreprises (AE) |
|
SIREN/SIRET validation, closed establishment detection |
La Poste |
|
Postal codes ( |
Koumoul |
|
EPCI |
INSEE |
|
Municipalities ( |
Contours administratifs |
|
GeoJSON for municipalities / departments / regions / EPCIs / associated & delegated municipalities |