Overview
The Collector module orchestrates automated data collection from external sources. Each data source is represented as a DataSource model in the admin panel, with an associated collection command and logging via CollectionLog.
Triggering Collection
Collections can be triggered:
- Via browser — Navigate to
/collector/collect/<id>/. - Via CLI — Run the management command directly.
- Via cron/scheduler — Schedule commands to run at regular intervals.
Full Command Reference
| Command | Data Type | Source |
|---|---|---|
collect_rainfall | Weekly rainfall forecast | FTP (GeoTIFF) |
collect_month_rainfall_forecast | Monthly rainfall forecast | FTP |
collect_season_rainfall_forecast | Seasonal rainfall forecast | FTP |
collect_week_temperature_forecast | Weekly temperature | FTP |
collect_month_temperature_forecast | Monthly temperature | FTP |
collect_season_temperature_forecast | Seasonal temperature | FTP |
collect_economy | CPI, inflation, food inflation | Trading Economics API |
collect_currency | Exchange rates | currencyapicom |
collect_displacement | Refugee data | UNHCR |
collect_idp | IDP data | UNHCR |
collect_iom_idp | IDP data | IOM DTM API |
collect_fi | IPC food insecurity | IPC |
collect_country_fi | Country IPC data | IPC |
collect_cropyield | Crop production | FAO FAOSTAT |
collect_food_prices_ken | Kenya food prices | WFP DataBridges |
collect_livestock_prices_ken | Kenya livestock prices | WFP DataBridges |