The following list of new features, updates and bug fixes are included in the latest Sprint 23.09 release to the FEWS NET Data Platform.
New Features
Retain an FDE user’s last domain search until cleared (DATA-2984)
All FDE domain pages now retain the user’s most recent search criteria. Users will see their most recent search criteria applied after refreshing a domain page, moving between pages, and between FDE sessions.
Updates
FDE Updates
Updates to the FDE were completed through the following tickets:
...
Replaced the conditional logic used to select the renderers for the data platform’s API metadata endpoints with a standardized approach.
Multi-layer conflict maps
Updates to the multi-layer conflict maps available in FDW and via the API were completed through the following tickets:
Ensured the Sudan Conflict Map can serve static versions of the image (DATA-3005)
Loaded cross border migration data for Sudan into FDW (DATA-3009)
Added cross border trade data to the Sudan Conflict Map (DATA-3010)
Added conflict maps for Mozambique and Honduras to FDW (DATA-3106)
Clean up XBT extracts (DATA-2946)
The cross border trade data API extracts have been refined by removing unnecessary fields and adding the common_unit field. The new set of fields are accessed with the query parameter ?fields=fde.
Investigate a database for storing scientific publications (DATA-3040)
FDW now has the ability to store and filter information on FEWS NET funded scientific publications.
...
Shapefiles for the administrative boundaries of Togo and an associated relationship table have been added to FDW.
ComTrade Pipeline
Updates to the ComTrade pipeline were completed through the following tickets:
The pipeline was re-enabled to ingest data into FDW using ComTrade’s new bulk API download (DATA-2948)
To accommodate reporting delays among different countries, data can now be fetched more than once, compared to the current data in FDW, and updated as appropriate. If the data has not been modified for 3 years, it will be published without requiring further checks of the data series. (DATA-2132)
ACLED API Support (DATA-3035)
Adjusted the ACLED pipeline to load all data for all countries into FDW and made it available via an API.
Load Togo Shapefiles in FDW (DATA-3011)
Shapefiles for the administrative boundaries of Togo and an associated relationship table have been added to FDW.
Multi-layer conflict maps
Updates to the multi-layer conflict maps available in FDW and via the API were completed through the following tickets:
Ensured the Sudan Conflict Map can serve static versions of the image (DATA-3005)
Loaded cross border migration data for Sudan into FDW (DATA-3009)
Added cross border trade data to the Sudan Conflict Map (DATA-3010)
Added conflict maps for Mozambique and Honduras to FDW (DATA-3106)
Create dashboard to report on failing celery tasks (DATA-3027)
A new dashboard in FDW helps monitor the data platform’s pipelines by showing the status of the required celery tasks.
...
Investigate a database for storing scientific publications (DATA-
...
3040)
Adjusted the ACLED pipeline to load all data for all countries into FDW and made it available via an APIFDW now has the ability to store and filter information on FEWS NET funded scientific publications.
Bugs
FDE Bugs
Bug fixes for the FEWS NET Data Explorer were completed through the following tickets:
...