The following list of new features, updates and bug fixes are included in the latest Sprint 23.09 release to the FEWS NET Data Platform.
New Features
Retain an FDE user’s last domain search until cleared (DATA-2984)
All FDE domain pages now retain the user’s most recent search criteria. Users will see their most recent search criteria applied after refreshing a domain page, moving between pages, and between FDE sessions.
Updates
FDE Updates
Updates to the FDE were completed through the following tickets:
Adjusted the login flow to enable users to reset or change their password in FDE, rather than being directed to FDW (DATA-2853)
Updated the My Top Pages widget on the FDE homepage to align with the domain page names (DATA-2981)
Standardize the renderers used in metadata viewsets (DATA-2830)
Replaced the conditional logic used to select the renderers for the data platform’s API metadata endpoints with a standardized approach.
Clean up XBT extracts (DATA-2946)
The cross border trade data API extracts have been refined by removing unnecessary fields and adding the common_unit field. The new set of fields are accessed with the query parameter ?fields=fde.
ComTrade Pipeline
Updates to the ComTrade pipeline were completed through the following tickets:
The pipeline was re-enabled to ingest data into FDW using ComTrade’s new bulk API download (DATA-2948)
To accommodate reporting delays among different countries, data can now be fetched more than once, compared to the current data in FDW, and updated as appropriate. If the data has not been modified for 3 years, it will be published without requiring further checks of the data series. (DATA-2132)
Multi-Layer Conflict Maps
Updates to the multi-layer conflict maps available in FDW and via the API were completed through the following tickets:
Ensured the Sudan Conflict Map can serve static versions of the image (DATA-3005)
Loaded cross border migration data for Sudan into FDW (DATA-3009)
Added cross border trade data to the Sudan Conflict Map (DATA-3010)
Added conflict maps for Mozambique and Honduras to FDW (DATA-3106)
Load Togo Shapefiles in FDW (DATA-3011)
Shapefiles for the administrative boundaries of Togo and an associated relationship table have been added to FDW.
Create dashboard to report on failing celery tasks (DATA-3027)
A new dashboard in FDW helps monitor the data platform’s pipelines by showing the status of the required celery tasks.
ACLED API Support (DATA-3035)
Adjusted the ACLED pipeline to load all data for all countries into FDW and made it available via an API.
Investigate a database for storing scientific publications (DATA-3040)
FDW now has the ability to store and filter information on FEWS NET funded scientific publications.
Bugs
FDE Bugs
Bug fixes for the FEWS NET Data Explorer were completed through the following tickets:
Cached the api/user, api/user/current and api/fdeprofile/2 endpoints that were being hit every time a domain tab is loaded (DATA-2765)
Corrected the functionality of the built-in tour to launch automatically for new users (DATA-3031)
Adjusted the behavior of data series selection to correct an issue with all data series in the domain showing as selected after de-selecting all data series in the Selected tab, as well as an issue causing all data series in the domain to populate the preview and export panel after de-selecting all data series from the This Search tab. (DATA-3047)
Fixed an issue where the Select All button failed to select all data series. Users can now select a large number of datasets using the Select All option as expected. (DATA-3111)
Fixed an issue causing the user profile page to display a 404 error upon refresh (DATA-3064)
Fix error with django import-export if the description of another object matches the identifier (DATA-3007)
Corrected an import error in FDW that resulted from the description of another object matching the identifier. The description field has now been removed from the search on import.