The following list of new features, updates and bug fixes are included in the latest Sprint 23.07 release to the FEWS NET Data Platform.
New Features
Allow users to change column order in FDE data series and data facts views (DATA-2574)
Users can change the order of the columns in an FDE data series or data facts table, have those changes save automatically, and visit their user profile to reset any customized tables. A new popover component notifies users of these changes to the interface.
Pilot of CIAT Dashboard (DATA-2588)
A new dashboard provides analysis and visualizations of historical trends and insights from FEWS NET’s archive based on the machine learning project carried out by CIAT.
Multilayer map showing conflict related data (DATA-2805)
A map with layers showing ACLED data for conflict events as well as IOM data for migration and displaced people has been added to a new dashboard in FDW. Data is current available for Sudan.
View more information about this map in the FDW Knowledge Base.
Updates
FDE Updates
Improved performance of the FDE by cacheing frequent API calls (DATA-2628)
Minor updates to text in the FIC and FIPE domains in FDE (DATA-2760)
Public users can now access cross-border trade data in the Trade domain (DATA-2838)
Data Ingestion Updates
A new pipeline can pull conflict data from ACLED into FDW (DATA-2807)
IOM data produced on an ad hoc basis when a conflict displaces people will be manually loaded into FDW (DATA-2815)
Data Extracts Updates
The data platform FIC extracts have renamed date columns, including
"reporting_date", "projection_start",and"projection_end"and added phase breakdowns (DATA-2595)Trade flow routes can be extracted in GeoJSON format with metadata indicating a small or large flow and distinguishing domestic and import data (DATA-2801)
Metadata Management Updates
Updated country aliases metadata for FDW to align with ISO 3166, BGN, and PCGN sources (DATA-1478)
A new validation check will raise a warning when a user attempts to change season metadata in FDW that has data associated with the season, in order to prevent unnecessary changes (DATA-2653)
Standardized the renderers used in metadata viewsets by replacing conditional logic that selects the renderer with an HTML renderer for use with templates (DATA-2830)
Add data series active/inactive information to FDW API (DATA-2682)
The FDW API reliably indicates whether a data series is active or inactive. This work also supports displaying active/inactive information in FDE in the future.
Separate Data Warehouse source document to have different visibility levels (DATA-2575)
Split the Data Warehouse source document in FDW into three Calculated Dataseries Data Warehouse documents with public, FEWS NET Only and Restricted usage policies, with an additional source document for the Geographic unit versions. Existing data series have been migrated to the correct source document.
Add Country field to Data Source Document and update filtering (DATA-2410)
Adjusted the method of supporting country-level data source documents and filtering by country by adding a country field to DataSourceDocument in FDW, and ensuring all filters use country field data source documents instead of data source organization.
Bug Fixes
Bug Fixes in FDE
Duplicate geographic units no longer appear in the Crop domain for Ethiopia now that shapefile names have been standardized (DATA-2544)
Corrected the behavior of currency conversions in FDE (DATA-2641)
Fixed an issue causing datapoints for Bolivia price data to fail to materialize when extracting the data from FDE as well as in the table view. This was due to a new group assigned an ID of less than 900. The error is resolved by using the matching group with the minimum M49 code. (DATA-2895)
Addressed the behavior of the Exchange rate type filter in the Exchange Rates domain so it filters correctly for the data series and the export link (DATA-2900)
Corrected issues with saving datasets (DATA-2909)
Incorrect filtering of RM countries in IPCPhaseViewSet (DATA-2851)
Corrected Burkina Faso being excluded from the West Africa regional FIC shapefiles due to filters for countries where a remote monitoring FSC geographic unit exists. Instead, the filter will identify and exclude only the data points that use a remote monitoring FSC geographic unit.
Error when uploading a new LHZ file on the FDW (DATA-2889)
An explicit error has been added when the livelihood zone type mapping is missing upon uploading shapefiles in FDW, in response to difficulty uploading a shapefile with values that could not be mapped.
Unable to add new commodities to FDW (DATA-2912)
Fixed a user-reported issue adding a new product to FDW by adding two missing fields, "_position" and "_ref_node_id", to the Add Classified Product admin screen.