The following list of new features, updates and bug fixes are included in the latest Sprint 22.08 release to FDW/FDE.

Updates

Data source document permissions and filter in FDW

• A new collect_datasourcedocument permission allows more granular access permissions to data source documents in FDW than the existing manage_datasourcedocument permission. The new permission grants users access to add and edit data collections and has enabled a new filter. When uploading data on the data collection page, the new filter only shows the data source documents for which the user has the collect_datasourcedocument permission.

• This update includes the following Jira issues:

  • FDW data source filter on data collection screen (DATA-1462)

  • Add collect_datasourcedocument permission to fdw. (DATA-1638)

Update the IPC Classification model in the FDW

...

(

...

DATA-1667)

• All instances of using the IPC31 value in FDW have been be replaced with the choices label IPC 3.1.

New data ingestion pipelines

• Two new pipelines have been established to ingest data collections from the field via MagPi and KoBoToolbox into the data platform. Metadata match reports are being automatically generated as part of the new pipelines.

• This update includes the following Jira issues:

  • XBT Ingestion pipeline from Kobo toolbox (DATA-1669)

  • Price Ingestion pipeline from MagPi to FDW for Ethiopia (DATA-1671)

Bug Fixes

Fix IPC 3.1 migration (DATA-1753)

• The IPC 3.1 migration caused duplicate names to be produced due to the way the geographic unit name was calculated. This has been fixed and the IPC migration now runs correctly.

Not possible to edit data point values of the Survey data domains i.e (Crop production , Nutrition and Population) (DATA-1807)

• Trying to edit the data point values of the survey data domains (i.e., Crop, Nutrition, and Population) was resulting in an error message. The issue has been fixed and survey domain data points can now be successfully edited.

Unable to edit data point (DATA-1713)

...

IPC FIC shapefile updates

• Food insecurity classification data and shapefiles have been updated in several ways. For example, empty data sets were removed, the list of viewable fields was updated for data.fews.net and fews.net, and more standardized tags were incorporated. In addition, data sets for historic IPC shapefiles were re-organized.

• This update includes the following Jira issues:

  • Update IPC FIC Shapefile publishing to publish to data.fews.net and HDX as well as website (DATA-1721)

  • Publish historic IPC FIC Shapefiles to data.fews.net and HDX (DATA-1723)

Update IPC FIPE Serializer (DATA-1724)

• The list of default fields for Food Insecure Population Estimates data in the API, FDE and on fews.net and data.fews.net has been updated to the following: source_organization, source_document, country, country_code, geographic_group, fewsnet_region, admin_0, admin_1, admin_2, admin_3, admin_4, phase, scenario_name, indicator_group, indicator_name, start_date, period_date, scenario, data_usage_policy, collection_schedule, phase_name, and population_range.

Support Price Projection domain in Add Data Collection (DATA-1744)

• Price projection spreadsheets can now be uploaded to an existing data source document using Add Data Collection in FDW.

Bug Fixes

Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error (DATA-1656)

• Attempting to open the Semi structured data points page in the FDW was resulting in an error caused by data points from the Source Document with values of NaN instead of a numeric or a null value. This issue was resolved and the page can now be accessed.

Privacy policy link broken in FDE and FDE2 (DATA-1703)

• The link in the footer of FDE to the FEWS NET privacy policy was broken. It is now linked to the correct page.

Unable to edit data point (DATA-1713)

• Trying to edit IPC Population data collections was resulting in an error message due to data series with empty values being set with a default status of Collected. Setting the default status to Not collected has resolved the error and users are now able to edit the data collections.

Remove the {% trans %} tag for all error pages (DATA-1726)

• Error pages in FDW were incorrectly showing a {% trans %} tag. This issue has been fixed and error pages are now showing correct messages.

Fix IPC 3.1 migration (DATA-1753)

• The IPC 3.1 migration caused duplicate names to be produced due to the way the geographic unit name was calculated. This has been fixed and the IPC migration now runs correctly.

Trying to search any article from the admin screen page results in 500 Internal error (DATA-1765)

...

• The FIC domain in the FDE was only returning greyed out data series due to there being no data points associated with them. A filter was added to only return data series with at least one data point.

Not possible to edit data point values of the Survey data domains i.e (Crop production , Nutrition and Population) (DATA-1807)

• Trying to edit the data point values of the survey data domains (i.e., Crop, Nutrition, and Population) was resulting in an error message. The issue has been fixed and survey domain data points can now be successfully edited.