The following list of new features, updates and bug fixes are included in the latest Sprint 22.10 release to the FEWS NET Data Platform.

New Features

Introduce IPC HFA data domain (DATA-557)

The FDW is now able to capture Humanitarian Food Assistance Data. This data can be accessed by going to Dataseries Management > Acute Food Insecurity > Humanitarian Food Assistance.

...

Updates available in the refreshed FDE

The refreshed FDE now has a variety of new features including:

...

• The ability for users to hide data series with zero data points (DATA-1869)

• A filter design that is useable on a variety of device types (DATA-2116new support widget (DATA-1926)

• All domains now include an info popup for each data series that includes additional information including the data usage policy (DATA-1934, DATA-2097)

• The ability for users to view metadata for selected data series within FDE (DATA-1942, DATA-1969, DATA-1972, DATA-2091)All domains now include an info popup for each data series that includes additional information including the data usage policy (DATA-2097, DATA-1934

• A filter design that is useable on a variety of device types (DATA-2116)

Read more about these features.

Introduce IPC HFA data domain (DATA-557)

The FDW is now able to capture Humanitarian Food Assistance Data. This data can be accessed by going to Dataseries Management > Acute Food Insecurity > Humanitarian Food Assistance.

...

Updates

Updates

Add filtering by keyword for News Article API (DATA-1651)

The News Article API now accepts keywords as a filter parameter.

Refreshed domain names (DATA-1922, DATA-1939)

The names of the domains in the Data Platform have been reviewed and several have been updated across the refreshed FDE, FDW, and HDX. Name changes can be reviewed here.

Refreshed FDW Interface (DATA-2040,

The FDW user interface has been refreshed to reflect the new FEWS NET brand. Changes include:

...

The News Article API now accepts keywords as a filter parameter.

Updates to KoBo Toolbox

...

...

(DATA-1778, DATA-1793, DATA-1811, DATA-1827

Description

Hello Henock and Girum,

...

• Add GPS location of the enumerator.

• Adding form submission radius not more than 10km

• When an enumerator logs in, the country and border point will be prefilled to avoid data entry errors.

DATA-1811 East Africa XBT Kobo Form Modifications

Description

...

...

• .

• Add GPS location of enumerators.

• Allow form submission only for a radius of not more than 10km

• Prefill default border-points based on the user using the form.

We opted to handle these changes separately because they are changes that affect the data collection process and relatively urgent than the rest of the Kobo data management and review issues mentioned in

...

Upgrade FEWS KoBo to latest version

Description

To be able to use the newer row-based permission feature in KoBo, we need to upgrade the KoBo version currently installed for FEWS to the latest available version.DATA-1913 Speed up api format renders of endpoints with large drop-downs

...

Some endpoints, particularly ipcphase, take a long time to render in api format (browsable), because they contain foreign keys to large tables, which are rendered as HTML SELECT OPTION tags.

We have attempted to replace them with auto-corrects, but never made a solid fix.

In most cases these would be more usable simply as TEXT inputs to type an ID in to.

Refreshed domain names (DATA-1922, DATA-1939)

The names of the domains in the Data Platform have been reviewed and several have been updated across the refreshed FDE, FDW, and HDX. Name changes can be reviewed here.

DATA-1943 Update FAO pipeline based on changes in remote api

Description

The help ticket reported

1. the datasereis api url is changed from https://fpma.apps.fao.org/giews/food-prices/tool/api/v1/series/ to https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSerie/

2. The current version also require a two step process to fetch the datapoints.
   First https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSerie/ returns the list of dataseries. Each dataseries has a guid type identifier as oppose to the previous api's series_id [eg. 8_23_642_2_434_nominal
   Then the datapoints can be fetched from a url like:
   https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSeriePrice/e23b83a7-7cf7-40b0-87f7-6c03a2d3b2bc/ and there is no datapoint_url now included in each dataseries

3. the seriesId is now has a different datatype - Guid and the column is named uuid

4. fao Country Code of value XXX used to be used to refer international prices, now they replaced that with IPS

5. market is now an id and market_name contains the name, commodity_name contains the product name where commodity used to reference

6. dateRanges field is now periodicity

These changes have side effect on the pipeline and we need to update it accordingly.

DATA-1994 Add dataset name to cross-domain dataset endpoint

Description

Make the dataset name field available on the cross-domain api/dataset endpoint

Bug Fixes

DATA-1656 Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error

DATA-1929 Unable to update datasourcedocument name

Description

As reported

DATA-1935 Investigate issues with refresh materialized views debouncing incorrectly.

Description

The EWT have been having issues with uploaded data collections taking a long time to reflect the updates in FDW. The is because the refresh materialized views have not been running correctly. These can be run manually by ssh-ing into the server and running the commands from psql, like the below;

...

DATA-1938 Fix Comtrade unit test erros

Update FAO pipeline based on changes in remote API (DATA-1943)

Description

The help ticket reported

1. the datasereis api url is changed from https://fpma.apps.fao.org/giews/food-prices/tool/api/v1/series/ to https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSerie/

2. The current version also require a two step process to fetch the datapoints.
   First https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSerie/ returns the list of dataseries. Each dataseries has a guid type identifier as oppose to the previous api's series_id [eg. 8_23_642_2_434_nominal
   Then the datapoints can be fetched from a url like:
   https://fpma.fao.org/giews/v4/price_module/api/v1/FpmaSeriePrice/e23b83a7-7cf7-40b0-87f7-6c03a2d3b2bc/ and there is no datapoint_url now included in each dataseries

3. the seriesId is now has a different datatype - Guid and the column is named uuid

4. fao Country Code of value XXX used to be used to refer international prices, now they replaced that with IPS

5. market is now an id and market_name contains the name, commodity_name contains the product name where commodity used to reference

6. dateRanges field is now periodicity

These changes have side effect on the pipeline and we need to update it accordingly.

DATA-1954 Fix safety warning for protobuf

Description

The below safety error is causing issues in the CI pipelines.

...

DATA-2083 SaveNewArticles fails for articles from multiple sources

Description

SaveNewArticle relies on ReadExistingArticles to avoid inserting duplicates.

...