Document toolboxDocument toolbox

Release Notes for Data Sprint 21.01

Owned by Hamelmal Kiros
Last updated: Feb 13, 2021 by Andrew Somers
7 min read

Introduction

Date: 12 February, 2021

The following list of new features, tasks, and resolved bugs are in the latest Version 21.01.1 release. Please contact Helpdesk@fews.net or visit the Helpdesk Portal if you need assistance navigating or utilizing the FEWS NET Data Explorer (FDE) or Data Warehouse (FDW).

Features

Tasks

Bugs

Features

Enhanced access control based on Data Usage Policy https://fewsnet.atlassian.net/browse/DATA-202

  • This feature enables enhanced access control by defining new data usage policies and restricting the data access by allocating to specific Users or Groups. These controls can be given down to the country level so that certain data within certain countries can be properly protected and/or accessed.

Develop a prototype of vector tiles serving using ST_AsMVT https://fewsnet.atlassian.net/browse/DATA-561

  • We have developed a prototype of vector tiles using ST_AsMVT with an MVTTileRenderer which can be viewed on spatial viewsets. When users click on a country, it will show the Admin boundaries. This capability is still undergoing changes and may not be visible to FDE users on this release; however, the functionality has been developed.

Move Indicator and Geographic Unit filters to Data Series and Data Point https://fewsnet.atlassian.net/browse/DATA-579

  • This enhancement is about moving Indicator and Geographic unit filters to DataSeries and DataPoint filters, which enables a better mechanism for searching among geographic units.

Make Geographic Unit Mandatory https://fewsnet.atlassian.net/browse/DATA-580

  • This feature is about making Geographic Unit a mandatory field for the data series of all the data domains, which will make all data series searchable within the Data Explorer. Previously, there were data series without geographic units attached to them, which made them difficult to locate and pull.

Enable production of Regional IPC pngs and shapefiles https://fewsnet.atlassian.net/browse/DATA-639

  • This feature is about enhancing the production of Regional IPC pngs and shapefile packages. Previously we had to rely on using only country_code to create maps, now we can utilize country_group to create regional maps automatically.

Import IPC Dataseries when importing Datapoints https://fewsnet.atlassian.net/browse/DATA-699

  • This enhancement is about making the IPC uploads a one step process, i.e importing the data points will create the data series which saves time and prevent errors which were caused due to sometimes missing data series.

Add 'pcgn_proper' and `pcgn_name` to Country Search https://fewsnet.atlassian.net/browse/DATA-720

  • This feature enhances the country search by adding the parameters pcgn_proper and pcgn_name to the API: https://fdw.fews.net/api/country/ which allows users to search either by "pcgn_name": "Congo, Democratic Republic", or "pcgn_proper": "Democratic Republic Congo .

Develop Prototype for Commodity Balance Sheet Domain https://fewsnet.atlassian.net/browse/DATA-722

  • The development team has produced a prototype for Commodity Balance Sheet data Domain which will be accessible via FDW here: https://fdw.fews.net/en/admin/balance/commoditybalance/. This capability is still undergoing changes and may not be visible to FDW users on this release; however, the functionality has been developed.

Make Data Series lists in Admin screens into clickable links https://fewsnet.atlassian.net/browse/DATA-733

  • This feature was about making the dataseries links clickable in all of all the admin pages (https://fdw.fews.net/en/admin/). This allows users to easily alter the Data Series belonging to a particular Data Source Document or Classified Product.

Consistent Labeling for Price Indexes https://fewsnet.atlassian.net/browse/DATA-746

  • This feature was about showing consistent labeling for the Price Index both in FDW and FDE, as shown below:

FDE

- External Price Index has been renamed to Secondary Price Index (https://fdw.fews.net/data-explorer/#/other)

FDW

- PriceIndex is renamed to Secondary Price Index and Secondary Price Indices (https://fdw.fews.net/en/admin/price/priceindex/)

- CalculatedIndex is renamed to Calculated Price Index and Calculated Price Indices (https://fdw.fews.net/en/admin/price/calculatedindex/)

Sub National Price Indexes https://fewsnet.atlassian.net/browse/DATA-747

Add totals to Crop Production and Inventory dashboards https://fewsnet.atlassian.net/browse/DATA-585

For the Crop Production dashboard, when no country is selected, the parameters below are displayed:

  • A total number of countries with crop data that exists in FDW;

  • A total number of commodities;

  • First and last period dates.

When a country is selected, users will now see:

  • A total number of commodities in the selected country;

  • First and last period dates for the selected country.

In the Data Inventory Dashboard, totals in the Number of Data Points by Data Domain table are summarized as shown below:

Tasks

Investigate performance issues on export of TradeFlowQuanity and fix https://fewsnet.atlassian.net/browse/DATA-710

Bugs

Problem with scrolling in FDE Other domain https://fewsnet.atlassian.net/browse/DATA-572

  • The Select All button of the demographic data domain, located within the Other (flexible) domain was not showing the correct selected dataseries count, and this was resolved and the functionality is working as expected.

/en/schema-ui doesn't populate Country Code lists https://fewsnet.atlassian.net/browse/DATA-581

  • Using the openapi/swagger end point, the "Try it out" option was not populating the Country Code select list (http://fdw.fews.net/en/schema-ui/) and this was resolved.

Country names not appearing in FDE when filtering exchange rate data https://fewsnet.atlassian.net/browse/DATA-584

  • The country names were not shown when filtering by the Exchange rate subtype of the Other data domain and this was resolved.

Some of the top menus of the Home page i.e (Change password , Recent Actions i.e (list) , Help with the current page) are not shown https://fewsnet.atlassian.net/browse/DATA-647

  • When navigating the FDW Admin page, some of the top menu information (https://fdw.fews.net/en/admin/) under the Welcome ( i.e Change password, Recent Actions, and Help) were hidden and this was resolved.

Production Time Series for Senegal appears incomplete https://fewsnet.atlassian.net/browse/DATA-697

  • There was an issue in accessing the full time series extent of the crop data in the Data Explorer for the country Senegal, and this was resolved.

The data extract buttons (i.e Download & Browse) of the calculated data series page are not working https://fewsnet.atlassian.net/browse/DATA-702

PandasShapefileRenderer doesn't support multiple Geographic Unit Types https://fewsnet.atlassian.net/browse/DATA-704

  • The system was throwing an error when using more than one Geographic Unit Type parameter and this was resolved.

MultipleObjectsReturned('get() returned more than one UnitOfMeasureConversion -- it returned 2 https://fewsnet.atlassian.net/browse/DATA-708

  • The system was throwing the following error message: MultipleObjectsReturned('get() returned more than one UnitOfMeasureConversion, which was happening for having two unit of measure conversions for the same unit, and this was resolved. Validation has also been added on UnitOfMeasureConversion which prevents duplicate entries. The duplicates which were previously showing in the Production Environment are now cleared.

Country_code missing from DataCollectionSerializer and DataCollectionPeriodSerializer https://fewsnet.atlassian.net/browse/DATA-718

Filtering by border point field of the trade data domain results in Impossible to fetch error message https://fewsnet.atlassian.net/browse/DATA-729

  • Trying to filter trade data by the border point field was resulting in an Impossible to fetch error, and this was resolved. The functionality is working as expected.

Metadata errors uploading FEWS NET/WFP/IAPRI Southern Africa, trade https://fewsnet.atlassian.net/browse/DATA-735

  • There was an issue on the import screen in uploading the metadata of FEWS NET/WFP/IAPRI Southern Africa that was causing unexpected results in FDW and this was resolved.