Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Dated: 08 April, 2020

Introduction

In this sprint release Release Notes document, the following main features, tasks and defects are resolved have been resolved by the Hub Data team and deployed to the FDE/FDW production server - Version 20.03.6.

Features

Tasks

Bugs/Defects

Features/Tasks

Customizable domains for semi-structured data https://fewsnet.atlassian.net/browse/DATA-97

  • This feature is about customizing the domains to manage the semi-structured data types, adding more flexibility to the platform. For example, we can now create new Data Series subtypes by defining the requirements in metadata.

Add Survey Type as part of the unique identifier for Survey Population Indicator, so that imports do not overwrite https://fewsnet.atlassian.net/browse/DATA-133

  • This feature is about adding the survey type as a part of unique identifier which allows to create Data Source Documents with the same name but different Document Types which in turn allows us to avoid the problem where loading crop production data overwrites existing crop production data of different survey type.

...

Automated Ingestion of Market Price Data from FAO using their API https://fewsnet.atlassian.net/browse/DATA-162

  • This feature is about a prototype for automating API ingestion, and specifically using the APIs' API for automating the ingestion of the FAO market price data of the FAO.

Fill geographic filter property even when item does not have parent id https://fewsnet.atlassian.net/browse/DATA-184

  • This feature is about displaying the geographic filter list of the IPC FIC data domain with the correct level of hierarchy.

...

Enhance Data Inventory Dashboard to include Data Points by Domain and Usage Policy https://fewsnet.atlassian.net/browse/DATA-213

  • This feature is about visualizing the data points break broken down by data domains and data usage policies.

...

Sub National Crop Production Data Visualization https://fewsnet.atlassian.net/browse/DATA-224

  • This feature is about visualizing crop production data at the corresponding admin levels, which in addition shows the spatial representation of the data according to the crop production value.

...

Bulk load of Crop Production Country Archives https://fewsnet.atlassian.net/browse/DATA-144

  • This task was about uploading the archive data of the crop production and all the data loaded into the systemassisting in the uploading a large set of crop production data from multiple countries, and the data was successfully loaded.

Develop list of Metadata Types and recommend maintainers https://fewsnet.atlassian.net/browse/DATA-210

Develop FDW/FDE Infrastructure Design Artifacts https://fewsnet.atlassian.net/browse/DATA-217

Develop FDW/FDE Software Design Artifacts https://fewsnet.atlassian.net/browse/DATA-218

  • This task was about developing an artifacts around document which describes the Software Design of FDE/FDW to include: a List list of Software, System Data Types, a Data Flow Diagram, and API Designs & it’s available at https://drive.google.com/drive/u/0/folders/1VKoFSeFfTx07hbX_6ibI4g5EuUe0fF-f software, system data types, a data flow diagram, and API designs. This has been delivered directly to USAID.

Develop FDW/FDE Configuration and Misc Artifacts https://fewsnet.atlassian.net/browse/DATA-219

Resolved Bugs/Defects

Increase ECS memory allocation for Mayan celery_slow container ​ https://fewsnet.atlassian.net/browse/DATA-147

  • There was an issue upon loading a document using the bulk upload process and it was due to low memory allocation of the Mayan celery_slow container. This was resolved by increasing the memory of Mayan celery_slow container.

FDW services sending double emails ​https://fewsnet.atlassian.net/browse/DATA-177

  • The FDW services were sending duplicate emails while resetting password function and this was resolved.

Warehouse.tasks.cache_datasourcedocumentviewset_list is extremely slow https://fewsnet.atlassian.net/browse/DATA-204

  • The warehouse.tasks.cache_datasourcedocumentviewset_list was very slow and by introducing the performance improvements and the feature that adds the survey type as part of unique identifier has improved the performance of the endpoint.

DRC market exchange rates upload file not recognized https://fewsnet.atlassian.net/browse/DATA-221

  • There was an issue in recognizing the monthly exchange rate values of the country DRC . This was caused due to the meta data change of the file and resolved.

Missing metadata from single price data series extract of the FDW ​https://fewsnet.atlassian.net/browse/DATA-227

  • Some meta data metadata information were was not available on the extracts of the price Price data series and this was resolved by displaying those meta data metadata under the /admin/price/marketproduct/.

IPC FIC drop down menu on the FDE ​https://fewsnet.atlassian.net/browse/DATA-228

  • The scale filter values of the IPC FIC data domain were incorrectly shown as IPC20 and IPC30. This was resolved and currently the values are shown as IPC v2.0 and IPC v3.0.

...

Markets bulk upload results in errors ​https://fewsnet.atlassian.net/browse/DATA-237

...