Document toolboxDocument toolbox

Release Notes for Sprint 20.01

Owned by Hamelmal Kiros
Last updated: Feb 13, 2020 by Andrew Somers
6 min read

Introduction

Dated: 13 February 2020

In this sprint release document, the features and defects below have been resolved and deployed to the production FDW/FDE server.

  New Features            

Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46     

  • This feature is about making change on a `warehouse_datapointfacts_view` so that it excludes Data Points that are Crop Production Indicator Values (using the specialization_type) and checks on the difference in time to refresh the view before and after the change, which as a result improves performance for refreshing the Data Point Facts materialized view.

Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94      

  • This feature is about allowing users to search the exchange rate by country name and in addition, the calculated name of the exchange rate data series has also been changed to include `from_currency_iso_en_name` and the `to_currency_iso_en_name` as shown below:

 Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96     

  • This feature is about separating the Border Point value from the Market, i.e the Border Point becomes a separate list under the sub-class of the Geographic unit like shown below:

Support GeoJSON format extracts in DataPoint APIs https://fewsnet.atlassian.net/browse/DATA-130

  • This feature is about implementing GeoJSON format extracts in DataPoint APIs, which as a result, will be used in GIS tools for generating Maps, etc.

Implement an OpenAPI Schema to make it easier to use the REST API https://fewsnet.atlassian.net/browse/DATA-134

  • This enhancement is about implementing  an OpenAPI Schema to make it easier for users who wish to make API requests to use the REST API.

Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136

  • This feature is about improving the speed of FDE tables, maps and charts by only extracting the required fields.

Associate the document type based permissions to the FEWS NET Staff and FDE Only roles https://fewsnet.atlassian.net/browse/DATA-145

  • This enhancement is about associating the document types to the Groups of FDE Only & FEWS NET Staff so that the users which are assigned to the group FDE Only can access only the documents which they are allowed to access and can only view the Data Explorer, whereas the users which are assigned to the group FEWS NET Staff may access all the total documents and can also access/view the Data Explorer & Data Management.

As a FDE Only user

As a FEWS NET Staff user

 

Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149

  • This task is about upgrading Mayan to 3.3 and this upgrade introduced key major changes in the user interface of the Mayan system by introducing the features listed below:

    • Increasing the role label field size from 64 to 128 characters

    • Darkening content area when opening the mobile menu

    • Hiding the multi-item selection help text on mobile screens

    • Removing body spacer HTML and JavaScript. Not needed with the new UI

    • Adding support for icon shadows

    • Back porting the vertical main menu update

    • Adding support for menu inheritance

    • Converting document image cache to use file cache manager app. Added setting DOCUMENTS_CACHE_MAXIMUM_SIZE defaults to 500 MB

    • Using timezone aware date for document statistics

    • Updating mayan_statistics migration 0002 to rename duplicate slugs

    • Removing index create permission as an ACL permission for indexes

  • The upgrade also resolves  the bugs listed below:

    • Username color on mobile screens not being user friendly

    • The Mayan statistics app that fails to render correct value when the current month is December

Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155

  • Since FDW depends on the Pandas library to perform statistical calculations and data re-sampling and we were using version 0.22 which is very old. So this task upgraded Pandas to 0.23.4, which is a much more modern version.

Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170

  • This feature is about adding the FEWS NET only visibility option to a saved dataset of all the data domains of the FDE.

Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed https://fewsnet.atlassian.net/browse/DATA-180

  • There were crop datasets which were sourced from the Public, but these datasets had the visibility type of ‘FEWS NET Only’ so this task was to change these datasets to the ‘Public’ visibility type.

Resolved Defects                                         

Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80  

  • For about 41 countries the FNID codes of the Admin 0 units were missing the year component and it is now resolved for all of these countries.

Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146

  • Due to a configuration error at the time of migration to the FEWS NET AWS infrastructure, the fdwdev and fdwprd environments were both sharing the same Postgres database and it is resolved now.

Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156

  • On Crop data domain, the Geographic filter took longer time to popup its values than it should have, and now the performance has been improved to be more consistent with the other geographic filter values' performance.

In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166

  • Admin 3 units of some countries were shown as list of countries under both M49 or FN Regions, which was incorrect, and this has been resolved.

Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173

  • There was an issue on the data upload page, i.e when one clicks on the Add data upload button it results in the screenshot below. Users were unable to select the File, Import format, subtype, and the File field were hidden like you see in the screenshot below, and this was resolved so that the fields are now selectable.

 

 

 

 

 

 

 

 

 

Â