Dated: 13 February 2020
In this sprint release document, the features and defects below have been resolved and deployed to the production FDW/FDE server.
Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46
Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94
Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96
Support GeoJSON format extracts in DataPoint APIs https://fewsnet.atlassian.net/browse/DATA-130
Implement an OpenAPI Schema to make it easier to use the REST API https://fewsnet.atlassian.net/browse/DATA-134
Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136
Associate the document type based permissions to the FEWS NET Staff and FDE Only roles https://fewsnet.atlassian.net/browse/DATA-145
Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149
Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155
Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170
Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed https://fewsnet.atlassian.net/browse/DATA-180
Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80
Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146
Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156
In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166
Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173
This feature is about making change on a `warehouse_datapointfacts_view` so that it excludes Data Points that are Crop Production Indicator Values (using the specialization_type) and checks on the difference in time to refresh the view before and after the change, which as a result improves performance for refreshing the Data Point Facts materialized view.
This feature is about allowing users to search the exchange rate by country name and in addition, the calculated name of the exchange rate data series has also been changed to include `from_currency_iso_en_name` and the `to_currency_iso_en_name` as shown below:
This feature is about separating the Border Point value from the Market, i.e the Border Point becomes a separate list under the sub-class of the Geographic unit like shown below:
This feature is about implementing GeoJSON format extracts in DataPoint APIs, which as a result, will be used in GIS tools for generating Maps, etc.
This enhancement is about implementing an OpenAPI Schema to make it easier for users who wish to make API requests to use the REST API.
This feature is about improving the speed of FDE tables, maps and charts by only extracting the required fields.
This enhancement is about associating the document types to the Groups of FDE Only & FEWS NET Staff so that the users which are assigned to the group FDE Only can access only the documents which they are allowed to access and can only view the Data Explorer, whereas the users which are assigned to the group FEWS NET Staff may access all the total documents and can also access/view the Data Explorer & Data Management.
As a FDE Only user
As a FEWS NET Staff user
This task is about upgrading Mayan to 3.3 and this upgrade introduced key major changes in the user interface of the Mayan system by introducing the features listed below:
Increasing the role label field size from 64 to 128 characters
Darkening content area when opening the mobile menu
Hiding the multi-item selection help text on mobile screens
Removing body spacer HTML and JavaScript. Not needed with the new UI
Adding support for icon shadows
Back porting the vertical main menu update
Adding support for menu inheritance
Converting document image cache to use file cache manager app. Added setting DOCUMENTS_CACHE_MAXIMUM_SIZE defaults to 500 MB
Using timezone aware date for document statistics
Updating mayan_statistics migration 0002 to rename duplicate slugs
Removing index create permission as an ACL permission for indexes
The upgrade also resolves the bugs listed below:
Username color on mobile screens not being user friendly
The Mayan statistics app that fails to render correct value when the current month is December
Since FDW depends on the Pandas library to perform statistical calculations and data re-sampling and we were using version 0.22 which is very old. So this task upgraded Pandas to 0.23.4, which is a much more modern version.
This feature is about adding the FEWS NET only visibility option to a saved dataset of all the data domains of the FDE.
There were crop datasets which were sourced from the Public, but these datasets had the visibility type of ‘FEWS NET Only’ so this task was to change these datasets to the ‘Public’ visibility type.
For about 41 countries the FNID codes of the Admin 0 units were missing the year component and it is now resolved for all of these countries.
Due to a configuration error at the time of migration to the FEWS NET AWS infrastructure, the fdwdev and fdwprd environments were both sharing the same Postgres database and it is resolved now.
On Crop data domain, the Geographic filter took longer time to popup its values than it should have, and now the performance has been improved to be more consistent with the other geographic filter values' performance.
Admin 3 units of some countries were shown as list of countries under both M49 or FN Regions, which was incorrect, and this has been resolved.
There was an issue on the data upload page, i.e when one clicks on the Add data upload button it results in the screenshot below. Users were unable to select the File, Import format, subtype, and the File field were hidden like you see in the screenshot below, and this was resolved so that the fields are now selectable.
