Introduction
The following list of new features, tasks, and resolved bugs are included in the latest Sprint 21.06 release to FDW/FDE:
Features
Review the pre-processing and matching of DataSourceDocuments in uploads - https://fewsnet.atlassian.net/browse/DATA-935
Add collection_start_date and collection_end_date filters to DataPointFilter - https://fewsnet.atlassian.net/browse/DATA-968
Replace Staple Food Price Data Set on Data center with direct download from FDW - https://fewsnet.atlassian.net/browse/DATA-906
Investigate dissolve performance in /api/ipcpasemap - https://fewsnet.atlassian.net/browse/DATA-621
Standard Price Charts in Superset - https://fewsnet.atlassian.net/browse/DATA-987
Support fields parameter for geojson extracts of DataPointViewSet - https://fewsnet.atlassian.net/browse/DATA-969
Tasks
Trade Flow resource generates lots of duplicate queries https://fewsnet.atlassian.net/browse/DATA-950
Enable extraction of reusable visualizations JSON format - https://fewsnet.atlassian.net/browse/DATA-993
Bugs
Zimbabwe common currency prices not being calculated in data extracts - https://fewsnet.atlassian.net/browse/DATA-533
Fix price charts located under the “Old Charts” tab - https://fewsnet.atlassian.net/browse/DATA-560
Error uploading ET 2018 abd 2009 LHZ shapefiles - https://fewsnet.atlassian.net/browse/DATA-784
Investigate potential templates (auto-complete field) loading issue with the new Autocomplete functionality - https://fewsnet.atlassian.net/browse/DATA-957
MarketProduct search doesn’t recognize partial Price Types - https://fewsnet.atlassian.net/browse/DATA-961
Error extracting Haiti and Madagascar availability data - https://fewsnet.atlassian.net/browse/DATA-1000
Collection date field is not automatically populated on the data collection page - https://fewsnet.atlassian.net/browse/DATA-1002
Features
Review the pre-proessing and matching of DataSourceDocuments in uploads - https://fewsnet.atlassian.net/browse/DATA-935
This feature is about removing trailing spaces in DataSourceDocment names.
Add collection_start_date and collection_end_date flters to DataPointFilter - https://fewsnet.atlassian.net/browse/DATA-968
This feature enables users to easily update local data visualizations each month via the API by using the ‘collection_start_date’ and ‘collection_end_date’ filters in the Data Point Filter.
Replace Staple Food Price Data Set on Data center with direct download from FDW - https://fewsnet.atlassian.net/browse/DATA-906
Investigate dissolve performance in /api/ipcpasemap - https://fewsnet.atlassian.net/browse/DATA-621
This feature improved the performance of GeoJSON downloads for map visualizations by dissolving internal boundaries prior to extraction.
Standard Price Charts in Superset - https://fewsnet.atlassian.net/browse/DATA-987
This feature developed standard price charts in superset and applied customization where possible.
Support fields parameter for geojson extracts of DataPointViewSet - https://fewsnet.atlassian.net/browse/DATA-969
This feature enables the users to download the subset of fields for IPC data required for analysis
Add Component Tests for FDE2 - https://fewsnet.atlassian.net/browse/DATA-960
This feature creates component tests for react components in FDE2
Tasks
Enable extraction of reusable visualizations JSON format - https://fewsnet.atlassian.net/browse/DATA-993
This task enables the successful extraction of reusable visualizations as a JSON object
Upgrade Django to 3.2 - https://fewsnet.atlassian.net/browse/DATA-942
This task upgrades Django from version 3.1 to 3.2 which includes features such as:
Customizing type of auto-created primary keys
Functional indexes
New decorators for the admin site
Admin theming support
Creating reusable aliases for expressions that do not need to be selected but are used for filtering, ordering, or as part of complex expressions
Confirm IPC Node checking notification works in PROD - https://fewsnet.atlassian.net/browse/DATA-988
This task confirms that the IPC Node Checking notifications are working correctly.
Support to Sudan Farmers API Testing - https://fewsnet.atlassian.net/browse/DATA-897
This task supports testing of the Sudan farmers API and applies relevant modifications to the FAO pipelines.
Investigation: Plotly cs mapbox vs Echart for the FDE2 map component - https://fewsnet.atlassian.net/browse/DATA-984
This task reviews the differences between the base library for Mapbox and the mapping features of Plotly for the FDE2 map component.
Bugs
Semi structured domain api/Deomographyvalue endpoint CSV format raises KeyError - https://fewsnet.atlassian.net/browse/DATA-848
Error uploading ET 2018 abd 2009 LHZ shapefiles - https://fewsnet.atlassian.net/browse/DATA-784
Users received an internal server error when attempting to upload ET 2018 and 2009 LHZ shapefiles. This issue was resolved.
Fix price charts located under the “Old Charts” tab - https://fewsnet.atlassian.net/browse/DATA-560
X-Axis labels, chart styles and tab names required updates on the Old Charts tab. This issue was resolved.
Investigate potential templates (auto-complete field) loading issue with the new Autocomplete functionality - https://fewsnet.atlassian.net/browse/DATA-957
Users experienced loading issues and were unable to select the data source organization while in the data source document add form. This issue was resolved. https://fdwdev.fews.net/en/admin/warehouse/datasourcedocument/add/
Create_sample_data doesn’t work on production containers - https://fewsnet.atlassian.net/browse/DATA-992
Error extracting Haiti and Madagascar availability data - https://fewsnet.atlassian.net/browse/DATA-1000
Users received an error message when attempting to extract availability data for Haiti and Madagascar in FDW. This issue was resolved.
MarketProduct search doesn’t recognize partial Price Types - https://fewsnet.atlassian.net/browse/DATA-961
Abbreviated price types were not recognized in Market Product searches. This issue was resolved.
Zimbabwe common currency prices not being calculated in data extracts - https://fewsnet.atlassian.net/browse/DATA-533
Zimbabwe common currency prices were not being calculated or presented in data extracts. This issue was resolved.
Collection date field is not automatically populated on the data collection page - https://fewsnet.atlassian.net/browse/DATA-1002
In FDW, the Collection Date field was not automatically populated on the Add Data Collection page. This issue was resolved. https://fdw.fews.net/en/admin/warehouse/datacollection/add/