The following list of new features, updates and bug fixes are included in the latest Sprint 22.12 release to the FEWS NET Data Platform.
New Features
Standard Visualizations
A variety of standard visualizations are now available using the API. This includes the following:
A Price with Projection standard visualization, most typically used for a staple food price, that shows the price of a product with the projection (DATA-1623)
Terms of Trade Standard Visualizations showing livestock-to-product terms of trade comparisons DATA-2018)
A Price Bulletin Standard Visualization (DATA-62) which includes narrative metadata for countries and regions as added in the FDW admin screens (DATA-2188)
The homepage visualization of Annual Peak Needs (DATA-2298)
Display of current prices on the Commodity Price Change Map (DATA-2021)
New FDW Search and Filter Options
Data can be more efficiently filtered in the FDW through the following features:
The filter pane in the FDW now includes a search box which can be used to narrow down the available filters (DATA-2336)
Dataseries Admin screens have a FEWS NET Country Group filter option to allow the selection of data for a given region (DATA-2160)
Updates
Metadata Management Updates
The management of metadata in the FDW has been refined through the inclusion of additional information and new endpoints. Updates include:
Metadata endpoints for ‘commoditybalancevalue’ and ‘commoditybalancefacts’ have been created for the Balance domain (DATA-1970)
All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-1972)
All existing indicators now include values in the aggregation and description fields (DATA-1973)
The data source document field for
datausage_notes
is included in the metadata API extracts as part of the description column (DATA-2082)Foreign name fields have been added to
GeographicUnitSerializer
(DATA-2153)The
availability
andavailability description
columns are included in ‘fields=simple’ (DATA-2300)
Improvements to Extracts and APIs
Data extraction has been made more comprehensive and accurate through the following updates:
Users can now define a list of extra fields per geographic unit type for inclusion in API extracts (DATA-1612)
The FNID, a unique code used to identify every Geographic Unit in the system, is now included in all Spatial extracts, simple or otherwise (DATA-2238)
An API has been created for Seasons data (DATA-2253)
The ‘geographicrelationship’ API endpoint returns fields for label and category (DATA-2219)
A new spreadsheet in EmergencyFoodAssistancePeakNeedsListViewSet is being used for
api/efapeakneeds/
due to issues withcsv
parsing when column headers contain special characters or spaces (DATA-2213)A full name column has been added to Data Source Documentation Organization to allow the entire name to be included in all metadata extracts. (DATA-2301)
FDE Refinements
FDE user experience was refined through the following tickets:
The list of most visited domains and datasets was updated to be more accurate (DATA-1813)
The guided tour was integrated into a user profile in order to automatically launch the tour for first-time users (DATA-1877)
Pagination has been added to the dataseries table to improve the loading of results (DATA-2162)
Update to the language of the download notification (DATA-2325)
Automated ingestion of Price Projection spreadsheets from Google Drive (DATA-1879)
A luigi pipeline was developed to ingest price projection spreadsheets from Google Drive.
Upload capital city names and coordinates to the Country table (DATA-2000)
Capital city names and coordinates have been added to the Country table, and are returned by a country serializer.
Data collection text boxes for metadata (DATA-2198)
The inline tabular display for data collections was improved to allow users to see the full text of important metadata columns.
Bug Fixes
Change country name of the exchange rate of Bolivar Digital per USD from World to Venezuela (DATA-2294)
The secondary exchange rate for VED (Bolivar Digital) per USD listed ‘World’ as the country. This has been corrected to list Venezuela.
Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error (DATA-1656)
The 500 Internal Server Error was caused by data points from the Source Document id: 7127, name: "FAO, Statistics Division"
whose values are NaN
instead of a numeric or a null
value. The error was resolved by running a clean up query in the database.
MarketPriceProjectionvalue period date is not the last day of the month (DATA-2215)
The output of SemiStructuredDataPoint.objects.filter( 2 dataseries=6827441, 3).values( 4 'datacollectionperiod__period_date', 5)
gave incorrect period dates that do not correspond to the last day of the month. The monthly data source documents will now be checked and corrected for the period date being the last day of the month where applicable.
Bug Fixes in the FDE
An issue with the FDE sidebar not retaining the user’s scroll position was corrected to function correctly within and across pages (DATA-2074)
The knowledge base widget article sidebar was fixed so text does not overflow out of the components (DATA-2075)
Maps in FDE were not resizing correctly when the main sidebar is collapsed. Maps now fill the interface in response to user interactions (DATA-2122)
The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file (DATA-2234)
The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)
The selected tab underline in FDE data series table did not match the label width. This was corrected so that the selected tab underline matches the length and position of the tab’s text label. (DATA-2282)
The height of the API LINK div on the Price Table was reduced to eliminate an overlap with the horizontal scroll bar for Ubuntu OS running Chrome (DATA-2296)
An error causing scroll bars to malfunction after closing the FDE guided tour has been fixed to allow users to scroll normally (DATA-2299)
The Reset Search button on FDE domain pages has been corrected to clear only the existing search parameters, and not a user’s selected data series. (DATA-2323)
The height of the FDE filter header and the placement of the ‘save search’ button after search parameters are entered have been corrected (DATA-2324)