Versions Compared

Old Version 1

changes.mady.by.user Allison Nederveld

Saved on

compared with

New Version 2

changes.mady.by.user Zoe Wingate

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The following list of new features, updates and bug fixes are included in the latest Sprint 22.12 release to the FEWS NET Data Platform.

New Features

Standard Visualizations 

A variety of standard visualizations are now available on the new FEWS NET homepage and for use in the CMS report builder. This includes the following:

  • A Price with Projection standard visualization, most typically used for a staple food price, that shows the price of a product with the projection (DATA-1623)

  • Terms of Trade Standard Visualizations showing livestock-to-product terms of trade comparisons DATA-2018)

  • A Price Bulletin Standard Visualization (DATA-62) which includes narrative metadata for countries and regions as added in the FDW admin screens (DATA-2188)

  • The homepage visualization of Annual Peak Needs (DATA-2298)

  • Display of current prices on the Commodity Price Change Map (DATA-2021)

New FDW Search and Filter Options

Data can be more efficiently filtered in the FDW through the following features:

  • The filter pane in the FDW now includes a search box which can be used to narrow down the available filters (DATA-2336)

  • Dataseries Admin screens have a FEWS NET Country Group filter option to allow the selection of data for a given region (DATA-2160)

...

Updates

Metadata Management Updates

The management of metadata in the FDW has been refined through the inclusion of additional information and new endpoints. Updates include:

  • Comprehensive metadata endpoints are available for the Nutrition and Population subtypes of the Survey domain (DATA-1978)

  • Metadata endpoints for ‘commoditybalancevalue’ and ‘commoditybalancefacts’ have been created for the Balance domain (DATA-1970)

  • A metadata endpoint has been created for Calculated Price Indexes (DATA-1971)

  • All existing indicators now include values in the aggregation and description fields (DATA-1973)

  • The data source document field for datausage_notes is included in the metadata API extracts as part of the description column (DATA-2082)

  • The availability and availability description columns are included in ‘fields=simple’ (DATA-2300)

  • All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-1972)

Improvements to Extracts and APIs

Data extraction has been made more comprehensive and accurate through the following updates:

  • Users can now define a list of extra fields per geographic unit type for inclusion in API extracts (DATA-1612)

  • The FNID, a unique code used to identify every Geographic Unit in the system, is now included in all Spatial extracts, simple or otherwise (DATA-2238) 

  • An API has been created for Seasons data (DATA-2253)

  • The ‘geographicrelationship’ API endpoint returns fields for label and category (DATA-2219)

  • A new spreadsheet in EmergencyFoodAssistancePeakNeedsListViewSet is being used for api/efapeakneeds/ due to issues with csv parsing when column headers contain special characters or spaces (DATA-2213)

  • A full name column has been added to Data Source Documentation Organization to allow the entire name to be included in all metadata extracts. (DATA-2301)

Peak Needs data loaded into the FIPE domain (DATA-1525)

Peak Needs data is loaded into the FIPE domain through a new data source document, and appears as a new indicator for the Import Dependency Dashboard.

Improved Dataseries Table Pagination (DATA-2162)

Pagination has been added to the FDE dataseries table to improve the loading of results. 

Automatically publish ComTrade data after 3 years of no updates (DATA-2132)

The data pipeline from Comtrade to the FDW now accommodates possible delays among different countries, as some countries may take several years to submit all trade data due to infrastructure limitations. Data can be fetched more than once and compared to the data in the FDW in order to update it as appropriate. If the data has not been modified for 3 years, it will be published without the need for further checks of the data series. 

Data collection text boxes for metadata (DATA-2198)

The inline tabular display for data collections was improved to allow users to see the full text of important metadata columns.

Bug Fixes

Change country name of the exchange rate of Bolivar Digital per USD from World to Venezuela (DATA-2294)

Fix FDE Trade Filters (DATA-2234)

The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file.

Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error (DATA-1656)

The 500 Internal Server Error was caused by data points from the Source Document id: 7127, name: "FAO, Statistics Division" whose values are NaN instead of a numeric or a null value. The error was resolved by running a clean up query in the database.

MarketPriceProjectionvalue period date is not the last day of the month (DATA-2215)

The output of SemiStructuredDataPoint.objects.filter( 2 dataseries=6827441, 3).values( 4 'datacollectionperiod__period_date', 5) gave incorrect period dates that do not correspond to the last day of the month. The monthly data source documents will now be checked and corrected for the period date being the last day of the month where applicable.

Bug Fixes in the FDE

  • The FdeProfileViewSet has been updated to operate in the same way as the UserViewSet with the CurrentUserOnly permission class, and allows the API to return a list of profiles to a superuser with permissions (DATA-2305)

  • The height of the API LINK div on the Price Table was reduced to eliminate an overlap with the horizontal scroll bar for Ubuntu OS running Chrome (DATA-2296)

  • An error causing scroll bars to malfunction after closing the FDE guided tour has been fixed to allow users to scroll normally (DATA-2299)

  • The Reset Search button on FDE domain pages has been corrected to clear only the existing search parameters, and not a user’s selected data series. (DATA-2323)

  • The height of the FDE filter header and the placement of the ‘save search’ button after search parameters are entered have been corrected (DATA-2324)

  • The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)