Skip to end of banner
Go to start of banner

December 2022/January 2023 Release Notes

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 7 Next »

The following list of new features, updates and bug fixes are included in the latest Sprint 22.12 release to the FEWS NET Data Platform.

New Features

Standard Visualizations 

A variety of standard visualizations are now available using the API. This includes the following:

  • A Price with Projection standard visualization, most typically used for a staple food price, that shows the price of a product with the projection (DATA-1623)

  • Terms of Trade Standard Visualizations showing livestock-to-product terms of trade comparisons DATA-2018)

  • A Price Bulletin Standard Visualization (DATA-62) which includes narrative metadata for countries and regions as added in the FDW admin screens (DATA-2188)

  • The homepage visualization of Annual Peak Needs (DATA-2298)

  • Display of current prices on the Commodity Price Change Map (DATA-2021)

New FDW Search and Filter Options

Data can be more efficiently filtered in the FDW through the following features:

  • The filter pane in the FDW now includes a search box which can be used to narrow down the available filters (DATA-2336)

  • Dataseries Admin screens have a FEWS NET Country Group filter option to allow the selection of data for a given region (DATA-2160)

The new search box appears at the top of the filter pane. The new FEWS NET Country Group filter selects all by default, with the option to select a particular region.

Updates

Metadata Management Updates

The management of metadata in the FDW has been refined through the inclusion of additional information and new endpoints. Updates include:

  • Comprehensive metadata endpoints are available for the Nutrition and Population subtypes of the Survey domain (DATA-1978)

  • Metadata endpoints for ‘commoditybalancevalue’ and ‘commoditybalancefacts’ have been created for the Balance domain (DATA-1970)

  • A metadata endpoint has been created for Calculated Price Indexes (DATA-1971)

  • All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-1972)

  • All existing indicators now include values in the aggregation and description fields (DATA-1973)

  • The data source document field for datausage_notes is included in the metadata API extracts as part of the description column (DATA-2082)

  • Foreign name fields have been added to GeographicUnitSerializer (DATA-2153)

  • The availability and availability description columns are included in ‘fields=simple’ (DATA-2300)

Improvements to Extracts and APIs

Data extraction has been made more comprehensive and accurate through the following updates:

  • Users can now define a list of extra fields per geographic unit type for inclusion in API extracts (DATA-1612)

  • The FNID, a unique code used to identify every Geographic Unit in the system, is now included in all Spatial extracts, simple or otherwise (DATA-2238) 

  • An API has been created for Seasons data (DATA-2253)

  • The ‘geographicrelationship’ API endpoint returns fields for label and category (DATA-2219)

  • A new spreadsheet in EmergencyFoodAssistancePeakNeedsListViewSet is being used for api/efapeakneeds/ due to issues with csv parsing when column headers contain special characters or spaces (DATA-2213)

  • A full name column has been added to Data Source Documentation Organization to allow the entire name to be included in all metadata extracts. (DATA-2301)

FDE Refinements

FDE user experience was refined through the following tickets:

  • The list of most visited domains and datasets was updated to be more accurate (DATA-1813)

  • The guided tour was integrated into a user profile in order to automatically launch the tour for first-time users (DATA-1877)

  • Pagination has been added to the dataseries table to improve the loading of results (DATA-2162)

  • Update to the language of the download notification (DATA-2325)

Replace ALL_HFIC.zip shapefile with direct download from FDW (DATA-1457)

As the ALL_HFIC.zip file was last updated in December 2021, the node was replaced with a URL that points directly to FDW.

Automated ingestion of Price Projection spreadsheets from Google Drive (DATA-1879)

A luigi pipeline was developed to ingest price projection spreadsheets from Google Drive.

Upload capital city names and coordinates to the Country table (DATA-2000)

Capital city names and coordinates have been added to the Country table, and are returned by a country serializer.

Automatically publish ComTrade data after 3 years of no updates (DATA-2132)

The data pipeline from Comtrade to the FDW now accommodates possible delays among different countries, as some countries may take several years to submit all trade data due to infrastructure limitations. Data can be fetched more than once and compared to the data in the FDW in order to update it as appropriate. If the data has not been modified for 3 years, it will be published without the need for further checks of the data series. 

Data collection text boxes for metadata (DATA-2198)

The inline tabular display for data collections was improved to allow users to see the full text of important metadata columns.

Bug Fixes

Change country name of the exchange rate of Bolivar Digital per USD from World to Venezuela (DATA-2294)

The secondary exchange rate for VED (Bolivar Digital) per USD listed ‘World’ as the country. This has been corrected to list Venezuela.

Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error (DATA-1656)

The 500 Internal Server Error was caused by data points from the Source Document id: 7127, name: "FAO, Statistics Division" whose values are NaN instead of a numeric or a null value. The error was resolved by running a clean up query in the database.

MarketPriceProjectionvalue period date is not the last day of the month (DATA-2215)

The output of SemiStructuredDataPoint.objects.filter( 2 dataseries=6827441, 3).values( 4 'datacollectionperiod__period_date', 5) gave incorrect period dates that do not correspond to the last day of the month. The monthly data source documents will now be checked and corrected for the period date being the last day of the month where applicable.

Bug Fixes in the FDE

  • An issue with the FDE sidebar not retaining the user’s scroll position was corrected to function correctly within and across pages (DATA-2074)

  • The knowledge base widget article sidebar was fixed so text does not overflow out of the components (DATA-2075)

  • Maps in FDE were not resizing correctly when the main sidebar is collapsed. Maps now fill the interface in response to user interactions (DATA-2122)

  • The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file (DATA-2234)

  • The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)

  • The selected tab underline in FDE data series table did not match the label width. This was corrected so that the selected tab underline matches the length and position of the tab’s text label. (DATA-2282)

  • The height of the API LINK div on the Price Table was reduced to eliminate an overlap with the horizontal scroll bar for Ubuntu OS running Chrome (DATA-2296)

  • An error causing scroll bars to malfunction after closing the FDE guided tour has been fixed to allow users to scroll normally (DATA-2299)

  • The Reset Search button on FDE domain pages has been corrected to clear only the existing search parameters, and not a user’s selected data series. (DATA-2323)

  • The height of the FDE filter header and the placement of the ‘save search’ button after search parameters are entered have been corrected (DATA-2324)

  • No labels