Versions Compared

Old Version 4

changes.mady.by.user Zoe Wingate

Saved on

compared with

New Version Current

changes.mady.by.user Zoe Wingate

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The following list of new features, updates and bug fixes are included in the latest Sprint 22.12 release to the FEWS NET Data Platform.

New Features

Standard Visualizations 

...

  • A Price with Projection standard visualization, most typically used for a staple food price, that shows the price of a product with the projection (DATA-1623)

  • Terms of Trade Standard Visualizations showing livestock-to-product terms of trade comparisons DATA-2018)

  • A Price Bulletin Standard Visualization (DATA-62) which includes narrative metadata for countries and regions as added in the FDW admin screens (DATA-2188)

  • The homepage visualization of Annual Peak Needs (DATA-2298)

  • Display of current prices on the Commodity Price Change Map (DATA-2021)

New FDW Search and Filter Options

...

  • The filter pane in the FDW now includes a search box which can be used to narrow down the available filters (DATA-2336)

  • Dataseries Admin screens have a FEWS NET Country Group filter option to allow the selection of data for a given region (DATA-2160)

...

Updates

Metadata Management Updates

The management of metadata in the FDW has been refined through the inclusion of additional information and new endpoints. Updates include:

...

  • Metadata endpoints for ‘commoditybalancevalue’ and ‘commoditybalancefacts’ have been created for the Balance domain (DATA-1970)A metadata endpoint has been created

  • for Calculated Price Indexes All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-19711972)

  • All existing indicators now include values in the aggregation and description fields (DATA-1973)

  • The data source document field for datausage_notes is included in the metadata API extracts as part of the description column (DATA-2082)

  • Foreign name fields have been added to GeographicUnitSerializer (DATA-2153)

  • Management of narrative metadata type and narrative metadata have been added to the admin screens as part of common metadata (DATA-2188)

  • The availability and availability description columns are included in ‘fields=simple’ (DATA-2300)

  • All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-1972)

Improvements to Extracts and APIs

Data extraction has been made more comprehensive and accurate through the following updates:

  • Users can now define a list of extra fields per Extra attributes are included in extracts by geographic unit type for inclusion in API extracts (DATA-1612)

  • The FNID, a unique code used to identify every Geographic Unit in the system, is now included in all Spatial extracts, simple or otherwise (DATA-2238) 

  • An API has been created for Seasons data (DATA-2253)

  • The ‘geographicrelationship’ API endpoint returns fields for label and category (DATA-2219)

  • A new spreadsheet in EmergencyFoodAssistancePeakNeedsListViewSet is being used for api/efapeakneeds/ due to issues with csv parsing when column headers contain special characters or spaces (DATA-2213)

  • A full name column has been added to Data Source Documentation Organization to allow the entire name to be included in all metadata extracts. (DATA-2301)

...

FDE Refinements

FDE user experience was refined through the following tickets:

  • The list of most visited domains and datasets was updated to be more accurate (DATA-

...

Peak Needs data is loaded into the FIPE domain through a new data source document, and appears as a new indicator for the Import Dependency Dashboard.

...

  • The guided tour was integrated into a user profile in order to automatically launch the tour for first-time users (DATA-1877)

  • Pagination has been added to the

...

  • dataseries table to improve the loading of results

...

Automatically publish ComTrade data after 3 years of no updates (DATA-2132)

...

Automated ingestion of Price Projection spreadsheets from Google Drive (DATA-1879)

A luigi pipeline was developed to ingest price projection spreadsheets from Google Drive.

Data collection text boxes for metadata (DATA-2198)

The inline tabular display for data collections was improved to allow users to see the full text of important metadata columns.

Bug Fixes

Change country name of the exchange rate of Bolivar Digital per USD from World to Venezuela (DATA-2294)

The secondary exchange rate for VED (Bolivar Digital) per USD listed ‘World’ as the country. This has been corrected to list Venezuela.

Fix FDE Trade Filters (DATA-2234)

The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file.

Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error (DATA-1656)

The 500 Internal Server Error was caused by data points from the Source Document id: 7127, name: "FAO, Statistics Division" whose values are NaN instead of a numeric or a null value. The error was resolved by running a clean up query in the database.

MarketPriceProjectionvalue period date is not the last day of the month (DATA-2215)

The output of SemiStructuredDataPoint.objects.filter( 2 dataseries=6827441, 3).values( 4 'datacollectionperiod__period_date', 5) gave incorrect period dates that do not correspond to the last day of the month. The monthly data source documents will now be checked and corrected for the period date being the last day of the month where applicable.

Bug Fixes in the FDE

  • An issue with the FDE

...

  • The FdeProfileViewSet has been updated to operate in the same way as the UserViewSet with the CurrentUserOnly permission class, and allows the API to return a list of profiles to a superuser with permissions (DATA-2305sidebar not retaining the user’s scroll position was corrected to function correctly within and across pages (DATA-2074)

  • Maps in FDE were not resizing correctly when the main sidebar is collapsed. Maps now fill the interface in response to user interactions (DATA-2122)

  • The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file (DATA-2234)

  • The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)

  • The selected tab underline in FDE data series table did not match the label width. This was corrected so that the selected tab underline matches the length and position of the tab’s text label. (DATA-2282)

  • The height of the API LINK div on the Price Table was reduced to eliminate an overlap with the horizontal scroll bar for Ubuntu OS running Chrome (DATA-2296)

  • An error causing scroll bars to malfunction after closing the FDE guided tour has been fixed to allow users to scroll normally (DATA-2299)

  • The Reset Search button on FDE domain pages has been corrected to clear only the existing search parameters, and not a user’s selected data series. (DATA-2323)

  • The height of the FDE filter header and the placement of the ‘save search’ button after search parameters are entered have been corrected (DATA-2324) The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)