Document toolboxDocument toolbox

February 2024 Release Notes

Owned by Zoe Wingate
Last updated: Mar 04, 2024
2 min read

The following list of updates and bug fixes are included in the latest Sprint 24.02 release to the FEWS NET Data Platform.

Updates

Method for monitoring Kobo data ingestion pipelines

The following updates were made to monitoring Kobo data ingestion pipelines:

  • Created a special Luigi CheckTask type for monitoring pipelines and implemented a check for the Nigeria Market Prices Kobo form to determine if the pipeline to FDW is running successfully (DATA-2993)

  • Implemented the CheckTask for other existing Kobo price pipelines (DATA-3558)

Fix crop time series adding separate row for each different data point status (DATA-3304)

Addressed duplicate rows of data appearing in time series Crop Production extracts from the Data Platform by excluding the status column and replacing values tied to a “Not Collected” status with “NC” when using time series.

Updates to FDE Trade domain filters (DATA-2947)

The following improvements were made to the filter options in the FDE Trade domain:

  • Moved the Border Point filter after the Reporting Country and Trade Source filters

  • Modified the source and destination filters to read “Trade Source” and “Trade Destination”

  • Moved the Data Source Document filter to be the last filter option

Add JSON field to FdeUserProfile model (DATA-3236)

Improved the storage of FDE user profile data through a new JSON field in FDW.

Add link-out to climate data portals to FDE (DATA-3420)

The left-hand FDE sidebar now includes a link to the Agroclimatology Data Portals on fews.net.

Add has_geography filter to BasicGeographicUnitFilterSet (DATA-3453)

Updated the FDW API with a has_geography filter in BasicGeographicUnitFilterSet as part of enabling the FDE Spatial domain to only return features with geography.

Bug Fixes

Fix LinearRing error affecting the Crop Assessment Dashboard from loading (DATA-3511)

Resolved an issue preventing the Crop Assessment Dashboard from loading by updating a name change to a Kobo form in the code and correcting permissions required to fetch data.

FDE Bugs

Bug fixes for the FEWS NET Data Explorer were completed through the following tickets:

  • Corrected the functionality of the Include data series with zero data points checkbox to reflect accurately in the selected data series count (DATA-3430)

  • Updated the metadata returned by the API call for the Spatial domain to include the selected params instead of generic metadata (DATA-3458)

  • Fixed an issue where clicking the Reset Search button in the Population, Nutrition, or Responses domain caused the Clear Selection button and Select All checkbox to be hidden (DATA-3551)