The following list of new features, updates and bug fixes are included in the latest Sprint 24.04 release to the FEWS NET Data Platform.
New Features
Create alerting system for failing Luigi tasks (DATA-3577)
Email alerts that report on failing tasks can now be added to FDW pipelines on an ad hoc basis.
Updates
Cached Response Updates
Work to detect and improve cached responses was completed through the following tickets:
A new task calculates a list of responses that we expect to be cached (staple foods market prices, various IPC extracts, etc.) and then attempts to download them in order to report on the cache hit, confirming whether the correct data is being returned (DATA-3152).
Failing caches can be detected and removed to prevent the extra load being applied to celery medium (DATA-3166).
The content size of the cached responses stored in FDW are now included in the cached response model (DATA-3529). The production database instance size was upgraded in order to increase the number of cache responses that can be processed in a given time frame (DATA-3692).
The cache request for an FIC map data visualization will expire when changes are made to the corresponding FIC data in FDW, preventing outdated data from appearing when the map is accessed (DATA-3699).
...