The following list of new features, updates and bug fixes are included in the latest Sprint 22.10 release to the FEWS NET Data Platform.
New Features
Introduce IPC HFA data domain (DATA-557)
...
Read more about these features.
Updates
Add filtering by keyword for News Article API (DATA-1651)
The News Article API now accepts keywords as a filter parameter.
Updates to KoBo Toolbox
Several updates were made to the FEWS NET KoBoToolbox dashboard and forms including:
Updates to the pipeline that ingests KoBo cross border trade data into FDW (DATA-1778)
The addition of a spreadsheet to aid in the validation of KoBo data (DATA-1793)
Updates to the East Africa cross border trade form to collect the GPS location of enumerator and pre-fill the country and border point (DATA-1811)
Upgrading to latest version in order to access a new row-based permission feature (DATA-1827)
DATA-1913 Speed up api format renders of endpoints with large drop-downs
Refreshed domain names (DATA-1922, DATA-1939)
...
The FDW user interface has been refreshed to reflect the new FEWS NET brand. Changes include:
Updates to KoBo Toolbox (DATA-1778, DATA-1793, DATA-1811, DATA-1827
Description
Hello Henock and Girum,
Thanks so much for attending the East Africa XBT training and Kobo toolbox rollout. I wanted to recap and list the challenges and the issues we encountered with the backed of kobo toolbox data viewing dashboard. I would like to address those as much as possible as it impacts our users' LOE when they review and download data and how we want to move forward with similar activities if we want to use Kobo.
Filter records for a specific period of time. In our case, weekly data. The start and end date in the dashboard is an indicator of time spent by the enumerator to complete a record from start to submission. Is there a way to filter data for a range of days? we can only filter by one day now using the "reporting date" column. This is an important feature to have and be able to filter data based on a range of days.
Validation status: is it possible to change the options to draft, submitted, not approved, and approved? we are trying to set a process where we will use this column for the country offices and regional data assistant to communicate the status of records and their readiness to be submitted to the FDW.
Filtering products with () in the name such as Rice (Paddy). When we filter to see data for any product that contains () in the names, we don't get any results.
Instead of submitting by and adding the "username" having the enumerator's name would make it easier to filter by.
downloading data for a range of days. When we filter data based on some parameters, we weren't able to download the results. Instead, we get an extract of all data collected. this is a huge limitation for our country office who'd want to review weekly data in Excel or other formats on the side or just want a quick extract.
View submissions from specific users: this was a limitation for country offices who needs to see records for only specific users (their country enumerators only) and be able to edit records if needed. At the moment, if we give "view submissions only from specific users" permission to a user, he won't be able to edit records from those users. This is a big limitation. As of now, when Sudan's country rep logs in to Kobo he will see records for all countries while he only needs to see records for Sundan's enumerators only and edit them if needed.
Another limitation is contact management. It's hard to manage the enumerators' profiles and contacts list from the backend and see who has access to which form and also see the enumerator profile (name, location, etc). I am also speaking from the point of someone who's managing more than one form.
When filtering by "group border point/reporting country" and selecting a country, the "group board point/border point" drop-down menu should display border points for the country selected and not all border points.
Additional items we needed to adjust in the form itself (Moved to DATA-1811):
Add GPS location of the enumerator.
Adding form submission radius not more than 10km
When an enumerator logs in, the country and border point will be prefilled to avoid data entry errors.
Upgrade FEWS KoBo to latest version
Description
To be able to use the newer row-based permission feature in KoBo, we need to upgrade the KoBo version currently installed for FEWS to the latest available version.DATA-1913 Speed up api format renders of endpoints with large drop-downs
Bug Fixes
DATA-1656 Trying to open https://fdw.fews.net/en/admin/semistructured/semistructureddatapoint/ results in 500 Internal Server Error
DATA-1929 Unable to update datasourcedocument name
Description
As reported
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
DATA-1935 Investigate issues with refresh materialized views debouncing incorrectly.
Description
The EWT have been having issues with uploaded data collections taking a long time to reflect the updates in FDW. The is because the refresh materialized views have not been running correctly. These can be run manually by ssh-ing into the server and running the commands from psql, like the below;
...
Update FAO pipeline based on changes in remote API (DATA-1943)
Description
The help ticket reported
| Jira Legacy | ||||||
|---|---|---|---|---|---|---|
|
...
DATA-1954 Fix safety warning for protobuf
Description
The below safety error is causing issues in the CI pipelines.
...
DATA-2083 SaveNewArticles fails for articles from multiple sources
Description
SaveNewArticle relies on ReadExistingArticles to avoid inserting duplicates.
...