Introduction
The following list of new features, tasks, and resolved bugs are in the latest Sprint 21.01.xx release:
Features
Enhanced access control based on Data Usage Policy https://fewsnet.atlassian.net/browse/DATA-202
Develop a prototype of vector tiles serving using ST_AsMVT https://fewsnet.atlassian.net/browse/DATA-561
Move Indicator and Geographic Unit filters to Data Series and Data Point https://fewsnet.atlassian.net/browse/DATA-579
Make Geographic Unit Mandatory https://fewsnet.atlassian.net/browse/DATA-580
Enable production of Regional IPC pngs and shapefiles https://fewsnet.atlassian.net/browse/DATA-639
Import IPC Dataseries when importing Datapoints https://fewsnet.atlassian.net/browse/DATA-699
WorldPop Demography Cache Expiry and Repopulation https://fewsnet.atlassian.net/browse/DATA-714
Add 'pcgn_proper' and `pcgn_name` to Country Search https://fewsnet.atlassian.net/browse/DATA-720
Develop Prototype for Commodity Balance Sheet Domain https://fewsnet.atlassian.net/browse/DATA-722
Make Data Series lists in Admin screens into clickable links https://fewsnet.atlassian.net/browse/DATA-733
Consistent Labeling for Price Indexes https://fewsnet.atlassian.net/browse/DATA-746
Sub National Price Indexes https://fewsnet.atlassian.net/browse/DATA-747
Tasks
Investigate performance issues on export of TradeFlowQuanity and fix https://fewsnet.atlassian.net/browse/DATA-710
Investigate performance issues on export of IPCClassificationResource and fix https://fewsnet.atlassian.net/browse/DATA-711
Add totals to Crop Production and Inventory dashboards https://fewsnet.atlassian.net/browse/DATA-585
Move LandScan rasters to S3 https://fewsnet.atlassian.net/browse/DATA-719
Bugs
Problem with scrolling in FDE Other domain https://fewsnet.atlassian.net/browse/DATA-572
/en/schema-ui doesn't populate Country Code lists https://fewsnet.atlassian.net/browse/DATA-581
Country names not appearing in FDE when filtering exchange rate data https://fewsnet.atlassian.net/browse/DATA-584
Some of the top menus of the Home page i.e (Change password , Recent Actions i.e (list) , Help with the current page) are not shown https://fewsnet.atlassian.net/browse/DATA-647
Production Time Series for Senegal appears incomplete https://fewsnet.atlassian.net/browse/DATA-697
The data extract buttons i.e ( Download & Browse) of the calculated data series page are not working https://fewsnet.atlassian.net/browse/DATA-702
PandasShapefileRenderer doesn't support multiple Geographic Unit Types https://fewsnet.atlassian.net/browse/DATA-704
MultipleObjectsReturned('get() returned more than one UnitOfMeasureConversion -- it returned 2 https://fewsnet.atlassian.net/browse/DATA-708
country_code missing from DataCollectionSerializer and DataCollectionPeriodSerializer https://fewsnet.atlassian.net/browse/DATA-718
Filtering by border point field of the trade data domain results in Impossible to fetch error message https://fewsnet.atlassian.net/browse/DATA-729
Metadata errors uploading FEWS NET/WFP/IAPRI Southern Africa, trade https://fewsnet.atlassian.net/browse/DATA-735
Division by Zero error when refreshing materialized views https://fewsnet.atlassian.net/browse/DATA-751
Features
Enhanced access control based on Data Usage Policy https://fewsnet.atlassian.net/browse/DATA-202
This feature is about enhancing access control by defining new data usage policies and restricting the data access by allocating to Users or Groups.
Develop a prototype of vector tiles serving using ST_AsMVT https://fewsnet.atlassian.net/browse/DATA-561
This feature is about developing prototype of vector tiles using
ST_AsMVT
with anMVTTileRenderer
which can be added to spatial viewsets.
Move Indicator and Geographic Unit filters to Data Series and Data Point https://fewsnet.atlassian.net/browse/DATA-579
This enhancing is about moving Indicator and Geographic unit filters to
DataSeries
andDataPoint
filters.
Make Geographic Unit Mandatory https://fewsnet.atlassian.net/browse/DATA-580
This feature is about making
Geographic Unit
a mandatory field for the data series of all the data domains.
Enable production of Regional IPC pngs and shapefiles https://fewsnet.atlassian.net/browse/DATA-639
This feature is about enhancing the production of Regional IPC
pngs
and shapefiles package.
Import IPC Dataseries when importing Datapoints https://fewsnet.atlassian.net/browse/DATA-699
This enhancement is about making the IPC Uploads a one step process , i.e importing the data points will create the data series which saves time and prevent error which were caused due to missing dataseries.
WorldPop Demography Cache Expiry and Repopulation https://fewsnet.atlassian.net/browse/DATA-714
This feature is about prepopulate the WorldPop cache for all shapes and reprocessing individually when a given shape is added or changed.
Add 'pcgn_proper' and `pcgn_name` to Country Search https://fewsnet.atlassian.net/browse/DATA-720
This feature is about enhancing the country search by adding the parameters 'pcgn_proper' and `pcgn_name` to (https://fdw.fews.net/api/country/) which allows to search , for instance, either by
"pcgn_name": "Congo, Democratic Republic",
or"pcgn_proper": "Democratic Republic Congo
.
Develop Prototype for Commodity Balance Sheet Domain https://fewsnet.atlassian.net/browse/DATA-722
This feature is about developing prototype for Commodity Balance Sheet data Domain (https://fdw.fews.net/en/admin/balance/commoditybalance/).
Make Data Series lists in Admin screens into clickable links https://fewsnet.atlassian.net/browse/DATA-733
This feature is about making the dataseries links clickable in all of all the admin pages (https://fdw.fews.net/en/admin/).
Consistent Labeling for Price Indexes https://fewsnet.atlassian.net/browse/DATA-746
This feature is about making consistent labeling for the Price Index both in FDW and FDE i.e
FDE
- External Price Index
is renamed to Secondary Price Index
(https://fdw.fews.net/data-explorer/#/other)
FDW
- PriceIndex
is renamed to Secondary Price Index
and Secondary Price Indices
(https://fdw.fews.net/en/admin/price/priceindex/)
- CalculatedIndex
is renamed to Calculated Price Index
and Calculated Price Indices
(https://fdw.fews.net/en/admin/price/calculatedindex/)
Sub National Price Indexes https://fewsnet.atlassian.net/browse/DATA-747
This feature is about enabling to create a sub-national Secondary Price Index (https://fdw.fews.net/en/admin/price/priceindex/) and Calculated Price Index (https://fdw.fews.net/en/admin/price/calculatedindex/) data series.
Tasks
Investigate performance issues on export of TradeFlowQuanity and fix https://fewsnet.atlassian.net/browse/DATA-710
This task was about improving the performance issue of the export functionality of the
TradeFlowQuanity
(https://fdw.fews.net/en/admin/trade/tradeflowquantity/export/?).
Investigate performance issues on export of IPCClassificationResource and fix https://fewsnet.atlassian.net/browse/DATA-711
This task was about improving the performance issue of the export functionality of the
ipcclassification
(https://fdw.fews.net/en/admin/ipc/ipcclassification/export/?).
Add totals to Crop Production and Inventory dashboards https://fewsnet.atlassian.net/browse/DATA-585
This task was about adding totals to
Crop Production dashboard
(https://fdw.fews.net/dashboard/crop-production/) andInventory dashboard
(https://fdw.fews.net/dashboard/inventory/).
For crop dashboard
,when no country is selected , the parameters below are displayed :
-A total number of countries, with crop data is in FDW
-A total number of commodities
-First and last dates
When a country is selected:
- A total number of commodities in selected country &
- First and last dates for selected country are shown .
For the data inventory dashboard
, the "Number of data points by data domain" table are summarized as shown below:
Move LandScan rasters to S3 https://fewsnet.atlassian.net/browse/DATA-719
This task was about moving the LandScan data to S3 which is helpful in reducing storage costs and supporting alternate sources of population & other raster data.
Bugs
Problem with scrolling in FDE Other domain https://fewsnet.atlassian.net/browse/DATA-572
The
select all button
of thedemographic
data of the other data domain was not showing the correct selected dataseries count and this was resolved and the functionality is working as expected.
/en/schema-ui doesn't populate Country Code lists https://fewsnet.atlassian.net/browse/DATA-581
The (http://fdw.fews.net/en/schema-ui/) didn't populate country code list and this was resolved.
Country names not appearing in FDE when filtering exchange rate data https://fewsnet.atlassian.net/browse/DATA-584
The country names were not shown when filtering by the
Exchange rate subtype
of the Other data domain and this was resolved.
Some of the top menus of the Home page i.e (Change password , Recent Actions i.e (list) , Help with the current page) are not shown https://fewsnet.atlassian.net/browse/DATA-647
Some of the top menus information (https://fdw.fews.net/en/admin/) under the Welcome ( i.e
Change password
) ,Recent Actions
, Help i.e (Help with the current page
) were hidden and this was resolved.
Production Time Series for Senegal appears incomplete https://fewsnet.atlassian.net/browse/DATA-697
There was an issue in accessing the crop data for the country Senegal and this was resolved.
The data extract buttons i.e ( Download & Browse) of the calculated data series page are not working https://fewsnet.atlassian.net/browse/DATA-702
The data extract buttons ( Download & Browse ) of the calculated data series page (https://fdw.fews.net/en/admin/price/priceratio/) & (https://fdw.fews.net/en/admin/price/calculatedindex/) were not working and this was resolved.
PandasShapefileRenderer doesn't support multiple Geographic Unit Types https://fewsnet.atlassian.net/browse/DATA-704
There was an error in using more than one
Geographic Unit Type
parameters and this was resolved.
MultipleObjectsReturned('get() returned more than one UnitOfMeasureConversion -- it returned 2 https://fewsnet.atlassian.net/browse/DATA-708
It was the error message i.e (
MultipleObjectsReturned('get() returned more than one UnitOfMeasureConversion -- it returned 2
), which was returned for having two unit of measure conversion for the same unit and this was resolved & validation has been added onUnitOfMeasureConversion
which prevents duplicate entries in addition to this,the duplicates which were available in PROD are now cleared.
country_code missing from DataCollectionSerializer and DataCollectionPeriodSerializer https://fewsnet.atlassian.net/browse/DATA-718
The parameter
country_code
was missing from the (https://fdw.fews.net/api/datacollection/) & (https://fdw.fews.net/api/datacollectionperiod) and this was resolved.
Filtering by border point field of the trade data domain results in Impossible to fetch error message https://fewsnet.atlassian.net/browse/DATA-729
Trying to filter trade data by
border point
field results inImpossible to fetch error
and this was resolved and the functionality is working as expected.
Metadata errors uploading FEWS NET/WFP/IAPRI Southern Africa, trade https://fewsnet.atlassian.net/browse/DATA-735
There was an issue in uploading the metadata of
FEWS NET/WFP/IAPRI Southern Africa, trade
and this was resolved.
Division by Zero error when refreshing materialized views https://fewsnet.atlassian.net/browse/DATA-751
There was a division by zero error both in refreshing materialized views of
MarketPriceFacts
andDataPointFacts
& this was resolved.