Document toolboxDocument toolbox

Preparing Data for Upload

Owned by Zoe Wingate
Last updated: Jun 28, 2024 by Allison Nederveld
5 min read

There are three categories of information that need to be checked when preparing data for upload.

Spreadsheets for most domains require a straight table with one data point per row. Certain domains, such as Prices, will load cross-tabs (i.e., with markets down the side and products across the top).

Column headings

Column headings must be recognized by FDW. When uploading ad hoc data, column names may need to be adjusted.

Important: If you regularly receive a document from a non-FEWS NET source that contains alternate column headings, do not edit the column headings every time. Instead, submit a help desk ticket so the Hub can add the headings as aliases to the system.

Source files uploaded to FDW must include properly defined column headings, including:

  • Column headings with correctly spelled metadata fields.

  • Column headings that contain metadata fields recognized by FDW.

  • A column heading for each column that contains data.

The examples below describe common errors related to column headings:

Scenario: Uploading price data using the import screen (https://fdw.fews.net/en/admin/price/marketprice/import/) results in the following error message:

‘country’ is not in list

Explanation: The country column heading is missing or spelled incorrectly in the source file.

Solution: Ensure the source file contains the corrected column heading.

Scenario: Uploading price data from the import screen (https://fdw.fews.net/en/admin/price/marketprice/import/) results in the following error message:

Explanation: The error indicates a mismatch in the column headings contained in the file and those recognized by FDW. For example, the data_source_document name or data_source_organization name in the file do not align with those in FDW. This error may also indicate that the file contains a blank column heading.

Solution: Ensure all column headings are titled correctly and there are no blank headings.

Metadata

Metadata values must be recognized by FDW. New metadata must be added through the data series or metadata importing screen.

Source files uploaded to FDW must include appropriate metadata information, including:

  • Metadata values that match those available in FDW.

  • Compatible metadata values for each record.

  • Metadata values free of extra characters or values that cannot be recognized.

The examples below describe common errors related to metadata:

Scenario: Uploading CPI data (https://fdw.fews.net/en/admin/price/priceindexvalue/import/) results in 1 skipped result.

Explanation: The metadata values for the columns (such as the index_name or geographic_unit) do not match those in FDW.

Solution: Correct the metadata values to match those in FDW.

Scenario: Uploading exchange rate data from the import screen (https://fdw.fews.net/en/admin/price/exchangeratevalue/import/) results in the following error message:

Explanation: The market name in FDW and the file do not match.

Solution: Correct the market name in the file.

Scenario: Uploading cross border trade metadata (https://fdw.fews.net/en/admin/trade/tradeflowquantity/import/) results in 3 invalid results:

Explanation: The invalid results are caused by incompatible values across the flow_type, source_country, and destination_country fields. E.g., a flow_type value of export cannot be valid if the source_country and destination_country values are the same.

Solution: The values must be corrected to upload the data successfully.

Data values

Data values must be accurately matched to their column headings.

Source files uploaded to FDW must include appropriate data values, including:

  • Data values that align with the correct metadata field in the column headings.

  • Data values that are within an expected range.

The examples below describe common errors related to data values: