From the Data entry module, users can upload new alphabetic, numeric, or symbolic data using the following options:

• Add a new data collectionData Collection: Used for step 1 of the data ingestion process, allowing users to enter data and ready it for approval and processing.

• Import data pointsData Points: Used for small bulk uploads of historical data or corrections.

• Offline data uploads: Used for large bulk uploads of historical data or corrections.

...

Add a new

...

To add a new data collection from the Data entry module, click Add a new Data collection. A form will appear with the following fields:

• *Source document: Specify the Data Source Document as an Excel worksheet attachment, or manual entry.

• *Publication name: Enter the publication name.

• *Collection date: Specify the collection date of the data series included within the data source document.

• File: Upload an Excel worksheet as an attachment. If no attachment is provided, the user will be redirected to a screen allowing for manual data entry.

(*) represents a required field

Additional fields:

• Status: An indicator for the current status of the Data Source Document. Default status during the Data entry phase is Draft.

• Status changed: A tracking feature that records the date, time, and action taken regarding changes in status of a Data Source Document.

• Import log: For tracking notification warnings or errors, a log file is generated after the creation of every data collection. Warning notifications are sent to the FEWS NET Home Office Markets and Trade team to make the relevant corrections. This action ensures the Alias Market name is specified correctly, and that the appropriate data series are identified.

• Collection periods: Specify the collection periods of the data source document.

• Start date: The start date of a collection period, usually the first day of a month.

• Period date: Refers to the last day of a collection period. If set to monthly, it will be the last day of that same month.

• Notes: A text field for notes and comments to improve context.

When ready, click on either the Save, Save and add another, or Save and continue editing buttons to save the data into the system and prepare it for processing. The system will display a message confirming the success of the saving operation.

• Save: Save and return to the Data entry homepage.

• Save and add another: Implies adding another data collection. Once the current one is saved, the system redirects the user to a similar window to repeat the process as many times as desired.

• Save and continue editing: The system allows a user to save the current work and continue editing which serves to minimize the loss of entered data in case of a poor internet connection.

Manual data entry

In cases where an Excel worksheet is not loaded, a user can enter values and set the status manually.

Note: Previous Price and Percentage Change will only be recognized or appear automatically if values were entered for the previous period (the last day of the previous month). This field is not required.

• Status options

  • Collected: Most common status. It means there is a value for the Data-Point in the Data Series for this Data Collection Period.

  • Not Collected: The Enumerator did not collect the price (a value for the Data Series) this month (for this Data Collection Period), and availability of the product is unknown.

  • Not Available: The Enumerator attempted to collect the data (a value for the Data Series for this Data Collection Period) but the product was not on sale/available in the Market.

  • Missing Historic Data: Should not be used by the Field Office because this status does not involve any new data. Concerns missing prices from historical data uploaded in bulk by Home Office: The data is not present in FEWS NET’s historic data; Unclear whether it was not available or not collected.

Bulk uploads

The Import data points and Offline data uploads screens should be used to bulk upload historical data or corrections. It is best to use Import data points when possible as this allows changes to be reviewed before the import is finalized. However, this option can be time consuming when there is large amounts of data so Offline data uploads should be used for large uploads.

Import data points

Data series can be imported in the following formats ( XLS, CSV, TSV, JSON, and YAML ). To import data series, follow the steps below:

1. Choose an item from the Import data points sub-menu.

2. Click the Choose File button and choose a file to upload.

3. Specify the file format that will be imported using the Format drop-down list.

4. Click Submit to start the import process.

5. Once the file is uploaded, the system will display the summary including:

   1. New: the data in the file that will be imported.

   2. Updated: the data in the file that are updates to existing data in the system.

   3. Delete: the records in the file that will be deleted from the system.

   4. Skip: the records in the file that will be skipped.

   5. Error: the records in the file that have errors in the data and will not be added to the system.

   6. Total: total number of records in the file.

6. To continue with the import, select Confirm import. The data series will be imported and a confirmation message will appear when complete.

...

Data Collection

The Add a new Data Collection option leads directly to the Add Data Collection form, where a user can either upload a file or create a Data Collection manually, allowing them to add Collection Periods and Data Points without a file upload.

Bulk uploads

Import Data Points

The Import Data Points option contains a submenu with import screens by Data Domain.

Offline data uploads

The Offline data uploads screen displays all the data upload records in the system together with their status, data domainData Domain, country information, and the user who initiated the upload process.

From this screen users can perform the following activities:

• Upload data contained in a file into the system by selecting a file, the format of the file containing the data (XLS, CSV, …), the relevant data domain, and the country

• View the data upload process status Add data uploads

• Search and filter using one or more of the following criteria:

  • Status

  • Subtype (Data Domain)

  • User the status was changed by

  • Country

• View record details, including the following information:

  • Name: The name of the data upload file

  • Subtype: The Data Domain for the upload

  • Country: The relevant country for the data upload

  • Status: The status of the data upload process (in progress, succeeded, failed)

  Displays

  • File: Link to download the data upload file

  • Result: Link to review the data upload result

  for

  • of each row of data in the data upload document

  • Log

  records in the system while uploading the data for each record

• Edit data upload record

• Delete one or more data upload records

• Reprocess or restart the data upload works for one or more data upload processes.

• Search data upload records using a free text search criteria

• Filter data upload records using one or more of the following criteria: status, sub type (data domain), user who changed the status, and country

  • : Link to review the log for the data upload process

  • Updates: Link to review updates to the data

  • Created By: The User who created the data upload

  • Created: The date the data upload was created

  • Status changed by: The User who most recently changed the status of the data upload

  • Status changed: The date the status of the data upload was last changed

• Delete, process, or restart data uploads using the Action dropdown.

• Select a Data Series record from the data uploads table view to access the Change data upload screen.