Data processing is the second step in the data ingestion process. The Data processing module allows users to review and approve submitted data and source documents Source Documents in preparation for publishing to the FEWS NET Data Warehouse.
Submitted data can be used to build visualizations in the FEWS NET website Website CMS. Once published, data becomes available for users with the appropriate permissions to view and export in the FEWS NET Data Explorer system.
From the Data processing module, the following actions can be performed:
Display or edit an existing data collectionData Collection.
Display or edit the data for an existing collection periodCollection Period.
Display or edit an existing
...
Data Collection
The data collections Data Collections screen allows you to submit, review, publish, and view an entire data collectionData Collection. A data collection Data Collection is a set of data points Data Points added in a single import. It may contain multiple data series or data collection periodsData Series or Collection Periods.
The data collections page Data Collections screen lists the currently available collections in a grid format with the following columns:
Source documentDocument: The name of the source document Source Document as defined in the Data entry process.
Document typeType: The domain Domain or data type qualification that the data is being submitted under.
Collection dateDate: The collection date Collection Date of the submitted data collectionData Collection.
File: Link Includes a link to the submitted file. Because data can be entered manually, not all collections have a file available.
Status: Status Data collection status types include Draft, Submitted, Under review, and Published.
Publication name: The name of the publication that the data source document Data Source Document came from.
Status changed: Indicator of when the status was last updated.
Data point Point count: Indicator of file size as represented by the number of data points Data Points submitted in the data collection.
...
Navigating the data collections table
...
Data Collection.
Navigating the Data Collections table
...
Search, sort, and filter the Data Collections table using the following options:
Free text criteria search bar: Enter one or more search terms related to the Source Document name, such as the Source Organization or Country.
Collection Date year: Select a year to filter Data Collections by a Collection Date year.
Sortable columns: Click the column name to sort by it. Multiple columns may be selected. Click the carat to change the sort order. Hover over and click the X next to the column name to remove the column from sorting.
Filters: Use the search bar and collapse/expand the filter categories to quickly apply the filters you need. Once a filter is selected from the list, the system will automatically apply the filter and display the results. To remove a selected filter within a filter category, select the All option from the list. Click the CLEAR ALL FILTERS option under the search bar to remove all selected filters.
...
| Info |
|---|
These options can be used in combination, as demonstrated in the video below. |
...
Editing the status information of a
...
Data Collection
The data collection Data Collection status can be changed in two ways:
From the table view, use the checkboxes to select one or more data collections and select a status from the Action dropdown:
Delete will delete the data collectionData Collection. If deleted, it cannot be recovered.
Submit will update the status to Submitted.
Publish will update the status to Published.
Review will update the status to Under review.
Select the data collection Data Collection from the table to navigate to the Change data collectionData Collection screen.
Modify the data in the Change data collectionData Collection page as needed and select a Save option.
Select Submit (for data collections Data Collections in Draft or Under review status) or Review (for data collections Data Collections that are Published).
...
Viewing the change history of a Data Collection
...
Display or edit the data for an existing Collection Period
The Data Collection Periods screen allows you to view and edit a single Collection Period.
The Data Collection Periods page screen lists the currently available collections in a grid format with the following columns:
Collection: The name of the data collection Data Collection as defined in the Data entry process.
Start date: The start date of the data collection periodthe Collection Period begins.
Period date: The last day of the data collection perioddate the Collection Period ends.
Schedule: The schedule on which the data is collected.
Collection Statusstatus: Status types include Draft, Submitted, Under Review, and Published.
Status changed: Indicator of when the status was last updated.
Data point Point count: The number of data Data points included in the data collection periodCollection Period.
View and edit a
...
Collection Period
To view and edit a data collection periodCollection Period:
Select the data collection period Collection Period to be updated.
On the Change collection periodCollection Period page, you can:
Add notes to a data collection periodCollection Period.
View the history of the data collection periodCollection Period.
Edit the status and values of specific data points Data Points within the data collection periodCollection Period.
Select one of the Save options.