File upload guide

This guide walks you through the process of uploading data to WeSIS.

Before you start

When you’ve decided that your data is finally ready to be uploaded to WeSIS please make sure that you have:

1. Created an indicator page on WeSISPedia. You should use the following template. Here is an example indicator page to give you an idea of what the page structure should look like. Please make sure that ALL relevant fields in the info box are filled out, since this is important for data validation.
2. Added all new indicators to the Index of all indicators page on WeSISPedia.
3. Formatted your files according to the provided templates as described in File formats. Please note that the system accepts .csv,.xls and .xlsx. Though uploading .xls files in not recommended.

Steps Outine

In this introduction you'll see a quick demonstration of the upload process. (gif or video to be added). Or you can read the text below.

The upload process consists of two main steps.

Step 1 Upload dataset files

At this step you can select or simply drap-n-drop your file in to the upload area and press "SAVE".

Note. Big files may a while to be uploaded (~2-5 minutes).

Step 2 Preview and Data Validation

At this step you are presented with a file overview, where can:

1. Rename your uploaded file before it is saved in the database.
2. See all recognized mandatory columns, countries, technical indicators and year values fetched from the file by hovering over the appropriate "See more" buttons.
3. Navigate back to WeSISPedia using the "More Info" button on the bottom left.
4. Open the data preview page, which shows the uploaded data with color coded cells for different types of validation errors if present.
5. Upload a new updated file to the system by clicking the "Reupload File" button, which brings the user back to step 1.

On the right you can see the validation logs output and have the option to download either the logs themselves as a .txt file or download an updated .csv file with a special column indicating rows with errors.

If the file passed all validation checks the "Submit" button will be active, pressing on which completes the upload process.

Error logs

At the moment the system performs four types of error checks:

1. Missing_columns - checks for mandatory columns missing in the uploaded file.
2. Invalid_datatype - checks whether cells are of type desribed in File formats section, i.e. Numeric, String, Binary, Datetime or other.
3. Unrecognized_values - checks whether the following column values: country, cow_code, technical_indicator_name, scale exist in database. If not the user should update the appropriate WesSISPedia page.
4. Scale/Value_mismatch - checks whether the scale documented in WeSISPedia for each technical indicator agrees with the scale of the actual value