b-import-data.md

+:arrow\_backward: [Home](home)
+
+[[_TOC_]]
+
+---
+
+# Part B - Importing Data into Your Node
+
+Before importing data into your node, you will need to have the data dictionary(ies) of your cohort. The most recent version of your dictionary(ies) is available in the `Data Repository` (Opal) of the central RECAP node.
+
+> **NOTE**  
+You should repeat this part of the tutorial for each cohort whose data you will be hosting on your node.
+
+## 1. Download your cohort's dictionary(ies) from the Central Node
+**1.1.** Navigate to the [central node's home page](https://recap-preterm.inesctec.pt/).  
+**1.2.** Click on the `Data Repository` (Opal) icon, as shown below.  
+  ![opal](uploads/opal.png)
+**1.3.** Log into the central node's Data Repository. (Note: if you do not yet have an account at the central node, please contact WP4 at [recap-dev@inesctec.pt](mailto:recap-dev@inesctec.pt)).  
+**1.4.** On the top bar, click on `Projects`.  
+**1.5.** Select your institution from the list.  
+  ![cohort](uploads/cohort.png)
+**1.6.** You will see a list of tables. Each table represents a data collection event of your cohort. Click on a table name and then click on `Download` > `Download dictionary`.  
+  ![download_dictionary](uploads/download_dictionary.png)  
+Once you have downloaded all the dictionaries from your cohort, please proceed to the next section.
+
+## 2. Import Data into Your Node
+For this step, you will have to access the `Data Repository` (Opal) in your own node. Start by accessing your node's main page and clicking on the `Data Repository` (Opal) icon.
+
+The Data Repository (Opal) organises data by using projects and tables. A project is a collection of tables. So, for instance, a cohort could be a project that has several tables (one for each data collection event of that cohort).  
+So before you can import your data into a table, you will need to create a project.
+
+**2.1. Create a project**  
+- **2.1.1.** Log into the Data Repository on your node.  
+- **2.1.2.** On the top bar, click on `Projects` > `Add Project`.  
+- **2.1.3.** Use the name of your cohort for the name of the project (e.g. EPICE-PT).  
+    ![create_project](uploads/create_project.png)  
+- **2.1.4.** Fill in the rest of the form (optional).  
+- **2.1.5.** Click `Save`.  
+
+Having created a project, you are now able to add tables where you will store your data.
+
+**2.2. Create a Table and Import Data**  
+> **NOTE**  
+You should repeat this step for each dictionary you downloaded in the [1st section](#1-download-your-cohorts-dictionaryies-from-the-central-node) of this part of the tutorial.
+
+To create a table, you will need a **dictionary file** and a **data file**:
+* `.xlsx` data dictionary file: the dictionary file you downloaded from the central node
+* `.CSV` data file: this is a file you must produce yourself. **It must have one column for IDs (which must be the first column), plus one column for each of the variables in the dictionary file (the names of the columns in the CSV must exactly match the names of the variables in the dictionary).**
+
+To be able to use your files to create a new table, they need to be uploaded to the Data Repository first.
+
+- **2.2.1. Upload the dictionary and data files**  
+  - Inside your project, click on the `Files` tab on the left panel and then click on `Upload`.  
+    ![upload_file_1](uploads/upload_file_1.png)  
+    ![upload_file_2](uploads/upload_file_2.png)  
+  - Browse to the location of your dictionary and data files, select them and click `Upload`.  
+
+  You can now proceed to create a new table using the uploaded dictionary and data files.
+
+- **2.2.2. Create a new table using the dictionary**  
+    - Go back to the home page of your project by clicking on the `Tables` tab on the left panel.  
+      ![create_table_with_dict_0](uploads/create_table_with_dict_0.png)  
+    - Click on `Add Table` > `Add/update tables from dictionary`.  
+      ![create_table_with_dict_1](uploads/create_table_with_dict_1.png)  
+    - Click `Browse` and select the dictionary file.  
+    - Click `Next` and then `Finish`.  
+    - The result is an empty table where the variables are described but without any actual data yet.  
+      ![create_table_with_dict_2](uploads/create_table_with_dict_2.png)  
+
+    The next step is to import your data into the table you have just created.
+
+- **2.2.3. Import the data into the new table**  
+    - Go to the home page of your project by clicking on the `Tables` tab on the left panel.
+    - Click on `Import`.  
+      ![import_csv_1](uploads/import_csv_1.png)  
+    - Select `CSV` as the data format and click `Next`.  
+    - Click `Browse` and select the data file.  
+    - Make sure the destination table is the one previously created with the dictionary and click `Next`.      
+      ![import_csv_2](uploads/import_csv_2.png)  
+    - Click `Next` again to see a comparison between the variables in the data file and the ones in the table into which you are trying to import. If there are no conflicts and no new or modified variables, it means that the data file completely matches the dictionary of the table and so you can proceed by clicking `Next`.  
+      ![import_csv_3](uploads/import_csv_3.png)  
+      > **NOTE**  
+      If you see any conflicts or new/modified variables, it means that your `CSV` data file does not exactly match the variables in your `.xlsx` dictionary file. Please make sure your CSV respects the rules mentioned in 2.2.
+    - The next window displays a fragment of what the data will look like once it is imported into the table. This is an opportunity to check if the data is being correctly interpreted.  
+    - Click `Finish`.  
+
+    The data is now being imported into the table. You can check the progress by clicking on the `Tasks` tab on the left panel.  
+    ![import_status_1](uploads/import_status_1.png)  
+    If the import is unsuccessful, please extract the log by clicking on `Log` and send it to [recap-dev@inesctec.pt](mailto:recap-dev@inesctec.pt).  
+  
+    If the import is successful, to see what the table looks like now that it contains data, you can go to the home page of the project, click on the table and then select the `Values` tab. It should look something like the image below.  
+    ![import_status_2](uploads/import_status_2.png)  
+
+## 3. Grant Access to the Central Node's Account
+> **NOTE**  
+You should repeat this step for each table you created in the previous section.
+
+In this section, you will allow the central node to retrieve the data dictionary and summary statistics from the table(s) you created. This is done by granting the `central_node` account (created in [Part A](a-create-accounts) of this tutorial) a specific level of access to your table.
+
+**3.1.** Inside your project, click on the table you created in the previous section.  
+**3.2.** In the `Permissions` tab, click on `Add Permission` > `Add user permission`  
+    ![add_user_perm_1](uploads/add_user_perm_1.png)  
+
+**3.3.** Type in `central_node` for the name and select `View dictionary and summaries` for the level of access the central node will have to the table.  
+    ![add_user_perm_2](uploads/add_user_perm_2.png)  
+**3.4.** Click `Save`.  
+
+The central node will now be able to retrieve the data dictionary and summary statistics from your table. This information will help build the central RECAP catalogue.  
+
+---
+Proceed to [Part C](c-harmonise-data)