The Who, What, and How of Data Submission |
Data Submission Agreement |
Data Expected List |
Validation and Upload Tool |
Submission Exemptions
Last Updated: 12/07/2022
The Who, What, and How of Data Submission
|
Who should be submitting data and when?
What do I need to have completed to start submitting data?
-
A signed and completed
Data Submission Agreement (DSA)
-
Data Expected List
-
Permission to submit to your NDA Collection
-
Global Unique Identifiers (GUIDs)
What data should be submitted?
How do I submit data?
-
Download the corresponding Data Structure submission template from the NDA Data Dictionary
-
NOTE: This is an important step, if you do not use the template provided by NDA your data will not pass Validation.
- For those that have aliases within their Data Structure, please use the custom scope in the Validation Tool in order to submit with aliases.
- Data Structures can also be downloaded via your Data Expected list.
- To view your data structure templates, click the information ("i") icon next to the data structure names in your Data Expected list.
- Populate the submission templates with your collected data.
- Submit your data via the
Validation and Upload Tool
either using:
- HTML web version is best used for cumulative data submissions
- Python command-line version is best used for large files (e.g. non-cumulative imaging files)
- More information can be found in the HTML Validation and Upload Tool tutorial
|
Back to top of page
Data Submission Agreement
|
The Data Submission Agreement (DSA) is used to request permission to submit data to NDA and outlines the terms and conditions associated with data submission.
- The DSA must be completed by the PI.
- The PI cannot delegate completing the DSA through the eDSA Tool to any other researcher.
Access to your NDA Collection and the Data Expected list is contingent
on completing the Data Submission Agreement (DSA).
How do I complete the DSA?
The Principal Investigator (PI) should submit their DSA through the
eDSA Tool.
Visit the
First Steps of Data Submission tutorial for instructions on
completing the eDSA Tool.
I received an HTTP 403 error when trying to access the eDSA Tool. What do I do?
- Clear your browser's cache
- Use an incognito/private window to access to the eDSA Tool.
If the issue persists, please contact the NDA Help Desk at
NDAHelp@mail.nih.gov for
further assistance.
|
Back to top of page
Data Expected List
|
Data Expected is a list of Data Structures, which have submission
templates used to collect data, the accompanying targeted enrollment of
human participants from which data will be collected, and the initial
dates for data submission and data sharing for that collected data.
How do I know if my Data Structure is ready for submission?
-
Check our
Preparing and Submitting Data tutorial for instructions on
checking your Data Structure's approval.
-
If you requested changes to your Data Structures and have not yet
received a submission template: Please email
NDAHelp@mail.nih.gov with your NDA
Collection ID and the structure name for an update.
-
If you are not requesting any changes to your Data Structures:
you can submit data now!
-
The Status column in your Data Expected list does not hinder you from submitting data.
Should I submit any data if NDA is still working on data mapping/curation?
- Yes! You should submit data for the Data Structures that are approved on your NDA Collection!
- Your NDA Collection has a "Research Subject and Pedigree" Data Structure that is required for each researcher to submit data.
- Your NDA Collection could also have some
Common Data Elements (CDE)
that will require data submission by the end of your grant.
- When your NDA Collection is created, NDA will populate your Data Expected list with the CDE structures that are correct for your NDA Collection.
When will my data structures be ready for submission?
- We advise you to complete your Data Expected list one month before the submission cycle begins.
- For NIMH Data Archive NDA Collections
- November 1st for the January 15th submission deadline
- May 1st for the July 15th submission deadline
- For NIAAA Data Archive NDA Collections
- February 1st for the April 1st submission deadline
- August 1st for the October 1st submission deadline
- Submitting your requests at this time ensures your data structures will be approved in time for the submission deadline.
- If requests for new structures or structural changes are made after the above dates, your Data Structure(s) will likely be ready for the next submission deadline.
- Data curators will do their best to get your Data Structures ready for submission.
- Be on the lookout for any emails from our data curation team updating you on the status of your Data Structures!
How do I add existing data structures to Data Expected list?
- Research which data structure best matches your data expected by searching the NDA Data Dictionary.
- Visit your NDA Collection, and click "New Data Expected" under the Data Expected tab.
- Use the "Search by Data structure Title" option
- Enter the target enrollment, the initial submission date, and the initial share date.
- Then search for the data structure name either by the long or short name and select the appropriate Data Structure.
- Then click Add Data Expected.
How do I create new data structures?
- Visit the NDA Collection, and click "New Data Expected" under the data expected tab.
- Click Upload Definition, enter the information, add the data structure name, and select the data structure file.
- Once you do this, a data curator will reach out to the PI regarding the mapping of your data structure and eventually provide the data structure's submission template.
How do I request changes to existing data structures?
- Download the "Definitions" file from the Data Structure page that you wish to modify.
- This should be a .csv formatted file and can be edited in Excel.
- If there are additional Data Elements you wish to add:
- Append the new element as a new row in red text.
- Search to see if it already exists in the NDA Data Dictionary.
- If that Data Element already exists in another Data Structure, use the exact same ElementName as it appears in the other Data Structure.
- If no element in the NDA Data Dictionary is appropriate, request a new Data Element.
- Make sure the ElementName you propose does not match any existing elements by searching the Data Dictionary with your proposed name.
- If there are Data Elements you wish to change,
- Highlight them in yellow (e.g., if you want to change 'my_raw_score' from 'Integer' type to 'Float' type, highlight the corresponding cell that says 'Integer' in yellow).
- Be sure to save this file in a spreadsheet format (e.g., xlsx) so that your red text and yellow highlights are saved.
- Email the
NDA Help Desk
with the following:
- An outline of the changes/additions you wish to make.
- A justification for the change.
- The modified "Definitions" file as .xlsx attachment.
- Your NDA Collection ID.
|
Back to top of page
Validation and Upload Tool
|
The
Validation and Upload Tool
can be used at any time during your data
submission process to validate your data against the NDA Data Dictionary.
- NDA strongly encourages all submitters to use this tool as frequently as possible to ensure your data is harmonized correctly.
- The Validation and Upload Tool is accessible to users with at least submission permissions to an NDA Collection.
What should I do if I receive an error when submitting data via the Validation and Upload tool and do not know how to fix it?
- Users can submit data through the Validation and Upload Tool even if warnings are present.
- If you receive an error in the HTML Validation and Upload Tool and are unsure of how to move forward:
- Scroll down to the bottom and click Request Help while you are already in the tool.
- That will send the NDA Help Desk more information to help troubleshoot the issue.
- Please include all the information including the: Error message and NDA Collection number.
- If you receive an error in the Python version, please email the NDA Help Desk and include:
- A screenshot of the error, that shows as much of the screen as possible.
- Your NDA Collection ID.
- The Data Structure(s) you are submitting.
If QA errors were identified from a previous submission cycle, do I still submit data?
-
Please
correct the QA errors before doing a new submission!
-
Users should not submit new data with the resubmissions.
|
Back to top of page
Submission Exemptions
|
Submission exemptions notify NDA that data may not be submitted during the upcoming/current submission cycle.
- These can be submitted at any time before or during the submission cycle.
- Submission exemptions can be submitted via the Data Expected tab of your NDA Collection.
- Users must have submission or admin permissions to submit a submission exemption.
Types of Exemptions
Exemption Type |
Title |
Description |
Type A |
No New Data This Period |
If you have no new data to submit |
Type B |
Deadline Extension |
If you have data to submit, but it will be submitted after the submission deadline |
Type C |
No New Data - Change Phase to Data Analysis |
You are completely done submitting data for the entire study and will not submit any new data |
|
Back to top of page
If you have further questions, please contact the NDA Help Desk at NDAHelp@mail.nih.gov.