DKRZ CMIP6 data submission form for ESGF publication

Overview

You want to store and publish CMIP6 data at DKRZ via ESGF ? This form will provide some background information and guide you through the process.
To organize the data ingest we need some specific information with respect to the CMIP6 data collection you want to publish (e.g. concerning data structure, content and quality). The form has to be filled before the ESGF data ingest and publication process can be started.
In case you have questions please contact esgf-publication@dkrz.de

Preconditions for your data submission

You need to be aware of a set of technical requirements which have to be addressed before CMIP6 data submission to DKRZ and ESGF data publication are possible. They are collected at the official WCRP CMP Phase6 (CMIP6) site in the Guide to CMP6 Participation. In the following a short summary of key prerequisites is given:

• Your institution as well as your model has to be registered on the WCRP-CMIP github site

• Contact and citation information has to be registered in the citation GUI documentation of GUI

• Your data conforms to the CMIP6 specifications for file names, directory structures and CMIP6 Data Reference Syntax (DRS)

  • Directory structure:

    
    <mip_era>/<activity_id>/<institution_id>/<source_id>/
       <experiment_id>/<member_id>/<table_id>/<variable_id>/<grid_label>/
    

  • File naming convention:

       <variable_id>_<table_id>_<source_id>_<experiment_id><member_id>
           _<grid_label[_<time_range>].nc
    
    

  • Please make sure your data is quality checked before submission to a data center. Two tools for checking are recommended:

    • CMOR/PREPARE checker (minimal check):
      • github: https://github.com/PCMDI/cmor
      • documentation: https://cmor.llnl.gov/mydoc_cmip6_validator/
    • DKRZ_QA checker (incluces CMOR/PREPARE checker optionally):
      • github: https://github.com/IS-ENES-Data/QA-DKRZ
      • documentation: http://qa-dkrz.readthedocs.io/en/latest/

Start submission procedure

The submission is based on this interactive document consisting of "cells" you can modify and then evaluate.
Evaluation of cells is done by selecting the cell and pressing the keys "Shift" + "Enter".

Please evaluate the following cell to identifiy your form (associate your name and email to this form).

Attention: the name selected must match the name at the opt of this page !

Step 1: provide generic data submission related information

Type of submission

please specify the type of this data submission:

• "initial_version" for first submission of data
• "new _version" for a re-submission of previousliy submitted data
• "retract" for the request to retract previously submitted data

CMOR compliance

• please provide information on the software and tools you used to make sure your data is CMIP6 CMOR3 compliant

Documentation availability

• please provide information with respect to availability of es-doc model documentation
• in case this form addresses a new version replacing older versions: provide info on the availability of errata information especially refer to errata information provided using the CMIP6 errata web frontend

Uniqueness of tracking_id and creation_date

All your file have unique tracking_ids assigned in the structure required by CMIP6 ?

In case any of your files is replacing a file already published, it must not have the same tracking_id nor the same creation_date as the file it replaces. Did you make sure that that this is true ?

Reply 'yes'; otherwise adapt your files, no ESGF publication is possible !

Generic content characterization based on CMIP6 directory structure

Please name the respective directory names characterizing your submission:

• all files within the specified directory pattern are subject to ESGF publication

CMIP6 directory structure:

    <CMIP6>/<activity_id>/<institution_id>/<source_id>/
        <experiment_id>/<member_id>/<table_id>/<variable_id>/
        <grid_label>/<version>  

e.g. form_data_dir_1 = '/CMIP6/CMIP/MPI-M/MPIESM-1-2-HR/ piControl/r1i2p1f1//3hr//* '

addresses all 3hr data in the specified experiment/member

Provide specific additional information for this submission

• variables, grid, calendar, ...
• example file name
• .. what do we need ..?

Exclude variable list

In each CMIP6 file there may be only one variable which shall be published and searchable at the ESGF portal (target variable). In order to facilitate publication, all non-target variables are included in a list used by the publisher to avoid publication. A list of known non-target variables is [time, time_bnds, lon, lat, rlon ,rlat ,x ,y ,z ,height, plev, Lambert_Conformal, rotated_pole]. Please enter other variables into the left field if applicable (e.g. grid description variables), otherwise write 'N/A'.

CMIP6 terms of use

• please explicitly note, you are ok with the CMIP6 terms of use

Step 2: provide information on the data handover mechanism

• the following information (and other information needed for data transport and data publication)

Example file name

Please provide an example file name of a file in your data collection, this name will be used to derive the other

Step 3: Check your submission before submission

Step 4: Save and review your form

your form will be stored (the form name consists of your last name plut your keyword)

Step 5: officially submit your form

the form will be submitted to the DKRZ team to process you also receive a confirmation email with a reference to your online form for future modifications