NICEST2 hackathon on FAIR climate data

This document is synchronized as you type, so that everyone viewing this page sees the same text. This allows you to collaborate seamlessly on documents.

Attendees are expected to follow our code of conduct: https://docs.carpentries.org/topic_folders/policies/code-of-conduct.html

All content is publicly available under the Creative Commons Attribution License: https://creativecommons.org/licenses/by/4.0/

Logistics

Notes from day-1

Icebreaker

After day-1, do you still have some hopes for this hackathon? What are they?

Welcome

Code of Conduct

How to report CoC issues to the CoC committee?

Presentation

Please sign in so we can record your attendance.

Name, Institution, relevant project, Email & Twitter (optional)

EOSC-Nordic Jupyterhub

Planning for practical sessions

Day 2 (03/16, 13:00-17:00 CET) and day 3 (03/17, 13:00-17:00 CET) are scheduled for practical work. We hope this provides an opportunity for those interested/motivated in diving deeper into some of the questions raised today in a breakout/working group setting?

Some ideas/suggestions for breakout themes (but we want to hear your ideas also!):

and detail how the (CMIP) metadata from one of these papers can be determined for someone trying to reproduce the research. (Prashanth)

HackMD for Tools and metadata: https://hackmd.io/@nicest2/H1ibGVAXd

Thoughts & inputs about hackathon

  • Matus: Apply to climate and use knowledge from bio-informatics (inputs as an "outsider" from climate), interested in options / efforts towards motivating & lowering barrier. I'll be jumping between the different breakout rooms 🦘
  • Abdelkader: interested to work on lowering the barrier for the scientists. There has been various developments in recent years in terms of data formats and tools (e.g NetCDF, CF-compilants) to make sure the climate data is standardized and well documented. Would it be possible to come up with automated FAIRness checks extending the meta data so that increasing our confidence in (re) using these datasets?
  • Oskar: motivate on why we "should" share data. Regional modelling to catch up with the global. Publication of research climate data to ESGF to be considered to benefit from existing work
  • Jean: see on a practical example how to "make something FAIR" +1+1
  • Adil: DMP integration with other services (for instance in Norway with Sigma2 MAS), ES-DOC. also interested in working on making data FAIR (practical example).
  • Klaus: identify existing project/tools to extend/reuse. https://c6dreq.dkrz.de/, undertand what kind of grids are used (CMIP6, etc.), make a registry of the different grids (can be reused to re-grid)

ES-DOC ocean description metadata for CMIP6: https://specializations.es-doc.org/static/index.html?target=cmip6.ocean&client=esdoc-url-rewrite

  • Aiden: see what tools could be reused (in our own research group), from own data, consider using Aiden et al.'s data as a practical example
  • Joakim: librarian, DMP (machine actionable) as a tool to evaluate FAIRness of the data. ES-DOC and E

Day-2 presentation from Joakim (DMP)

Ask questions below:

  • Tool to get a score for the FAIRness https://f-uji.net/
  • Is there a way to directly get a score for the DMP?
    • It is not possible in DMPOnline, but possibly in the Data Stewardshap Wizard
  • Is f-uji tool usable for DMP only?
    • No, Fuji is usable only for datasets. If you have a dataset with an identifier then you can use the tool to check the FAIRness. All the tool does is to access the page and try to see if it can find links to information. It doesn't check the quality of the metadata.
  • How does the Fuji score compare with the DMP score?
  • Are DMPs compulsory in Sweden?
    • Depends on the funder, but in most cases they are.
  • Is the API "accessible" to end-users?
    • Probably not (one needs to be admin)
    • But can be downloaded (in different formats)

Day 3

Working groups

1. FAIR climate cookbook:

Participants: Abdelkader, Oskar, Aiden, Hamish, Adil, Jean

​​​​- Create repo in https://github.com/NordicESMhub/
​​​​- Create basic book structure
​​​​- Start hacking content

2. Idealized citation

Participants: Tyge, Naoe, Kirsten, Prashanth, Anne, Klaus

​​​​- Decide on a paper(s) to analyze citation 
​​​​    - data   
​​​​    - software
​​​​- Push recommendations to cookbook
​​​​- Consider a small article for EOSC-Nordic?
​​​​- [nature paper](https://www.nature.com/articles/s41561-020-00649-1)

CMIP6 data citation; add handles for CMIP6 (Identifier, PID) for the entire dataset (not per file as a dataset can be split per time):

But we could give the PID of the entire dataset.

–> the best would be to get a PID from a downloaded dataset. (to add in the cookbook); provide a simple tool to return PID from data stored on disk.

CMIP5 REST API example: https://esgf-node.llnl.gov/esg-search/search?type=File&tracking_id=826ee5e9-3cc9-40a6-a42b-d84c6b4aad97

CMIP6 REST API example: https://esgf-node.llnl.gov/esg-search/search?type=File&tracking_id=hdl:21.14100/a97ec9f6-f29f-4c79-b809-285926068043
Resolve hdl handle: https://hdl.handle.net/

Data-ography section

  • CMIP6: list of handles and identifier (see above)
    • DOI of the code or tool to compute anomalies (version, PID). If your own tool in github, make a release and get a DOI with zenodo.
  • GISTEMP v4 : no PID so download dataset and archive it to get a PID?
    • Compute annual mean (DOI of code; in that case it may be too simple and unecessary)
  • Code to make Figure 1a (this code could be added with paper or github)
    • Data use for plotting saved so it is easy to reproduce the plot

3. Ontologies

Participants: Oscar from 15:00, Matus (jumping between groups), Klaus

​​​​- White paper/roadmap
​​​​    - Outline
​​​​    - Where will it be hosted?
​​​​    - How to contribute?
​​​​- Important Ontologies or Ontology-like information
​​​​    - CF Conventions: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-conventions.html
​​​​    - CF Standard Names: http://cfconventions.org/standard-names.html
​​​​    - CMIP6 Data Request: http://clipc-services.ceda.ac.uk/dreq/index.html
​​​​        - Implementation repository (svn): http://proj.badc.rl.ac.uk/svn/exarch/CMIP6dreq/tags/01.00.33/dreqPy/docs
​​​​    - ES-DOC cim schema: https://github.com/ES-DOC/esdoc-cim-v2-schema
​​​​    - IS-ENES3 Milestones: https://is.enes.org/documents/milestones
​​​​- Other communities:
​​​​    - https://bioportal.bioontology.org
​​​​    - http://agroportal.lirmm.fr/ontologies

Sustainability Please think how your activity can be sustained after the end of the hackathon

Select a repo