## Welcome to the Reproducibility Hackathon @Open Science Festival Hannover
<br>
<!-- Put the link to the event page here so people can access all materials -->
### Event Page:
### https://reprohack.org/event/22
Contains all event information and links to materials
---
# Introductions
<!-- Use this section as an ice-breaker. Introduce yourself, then allow others to
go around the room and introduce themselves too. If online, consider using break-out rooms of 5-6 people -->
---
### Open Reproducible Data Science and Statistics network in MV
- Graduate network for reproducibility in MV
- https://ords-mv.github.io/
- Part of German Reproducibility Network
<img src="https://ords-mv.github.io/assets/images/ords-logo-large.png" alt="ORDS Logo" width="300"/>
---
### Biologist + Computer Scientist by training
**Anja Eggert ([@AnjaEggert42](https://twitter.com/AnjaEggert42))**
- Statistical Advisor at Research Institute for Farm Animal Biology
**Frank Krüger ([@\_frank\_k\_](https://twitter.com/_frank_k_))**
- Research Associate at University of Rostock
---
## ReproHack Objectives
1. **Practical Experience in Reproducibility**
3. **Feedback to Authors**
5. **Think more broadly about opportunities and challenges**
---
## ReproHack
https://www.reprohack.org/
---
## What about you?
<!-- Open it up to participants -->
- ### Who are you?
- ### Why are you here?
---
# Plan of Action
---
### Reproduce paper
1. **Paper review (and team formation)**
2. **Select and register your paper on hackpad**
3. **Work on your paper!**
4. **Feedback at the end (group & authors)**
---
# Tips for reviewing
---
<!-- Remind participant of code of conduct and basic expectations. Bring attention to the additional considerations involved in giving feedback to authors -->
## Code of Conduct
Event governed by [**ReproHack Code of Conduct**](https://reprohack.org/code-of-conduct)
<br>
### Additional Considerations
- #### Reproducibility is hard!
- #### Submitting authors are incredibly brave!
---
## Thank you Authors! :raised_hands:
- #### Without them there would be no ReproHack.
- #### Show gratitude and appreciation for their effort and bravery. :pray:
- #### Constructive criticism only please!
---
## Reproduce and Review
# :mag:
---
## Selecting Papers
- **Author comments:** paper description and why you should choose to reproduce.
- **Tags:** Tools, languages & domains
- **No. attempts:** No. times reproduction has been attempted
- **Mean Repro Score:** Mean reproducibility score (out of 10)
- lower == harder!
---
## Preselected papers
- REMoDNaV: robust eye-movement classification for dynamic stimulation
- https://www.reprohack.org/paper/53/
- The role of conidia in the dispersal of *Ascochyta rabiei*
- https://www.reprohack.org/paper/41/
---
## Review as an auditor :bookmark_tabs:
---
## Access
- How easy was it to gain access to the materials?
## Installation
- How easy / automated was installation?
- Did you have any problems?
---
## Data
- Were data clearly separated from code and other items?
- Were large data files deposited in a trustworthy data repository and referred to using a persistent identifier?
- Were data documented ...somehow...
---
## Documentation
Was there adequate documentation describing:
- how to install necessary software including non-standard dependencies?
- how to use materials to reproduce the paper?
- how to cite the materials, ideally in a form that can be copy and pasted?
---
## Analysis
- Were you able to fully reproduce the paper? :white_check_mark:
- How automated was the process of reproducing the paper?
- How easy was it to link analysis code to:
- the plots it generates
- sections in the manuscript in which it is described
---
## Analysis
### If the analysis was not fully reproducible :no_entry_sign:
- Did results (e.g. model outputs, tables, figures) differ to those published? By how much?
- Were missing dependencies?
- Was the computational environment not adequately described / captured?
---
## Review as a user :video_game:
<br>
#### What did you find easy / intuitive?
#### What did you find confusing / difficult
#### What did you enjoy?
---
# Feed back
# :speech_balloon:
---
## Feedback as a community member
<br>
#### Acknowledge author effort
#### Give feedback in good faith
#### Focus on community benefits and system level solutions
---
# Additional activities
---
## Finished early?
### Explore the work more deeply:
- Try and run additional analyses.
- Create new plots.
- Combine materials with your own or other open materials available on the web!
---
# Let's go! :checkered_flag:
---
## 1. Paper review
+ Have a look at the papers available for reproduction
+ Add your details to the **hackpad**.
+ Fine to work individually or tackle a papers as group
---
## 2. Project registration
- Register your team and paper on the **hackpad**
- https://hackmd.io/@ords/BJGOE9cJs
---
## 3. Reproduce Paper
- Inspect the review form.
- https://www.reprohack.org/review/
- Try to reproduce the paper using the materials provided.
- Record your responses to review questions according to your experiences.
---
## 4. Mid-point regroup
- Which paper have you selected? Briefly describe what it's about.
- Briefly describe the approach to reproducibility the paper has taken.
- Anything in particular you like about the paper's approach so far?
- Anything you're having difficulty with?
---
## 5. Feedback to authors
- **Please complete the feedback form for authors**
- Feel free to record general findings the hackpad
---
## 6. Final regroup
- So, how did you get on?
- Final comments.
- If there's time, tackle some discussion topics (see hackpad).
- On post-its: One thing you liked, one thing that can be improved.
---
# Get involved!
### Visit ReproHack Hub <https://reprohack.org>
- [**Submit a paper for review**](https://reprohack.org/paper/new/)
- [**Organise your own event**](https://reprohack.org/event/new/)
_Check out our [Resources](https://reprohack.org/resources) for more details_
### Chat to us:
[![Slack](https://img.shields.io/badge/slack-join%20us-orange?style=for-the-badge&logo=slack)](https://reprohack-autoinvite.herokuapp.com/)
---
# THANK YOU ALL! :pray:
- #### Thank you PARTICIPANTS for coming!
- #### Thank you AUTHORS for submitting!
- #### Thanks to <any-sponsors> for sponsoring!
# :wave:
{"metaMigratedAt":"2023-06-17T07:52:35.372Z","metaMigratedFrom":"YAML","title":"Open Science Festival ReproHack slides","breaks":true,"description":"View the slide with \"Slide Mode\".","slideOptions":"{\"theme\":\"white\"}","contributors":"[{\"id\":\"1f705e2d-b6b6-4c14-a696-77ad7e25d6d8\",\"add\":9041,\"del\":2393},{\"id\":\"d3c65d7c-bea1-4bcf-9165-96ed51c0398a\",\"add\":2,\"del\":0}]"}