changed 6 years ago  
Published Linked with GitHub

CarpentryConnect 2019 ReproHack Notes

tags: Templates Meeting
  • Location: Room 2.15, Kilburn Building, University of Manchester
  • Date: 27th June 2019 9.30am-15:30pm
  • Participants:
    • Anna Krystalli (University of Sheffield)
    • Tania Allard (Microsoft)
    • Jez Cope (The British Library)
    • François Michonneau (The Carpentries)
    • Andrew Stewart (University of Manchester)
    • Jess Ward (Newcastle University)
    • Manal Albahlal (University of Manchester)
    • Penny Wheeler (Macquarie University; Australian Catholic University)
    • Radovan Bast (University of Tromso/ NeIC)
    • Anne Fouilloux (University of Oslo, NO)
    • Tim Dennis (UCLA)

Plan of Action

Welcome and Introduction

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →
Form teams

Feel free to tackle papers individually or as teams.

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →
Select papers

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →
Reproduce

  • Attempt to reproduce papers from available materials and documentation
  • Make notes about your experiences, in particular with respect to how easy it is to:
    • Image Not Showing Possible Reasons
      • The image file may be corrupted
      • The server hosting the image is unavailable
      • The image path is incorrect
      • The image format is not supported
      Learn More →
      navigate the materials
    • Image Not Showing Possible Reasons
      • The image file may be corrupted
      • The server hosting the image is unavailable
      • The image path is incorrect
      • The image format is not supported
      Learn More →
      reproduce the analysis
    • Image Not Showing Possible Reasons
      • The image file may be corrupted
      • The server hosting the image is unavailable
      • The image path is incorrect
      • The image format is not supported
      Learn More →
      reuse the materials

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →
Feedback to authors

Paste links to any derived materials produced here: Remember to include a link to your team issue #.

Discussion notes

Discussion Topic 1: Remote ReproHacks

Can we make this happen?

What technologies would we need?

What would loose compared to the localised experience? Could we make up for it?

Discussion Topic 2: Reproducibility Reports

What should they contain?

Regroup notes

Notes

I was meant to work on the reproduction of https://www.nature.com/articles/ncomms12737#supplementary-information but it seems that supplementary files are not accessible eventhough Nature claims they are 🤦🏻‍♀️

– (by Manal )
I am wondering if there any automated way to pull the data and code from supplementary or additional files. Should the scientific community start recommend some regulations and formats to smooth the way of how/where these kind of data are being available and benefical?
After a little discussion with Emmy, Binder is one of the promising environments to hold the needed stuff to reproduce a paper. The main concern is the Binder is too slow.

–

(Andrew) I had a go at reproducing the analysis for "Comparing theory-driven and data-driven attractiveness models using images of real women’s faces" by Holzleitner et al. (in press) JEP:HPP. There are two .Rmd scripts in the OSF repo for this paper. The first script involves data processing. It wouldn't execute as the data files needs weren't on OSF. It turns out there is a very good reason for this - speaking with one of the authors (Ben Jones), it transpired that if those data were open, then people would be able to reconstruct the face images associated and then have access to the associated attractiveness ratings provided by a separate group of participants. After communicating with Ben I understand that a note is being added to the OSF README to make it clear that the first script won't execute because of the restriction on making the associated data freely available.

Select a repo