We are excited to announce the Reproducibility Hackathon at the IC2E Conference taking place September 25-28, 2023 in Boston!
The hackathon, hosted by Kate Keahey of Argonne National Laboratory and Ibrahim Matta of Boston University, will take place on Monday September 25th and run the whole day. From the abstract:
Reproducibility is not just a sound scientific practice – it also has many potential practical applications in teaching and creating new research results. In this tutorial, the attendees will learn about how to package their computer science research experiments in such a way that they are not only reproducible – but also practically reproducible, i.e., capable of being reproduced easily enough to be used as a mainstream method of interactive scientific exploration and exchange.
To achieve this objective this tutorial will be part instructional and part hackathon. The instructional part will cover how to use the NSF-funded Chameleon platform, one of the largest academic clouds, and how to package experiments for reproducibility using this platform. Attendees will learn about tools and services Chameleon provides to share experiments, including using Jupyter to manage the full experimental workflow including creating the environment, implementing experiment body, and data analytics; using Chameleon daypass to give access to the testbed for reproducibility; as well as Trovi, an experiment sharing portal integrated with the testbed. The tutorial will also cover the existing experiment patterns available via Trovi representing common elements of experimental configurations such as e.g., configuring storage with RAID, NFS, or RDMA.
The second part of the tutorial will consist of a hackathon in which the attendees will either reproduce existing experiments from a list of recommendations, or participate in a “reproducibility clinic” allowing them to partially or fully package their own experiments with the help of the organizing team. After the event, participants can share their packaged experiments with their own community so that other researchers can reproduce their experiments (and potentially cite their work).
We hope that participants can use their initial work and what they learn at the Hackathon to make future contributions to reproducibility workshops and conferences such as ACM REP.
We hope to see you all there!