Report on Challenges of Practical Reproducibility Published

We are pleased to share the “Report on Challenges of Practical Reproducibility for Systems and HPC Computer Science” (Kate Keahey, Marc Richardson, Rafael Tolosana Calasanz, Sascha Hunold, Jay Lofstead, Tanu Malik, and Christian Perez). The report distills the outcomes of the Community Workshop on Practical Reproducibility in HPC, held in Atlanta in November 2024, into a concrete set of challenges and recommendations for making systems and HPC research reproducible in practice. It is openly available on Zenodo (DOI 10.5281/zenodo.15306610) and summarized on the REPETO project site.

This report is part of a broader, ongoing effort to build capacity for practical reproducibility through REPETO, our NSF-funded research coordination network. Related work includes our Summer of Reproducibility mentorship program — whose approach we describe in the recent ACM REP’25 paper “Summer of Reproducibility: Building Global Capacity for Practical Reproducibility through Hands-On Mentorship” — along with our reproducibility hackathons and a growing set of community resources. Explore more of REPETO’s work on the project news page.