Day 5

reproduction
Author

Amy Heather

Published

October 2, 2024

Note

Test-run of reproduction package, informing author/s and archiving repository.

Untimed: Test-run of reproduction package

Tom did a test-run on XPS13 with Ubuntu 22.04:

  • Environment creation - confirm works as expected
  • Pytest - completed successfully
  • Reproduction.ipynb - reproduces charts
  • Dockerfile - container built successfully
  • Docker container - launched successfully and ran reproduction.ipynb

Untimed: Checking “unmet” criteria in evaluation

Tom also looked over the unmet criteria. Agreed in all cases. For reporting guidelines, he noted:

“The one that I thought about the most was”assumptions”. I re-read the CHARM section of the paper and my view is that I wasn’t clear on what were assumptions due to lack of knowledge/data and what wasn’t. I suspect using something like the Triangular distribution was an assumption as they had limited data, but its not stated explicitly. I guess that’s an issue with the limited space in a conference paper more than anything. So I agree with your not met.”

Untimed: Wrap-up

This marks the reproduction as complete, so we are able to:

  • Inform the author/s
  • Archive another version of the repository