| scenario | policy | policy_param | crit | type1 | type2 | type3 | total | total_ly | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | unmitigated | 1 | NaN | baseline | 455 (131 to 1178) | 0 (0 to 0) | 54 (37 to 75) | 509 (180 to 1237) | 12968 (4504 to 31634) |
| 1 | unmitigated | 1 | NaN | 50 | +54 (49 to 61) | 0 (0 to 0) | -39 (-50 to -30) | +15 (9 to 24) | -521 (-763 to -21) |
| 2 | unmitigated | 1 | NaN | 60 | +27 (23 to 27) | 0 (0 to 0) | -25 (-33 to -20) | +2 (-9 to 5) | -501 (-761 to -483) |
| 3 | unmitigated | 1 | NaN | 70 | +10 (8 to 9) | 0 (0 to 0) | -11 (-14 to -9) | -1 (-5 to 2) | -240 (-316 to -303) |
| 4 | unmitigated | 1 | NaN | 80 | +2 (0 to 5) | 0 (0 to 0) | -2 (-3 to -2) | +0 (-3 to -2) | -41 (-229 to 6) |
Summary report
For computational reproducibility assessment of Author et al. Year
Study
Wood RM, Pratt AC, Kenward C, McWilliams CJ, Booton RD, Thomas MJ, Bourdeaux CP, Vasilakis C. The Value of Triage during Periods of Intense COVID-19 Demand: Simulation Modeling Study. Medical Decision Making 41(4):393-407 (2021). https://doi.org/10.1177/0272989X21994035.
This study uses discrete-event simulation to explore the deaths and life years lost under different triage strategies for an intensive care unit, relative to a baseline strategy. The unit is modelled with 20 beds (varied from 10 to 200 in sensitivity analyses). Three different triage strategies are explored, under three different projected demand trajectories.
Computational reproducibility
Successfully reproduced 5 out of 5 (100%) of items from the scope in 3h 50m (9.6%).
Required troubleshooting:
- Environment - identifying required packages and creating
renv - File paths - amending for imports and exports (although this was partly because I reorganised repository, and would always be necessary)
- Syncing raw results file - compress file and set up GitHub Large File Storage for the raw results
- Correction to figure - add smoothing to figure 7 code
Cannot display original figure as do not have permission for reuse, but can view at Wood et al. (2021)
Reproduction:
Cannot display original figure as do not have permission for reuse, but can view at Wood et al. (2021)
Head of reproduced table (view full table on reproduction success page):
Cannot display original figure as do not have permission for reuse, but can view at Wood et al. (2021)
Reproduction:
Cannot display original figure as do not have permission for reuse, but can view at Wood et al. (2021)
Reproduction:
Cannot display original figure as do not have permission for reuse, but can view at Wood et al. (2021)
Reproduction:
Evaluation against guidelines
Context: The original study repository was evaluated against criteria from journal badges relating to how open and reproducible the model is and against guidance for sharing artefacts from the STARS framework. The original study article and supplementary materials (excluding code) were evaluated against reporting guidelines for DES models: STRESS-DES, and guidelines adapted from ISPOR-SDM.
References
Wood, Richard M., Adrian C. Pratt, Charlie Kenward, Christopher J. McWilliams, Ross D. Booton, Matthew J. Thomas, Christopher P. Bourdeaux, and Christos Vasilakis. 2021. “The Value of Triage During Periods of Intense COVID-19 Demand: Simulation Modeling Study.” Medical Decision Making 41 (4): 393–407. https://doi.org/10.1177/0272989X21994035.