Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines

Replicable
Authors
Affiliations

Thomas Monks

NIHR CLAHRC Wessex, Faculty of Health Sciences, University of Southampton

Christine Currie

Mathematical Sciences, University of Southampton

Bhakti Onggo

Trinity Business School, Trinity College Dublin

Stewart Robinson

School of Business and Economics, Loughborough University

Martin Kunc

Warwick Business School, University of Warwick

Simon Taylor

Department of Computer Science, Brunel University

Published

06 Mar 2018

Doi

10.1080/17477778.2018.1442155

This was not developed as part of the STARS project, but is related work that Tom was involved in.

Abstract

This study develops a standardised checklist approach to improve the reporting of discrete-event simulation, system dynamics and agent-based simulation models within the field of Operational Research and Management Science. Incomplete or ambiguous reporting means that many simulation studies are not reproducible, leaving other modellers with an incomplete picture of what has been done and unable to judge the reliability of the results. Crucially, unclear reporting makes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality of model reporting and consolidate previous work. We derive general good practice principles and three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation Studies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agent-based simulation and system dynamics, respectively. Given the variety of simulation projects, we provide usage and troubleshooting advice to cover a wide range of situations.

Article

Citation

BibTeX citation:
@online{monks2018,
  author = {Monks, Thomas and Currie, Christine and Onggo, Bhakti and
    Robinson, Stewart and Kunc, Martin and Taylor, Simon},
  title = {Strengthening the Reporting of Empirical Simulation Studies:
    {Introducing} the {STRESS} Guidelines},
  date = {2018-03-06},
  url = {https://pythonhealthdatascience.github.io/stars/pages/publications/2018/monks2018strengthening/},
  doi = {10.1080/17477778.2018.1442155},
  langid = {en}
}
For attribution, please cite this work as:
Monks, Thomas, Christine Currie, Bhakti Onggo, Stewart Robinson, Martin Kunc, and Simon Taylor. 2018. “Strengthening the Reporting of Empirical Simulation Studies: Introducing the STRESS Guidelines.” March 6, 2018. https://doi.org/10.1080/17477778.2018.1442155.