Repeatability, reproducibility, and rigor in systems research

Jan Vítek · Tomáš Kalibera

79 citations0/0 files storedACM International Conference on Embedded Software (EMSOFT)

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Scientific Computing and Data Management Research, Science, and Academia Software Engineering Techniques and Practices

Abstract

Computer systems research spans sub-disciplines that include embedded and real-time systems, compilers, networking, and operating systems. Our contention is that a number of structural factors inhibit quality research and decrease the velocity of science. We highlight some of the factors we have encountered in our work and observed in published papers and propose solutions that, if widely adopted, could both increase the productivity of researchers and the quality of their output.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 79 citations exist upstream.

References

1994Guidelines for evaluating and expressing the uncertainty of NIST measurement results 2018Guidelines for evaluating and expressing the uncertainty of NIST measurement results 1954An Introduction to Scientific Research 2009Producing wrong data without doing anything obviously wrong!

Cited by

2015From Repeatability to Reproducibility and Corroboration 2017Investigating reproducibility and tracking provenance – A genomic workflow case study 2016Best practices for replicability, reproducibility and reusability of computer-based experiments exemplified by model reduction software 2016The Truth, The Whole Truth, and Nothing But the Truth 2022Reproducibility in Computing Research: An Empirical Study 2015Apt 2018Schroedinger’s Code: A Preliminary Study on Research Source Code Availability and Link Persistence in Astrophysics 2014Reproducibility, correctness, and buildability: The three principles for ethical public dissemination of computer science and engineering research

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.