Report1997

Does Systems Research Measure Up

Christopher Small · Narendra Ghosh · Hany Saleeb · Margo Seltzer · Keith A. Smith

5 citations0/0 files storedDigital Access to Scholarship at Harvard (DASH) (Harvard University)

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Scientific Computing and Data Management Distributed systems and fault tolerance Software System Performance and Reliability

Abstract

We surveyed more than two hundred systems research papers published in the last six years, and found that, in experiment after experiment, systems researchers measure the same things, but in the majority of cases the reported results are not reproducible, comparable, or statistically rigorous. In this paper we present data describing the state of systems experimentation and suggest guidelines for structuring commonly run experiments, so that results from work by different researchers can be compared more easily. We conclude with recommendations on how to improve the rigor of published computer systems research. 1

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 5 citations exist upstream.

References

1983An Evaluation of the Ninth SOSP Submissions or: How (and How Not) to Write a Good Systems Paper.

Imported from OpenAlex (CC0) — nothing here is generated.