Comparisons with a Standard in Simulation Experiments

Barry L. Nelson · David M. Goldsman

84 citations0/0 files storedManagement Science

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Simulation Techniques and Applications Optimal Experimental Design Methods Complex Systems and Decision Making

Abstract

We consider the problem of comparing a finite number of stochastic systems with respect to a single system (designated as the “standard”) via simulation experiments. The comparison is based on expected performance, and the goal is to determine if any system has larger expected performance than the standard, and if so to identify the best of the alternatives. In this paper we provide two-stage experiment design and analysis procedures to solve the problem for a variety of scenarios, including those in which we encounter unequal variances across systems, as well as those in which we use the variance reduction technique of common random numbers and it is appropriate to do so. The emphasis is added because in some cases common random numbers can be counterproductive when performing comparisons with a standard. We also provide methods for estimating the critical constants required by our procedures, present a portion of an extensive empirical study, and demonstrate one of the procedures via a numerical example.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 84 citations exist upstream.

References

1995Using Common Random Numbers for Indifference-Zone Selection and Multiple Comparisons in Simulation 1995Two-Stage Multiple Comparisons with the Best for Computer Simulation

Cited by

2005A sequential procedure for neighborhood selection-of-the-best in optimization via simulation 2013Simulation Optimization: A Concise Overview and Implementation Guide 2010Optimization via Simulation Over Discrete Decision Variables 2012The call for equity: simulation optimization models to minimize the range of waiting times 2003Selecting The Best System: Theory And Methods 2005Comparison with a standard via fully sequential procedures 2013Sequential Bayes-Optimal Policies for Multiple Comparisons with a Known Standard 2009A quantile-based approach to system selection

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.