Ability of Panelists to Estimate Item Performance for a Target Group of Candidates: An Issue in Judgmental Standard Setting

Barbara Sterrett Plake · James C. Impara

24 citations0/0 files storedEducational Assessment

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Teacher Education and Assessments

Abstract

Recent researchers (Impara & Plake, 1998; National Research Council, 1999; Shepard, 1995) have called into question the ability of judges to make accurate item performance estimates for target subgroups of candidates, such as minimally competent candidates. The purpose of this study was to examine both the reliability and accuracy of item performance estimates from an Angoff (1971) standard setting application. Results provide evidence that item performance estimates were both reasonable and reliable. Factors that might have influenced these results are discussed.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 24 citations exist upstream.

References

1998Teachers' Ability to Estimate Item Difficulty: A Test of the Assumptions in the Angoff Standard Setting Method 1999Grading the Nation's Report Card: Evaluating NAEP and Transforming the Assessment of Educational Progress 1996Standard‐Setting Guidelines 1991Training Judges to Generate Standard‐Setting Data 1993Reactions to National Academy of Education Report, "Setting Performance Standards for Student Achievement.".

Cited by

2013Construct Maps as a Foundation for Standard Setting 2007Item Selection Strategy for Reducing the Number of Items Rated in an Angoff Standard Setting Study

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.