The Reliability of a Certain University Examination Compared with the Precision of Absolute Judgements

Donald Laming

75 citations0/0 files storedThe Quarterly Journal of Experimental Psychology Section A

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Reliability and Agreement in Measurement

Abstract

A formula is proposed to estimate the reliability with which an examination assesses the individual merits of the candidates, using only the marks assigned naturally by the examiners. This formula, which is founded in classical test theory, can be applied (as here) to an examination in which the candidates are offered a wide choice of questions and different questions are marked by different pairs of examiners. The use of the formula is illustrated by reference to a certain university examination; and the results of analysing the correlations between marks independently awarded by different examiners are compared with previous studies of the reliability of university examinations, with similar studies of GCE examinations, and with the precision of absolute judgement of simple stimulus magnitudes.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 75 citations exist upstream.

References

1950Theory of Mental Tests 1964Uncertainty and Structure as Psychological Concepts 1910The Central Tendency of Judgment 1955THE PSYCHOLOGY OF THOUGHT AND JUDGMENT 1982A FURTHER REPORT OF INVESTIGATIONS INTO THE RELIABILITY OF MARKING OF GCE EXAMINATIONS

Cited by

1999The Experience of Introducing a Common Criteria Assessment Grid Across an Academic Department 1991Reliability, fairness, objectivity and other inappropriate goals in peer review 2008What goes through an examiner's mind? Using verbal protocols to gain insights into the GCSE marking process 1991Does the need for agreement among reviewers inhibit the publication controversial findings?2005Towards consistent penalty decisions for breaches of academic regulations in one UK university 2002An application of judgment analysis to examination marking in psychology 2009Examinations and the ESL student – more evidence of particular disadvantages 1991Referee agreement in context

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.