Investigation of model fit and score scale comparability in international assessments

María Elena Oliveri · Matthias von Davier

108 citations0/0 files stored

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Educational Assessment and Improvement

Abstract

This study used item response data from 30 countries who participated in the Programme for International Student Assessment (PISA). It compared reduction of proportion of item misfit associated with alternative item response theory (IRT; multidimensional and multi-parameter Rasch and 2 parameter logistic; 2PL) models and linking (mean-mean IRT vs. Lagrangian multiplier and concurrent calibration) approaches to those currently used by PISA to conduct score scale calibrations. The analyses are conducted with the general diagnostic model (GDM), which is a modeling framework that contains all IRT models used in the paper as special cases. The paper also investigated whether the use of an alternative score scale (i.e., a scale that includes the use of international and a subset of country-specific parameters) as compared to the use of solely international parameters for country score scale calibrations led to improvement of fit. Analyses were conducted using discrete mixture distribution IRT as well as multiple group (M-)IRT models. As compared to a scale that uses all international parameters, substantial improvement of fit was obtained using the concurrent calibration linking approach with the multi-group 2PL model allowing for partially-unique country parameters.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 108 citations exist upstream.

References

1969Statistical Theories of Mental Test Scores 1990Structural Model Evaluation and Modification: An Interval Estimation Approach 1961Probabilistic Models for Some Intelligence and Attainment Tests 2004Bias and equivalence in cross-cultural assessment: an overview 1990Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis 2010International Large-Scale Assessment Data 20037. Multilevel Latent Class Models 1992Estimating Population Characteristics From Sparse Matrix Samples of Item Responses

Cited by

2013Toward Increasing Fairness in Score Scale Calibrations Employed in International Large-Scale Assessments 2018Multistage Adaptive Testing Design in International Large‐Scale Assessments 2019Evaluating item response theory linking and model fit for data from PISA 2000–2012 2017Improving the Comparability and Local Usefulness of International Assessments: A Look Back and A Way Forward 2019Developments in Psychometric Population Models for Technology-Based Large-Scale Assessments: An Overview of Challenges and Opportunities

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.