Relative and Absolute Fit Evaluation in Cognitive Diagnosis Modeling

Jinsong Chen · Jimmy DE LA TORRE · Zao Zhang

194 citations0/0 files storedJournal of Educational Measurement

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Educational Technology and Assessment

Abstract

As with any psychometric models, the validity of inferences from cognitive diagnosis models (CDMs) determines the extent to which these models can be useful. For inferences from CDMs to be valid, it is crucial that the fit of the model to the data is ascertained. Based on a simulation study, this study investigated the sensitivity of various fit statistics for absolute or relative fit under different CDM settings. The investigation covered various types of model–data misfit that can occur with the misspecifications of the Q‐matrix, the CDM, or both. Six fit statistics were considered: –2 log likelihood (–2LL), Akaike's information criterion (AIC), Bayesian information criterion (BIC), and residuals based on the proportion correct of individual items (p), the correlations (r), and the log‐odds ratio of item pairs (l). An empirical example involving real data was used to illustrate how the different fit statistics can be employed in conjunction with each other to identify different types of misspecifications. With these statistics and the saturated model serving as the basis, relative and absolute fit evaluation can be integrated to detect misspecification efficiently.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 194 citations exist upstream.

References

2001Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory 1983RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY 2011The Generalized DINA Model Framework 2010Diagnostic measurement: Theory, methods, and applications.2006Measurement of psychological disorders using cognitive diagnosis models.2004Higher-Order Latent Trait Models for Cognitive Diagnosis 2008Defining a Family of Cognitive Diagnosis Models Using Log-Linear Models with Latent Variables 1999Estimating Multiple Classification Latent Class Models

Cited by

2020GDINA: An R Package for Cognitive Diagnosis Modeling 2015Application of a Cognitive Diagnostic Model to a High-Stakes Reading Comprehension Test 2016Model Similarity, Model Selection, and Attribute Classification 2013Evaluating the Wald Test for Item‐Level Comparison of Saturated and Reduced Models in Cognitive Diagnosis 2016Validity and Reliability of Situational Judgement Test Scores

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.