Article1996

Simulation Studies of the Effects of Small Sample Size and Studied Item Parameters on SIBTEST and Mantel‐Haenszel Type I Error Performance

256 citations0/0 files storedJournal of Educational Measurement

No readable copy stored yet — this record is metadata only.

Psychometric Methodologies and Testing Educational Assessment and Pedagogy Educational Technology and Assessment

Abstract

Two simulation studies investigated Type I error performance of two statistical procedures for detecting differential item functioning (DIF): SIBTEST and Mantel‐Haenszel (MH). Because MH and SIBTEST are based on asymptotic distributions requiring “large” numbers of examinees, the first study examined Type 1 error for small sample sizes. No significant Type I error inflation occurred for either procedure. Because MH has the potential for Type I error inflation for non‐Rasch models, the second study used a markedly non‐Rasch test and systematically varied the shape and location of the studied item. When differences in distribution across examinee group of the measured ability were present, both procedures displayed inflated Type 1 error for certain items; MH displayed the greater inflation. Also, both procedures displayed statistically biased estimation of the zero DIF for certain items, though SIBTEST displayed much less than MH. When no latent distributional differences were present, both procedures performed satisfactorily under all conditions.

Citations in this library

Stored only when both papers are in the corpus — 256 citations exist upstream.

References

1994Differential Item Functioning.2013Differential Item Performance and the Mantel–Haenszel Procedure 1993A Model-Based Standardization Approach that Separates True Bias/DIF from Group Ability Differences and Detects Test Bias/DTF as well as Item Bias/DIF 1987A Nonparametric Approach for Assessing Latent Trait Unidimensionality 1992DIF DETECTION AND DESCRIPTION: MANTEL‐HAENSZEL AND STANDARDIZATION1,2 1990A New Item Response Theory Modeling Approach with Applications to Unidimensionality Assessment and Ability Estimation 1986DEMONSTRATING THE UTILITY OF THE STANDARDIZATION APPROACH TO ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE ON THE SCHOLASTIC APTITUDE TEST 1989A New Item Response Theory Modeling Approach with Applications to Unidimensionality Assessment and Ability Estimation

Cited by

2004A Multigroup Item Response Theory Analysis of the Psychopathy Checklist-Revised.20065 Differential Item Functioning and Item Bias 2005The MIMIC Model as a Method for Detecting DIF: Comparison With Mantel-Haenszel, SIBTEST, and the IRT Likelihood Ratio 1996Detecting DIF for Polytomously Scored Items: An Adaptation of the SIBTEST Procedure 2006

Imported from OpenAlex (CC0) — nothing here is generated.