Performance of the Mantel-Haenszel and Simultaneous Item Bias Procedures for Detecting Differential Item Functioning

Pankaja Narayanan · Hari Swaminathan

131 citations0/0 files storedApplied Psychological Measurement

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Psychometric Methodologies and Testing Psychological Testing and Assessment Educational Assessment and Pedagogy

Abstract

Two nonparametric procedures for detecting differ ential item functioning (DIF)—the Mantel-Haenszel (MH) procedure and the simultaneous item bias (SIB) procedure—were compared with respect to their Type I error rates and power. Data were simulated to reflect conditions varying in sample size, ability distribution differences between the focal and reference groups, pro portion of DIF items in the test, DIF effect sizes, and type of item. 1,296 conditions were studied. The SIB and MH procedures were equally powerful in detecting uniform DIF for equal ability distributions. The SIB procedure was more powerful than the MH procedure in detecting DIF for unequal ability distributions. Both procedures had sufficient power to detect DIF for a sample size of 300 in each group. Ability distribution did not have a significant effect on the SIB procedure but did affect the MH procedure. This is important because ability distribu tion differences between two groups often are found in practice. The Type I error rates for the MH statistic were well within the nominal limits, whereas they were slightly higher than expected for the SIB statistic. Com parisons between the detection rates of the two proce dures were made with respect to the various factors. Index terms: differential item functioning, Mantel- Haenszel statistic, power, simultaneous item bias statis tic, SIBTEST, Type I error rates.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 131 citations exist upstream.

References

1990Detecting Differential Item Functioning Using Logistic Regression Procedures 2013Differential Item Performance and the Mantel–Haenszel Procedure 1993A Model-Based Standardization Approach that Separates True Bias/DIF from Group Ability Differences and Detects Test Bias/DTF as well as Item Bias/DIF 1988The Area between Two Item Characteristic Curves 1992A Didactic Explanation of Item Bias, Item Impact, and Item Validity From a Multidimensional Perspective 1986DEMONSTRATING THE UTILITY OF THE STANDARDIZATION APPROACH TO ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE ON THE SCHOLASTIC APTITUDE TEST 1993A Comparison of Logistic Regression and Mantel-Haenszel Procedures for Detecting Differential Item Functioning 1990When Do Item Response Function and Mantel-Haenszel Definitions of Differential Item Functioning Coincide?

Cited by

2004Differential Item Functioning Detection and Effect Size: A Comparison between Logistic Regression and Mantel-Haenszel Procedures 2007Iterative Purification and Effect Size Use With Logistic Regression for Differential Item Functioning Detection 1997Identifying Cultural Differences in Items and Traits 2008Estimation of Item Response Theory Parameters in the Presence of Missing Data

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.