Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning

Loading...

View/Download File

v18n1p015.pdf (1.37 MB)

Persistent link to this item

https://hdl.handle.net/11299/116937

Statistics

View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning

Authors

Uttaro, Thomas

Millsap, Roger E.

Published Date

1994

Publisher

Type

Article

Abstract

The performance of the Mantel-Haenszel odds-ratio estimator and X² significance test were investigated using simulated data. Multiparameter logistic item response theory models were used to generate item scores for 20- and 40-item tests for 500 reference group and 500 focal group examinees. The difficulty, discrimination, and guessing parameters, and the difference in the group trait level averages were varied and combined factorially. Within each cell of the design, 200 replications were completed under both differential item functioning (DIF) and no-DiF conditions. The empirical X² Type I and Type II error rates, and the average of the odds-ratio estimates, were analyzed over the 200 replications. Under no-DiF conditions, inflated X² Type I error rates and misestimated odds-ratio values were found for the 20-item test and resulted from interactions between item parameter values and trait differences. For the 40-item test, Type I error rate inflation disappeared but odds-ratios still were misestimated. Under DIF conditions, Type II error rates were not inflated, but odds-ratios were misestimated, due to parameter X trait level interactions for both test lengths. The results demonstrate the importance of using both the odds-ratio and the significance test in interpreting the presence or absence of DIF. In addition, the accuracy under the DIF conditions depended on the size and uniformity Of DIF. Index terms: differential item functioning, item bias, item response theory, Mantel-Haenszel procedure, measurement bias, odds-ratio, simulation.

Keywords

Description

Related to

Replaces

License

Collections

Applied Psychological Measurement, Volume 18, 1994

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Uttaro, Thomas & Millsap, Roger E. (1994). Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning. Applied Psychological Measurement, 18, 15-25. doi:10.1177/014662169401800102

Suggested citation

Uttaro, Thomas; Millsap, Roger E.. (1994). Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/116937.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.