A two-stage procedure for estimating item bias
was examined with six indexes of item bias and
with the Mantel-Haenszel (MH) statistic; the sample
size, the number of biased items, and the magnitude
of the bias were varied. The second stage of the
procedure did not identify substantial numbers of
false positives (unbiased items identified as biased).
However, the identification of true positives in the
second stage was useful only when the magnitude
of the bias was not small and the number of
biased items was large (20% or 40% of the test).
The weighted indexes tended to identify more true
and false positives than their unweighted item
response theory counterparts. Finally, the MH
statistic identified fewer false positives, but did not
identify small bias as well as the item response
theory indexes. Index terms: differential item functioning,
item bias, Mantel-Haenszel statistic, two-stage
Miller, M. David; Oshima, T. C..
Effect of sample size, number of biased items, and magnitude of bias on a two-stage item bias estimation method.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital
Conservancy may be subject to additional license and use
restrictions applied by the depositor.