Item response theory models and spurious interaction effects in factorial ANOVA designs

Embretson, Susan E.
1996
Thumbnail Image

View/Download File

v20n3p201.pdf (1.35 MB)

Persistent link to this item

https://hdl.handle.net/11299/119091
Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Item response theory models and spurious interaction effects in factorial ANOVA designs

Authors

Published Date

1996

Publisher

Type

Article

Abstract

In many psychological experiments, interaction effects in factorial analysis of variance (ANOVA) designs are often estimated using total scores derived from classical test theory. However, interaction effects can be reduced or eliminated by nonlinear monotonic transformations of a dependent variable. Although cross-over interactions cannot be eliminated by transformations, the meaningfulness of other interactions hinges on achieving a measurement scale level for which nonlinear transformations are inappropriate (i.e., at least interval scale level). Classical total test scores do not provide interval level measurement according to contemporary item response theory (IRT). Nevertheless, rarely are IRT models applied to achieve more optimal measurement properties and hence more meaningful interaction effects. This paper provides several conditions under which interaction effects that are estimated from classical total scores, rather than IRT trait scores, can be misleading. Using derived asymptotic expectations from an IRT model, interaction effects of zero on the IRT trait scale were often not estimated as zero from the total score scale. Further, when nonzero interactions were specified on the IRT trait scale, the estimated interaction effects were biased inward when estimated from the total score scale. Test difficulty level determined both the direction and the magnitude of the biased interaction effects. Index terms: factorial designs, interaction effects, interval measurement, item response theory, level of measurement, measurement scales, statistical inference.

Keywords

Description

Related to

Replaces

License

Collections

Applied Psychological Measurement, Volume 20, 1996

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Embretson, Susan E. (1996). Item response theory models and spurious interaction effects in factorial ANOVA designs. Applied Psychological Measurement, 20, 201-212. doi:10.1177/014662169602000302

Suggested citation

Embretson, Susan E.. (1996). Item response theory models and spurious interaction effects in factorial ANOVA designs. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/119091.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.