An investigation of ordinal true score test theory

Loading...

View/Download File

v15n4p335.pdf (1.14 MB)

Persistent link to this item

https://hdl.handle.net/11299/114465

Statistics

View Statistics

Journal Title

Journal ISSN

Volume Title

Title

An investigation of ordinal true score test theory

Authors

Donoghue, John R.

Cliff, Norman

Published Date

1991

Publisher

Type

Article

Abstract

The validity of the assumptions underlying Cliff’s (1989) ordinal true score theory (OTST) were investigated in a three-stage study. OTST makes only ordinal assumptions about the data, and provides a means of converting ordinal item information into summary ordinal information about examinees. Stage 1 was a simulation based on a classical (weak true score) test theory model. Stage 2 used a long empirical test to approximate the true order. Stage 3 was an extensive simulation based on the three-parameter logistic model. The results of all three studies were consistent; the assumption of local ordinal uncorrelatedness was violated in that partial item-item gamma (γ) correlations were positive instead of 0. The assumption of proportional distribution of ties was violated-pairs tied on one item were not distributed on the other as prescribed. The item-true order tau (τ) correlation was consistently overestimated, although the estimated τ correlated highly with the true τ. The τ correlation between total score and true order was also consistently overestimated. Stage 3 showed that these effects occurred under all conditions, although they were smaller under some conditions. Index terms: classical test theory, item response models, local independence, monte carlo simulation, nonparametric test models, ordinal regression, ordinal test models, test theory.

Keywords

Description

Related to

Replaces

License

Collections

Applied Psychological Measurement, Volume 15, 1991

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Donoghue, John R & Cliff, Norman. (1991). An investigation of ordinal true score test theory. Applied Psychological Measurement, 15, 335-351. doi:10.1177/014662169101500403

Suggested citation

Donoghue, John R.; Cliff, Norman. (1991). An investigation of ordinal true score test theory. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/114465.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.