An investigation of ordinal true score test theory
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
An investigation of ordinal true score test theory
Authors
Published Date
1991
Publisher
Type
Article
Abstract
The validity of the assumptions underlying
Cliff’s (1989) ordinal true score theory (OTST) were
investigated in a three-stage study. OTST makes only
ordinal assumptions about the data, and provides
a means of converting ordinal item information
into summary ordinal information about
examinees. Stage 1 was a simulation based on a
classical (weak true score) test theory model. Stage
2 used a long empirical test to approximate the
true order. Stage 3 was an extensive simulation
based on the three-parameter logistic model. The
results of all three studies were consistent; the
assumption of local ordinal uncorrelatedness was
violated in that partial item-item gamma (γ) correlations
were positive instead of 0. The assumption
of proportional distribution of ties was
violated-pairs tied on one item were not
distributed on the other as prescribed. The item-true
order tau (τ) correlation was consistently
overestimated, although the estimated τ correlated
highly with the true τ. The τ correlation between
total score and true order was also consistently
overestimated. Stage 3 showed that these effects
occurred under all conditions, although they were
smaller under some conditions. Index terms:
classical test theory, item response models, local
independence, monte carlo simulation, nonparametric
test models, ordinal regression, ordinal test models,
test theory.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Donoghue, John R & Cliff, Norman. (1991). An investigation of ordinal true score test theory. Applied Psychological Measurement, 15, 335-351. doi:10.1177/014662169101500403
Suggested citation
Donoghue, John R.; Cliff, Norman. (1991). An investigation of ordinal true score test theory. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/114465.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.