Group dependence of some reliability indices for mastery tests
1980
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
Group dependence of some reliability indices for mastery tests
Authors
Published Date
1980
Publisher
Type
Article
Abstract
Reliability indices for mastery tests depend not
only on true-score variance but also on mean and
cutoff scores. This dependence was examined in the
case of three decision-theoretic indices: (1) the coefficient
of agreement; (2) kappa; and (3) the proportion
of correct decisions. The binomial error
model was assumed, with a two-parameter beta distribution
for true scores. The reliability indices were
computed at five values of the mean, four values of
KR-21, and four cutoff scores. Results show that
the dependence of kappa on mean and cutoff scores
is opposite to that of the proportion of correct decisions,
which is linearly related to average threshold
loss. Moreover, kappa can be very small when
most examinees are classified correctly. Thus, objections
against the classical reliability coefficient
apply even more strongly to kappa.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Divgi, D. R. (1980). Group dependence of some reliability indices for mastery tests. Applied Psychological Measurement, 4, 213-218. doi:10.1177/014662168000400208
Suggested citation
Divgi, D. R.. (1980). Group dependence of some reliability indices for mastery tests. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/100085.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.