Estimating individual rater reliabilities
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
Estimating individual rater reliabilities
Authors
Published Date
1992
Publisher
Type
Article
Abstract
Rating scales have no inherent reliability that is
independent of the observers who use them. The
often reported interrater reliability is an average of
perhaps quite different individual rater reliabilities.
It is possible to separate out the individual rater
reliabilities given a number of independent raters
who observe the same sample of ratees. Under certain
assumptions, an external measure can replace
one of the raters, and individual reliabilities of two
independent raters can be estimated. In a somewhat
similar fashion, estimates of treatment effects present
in ratings by two independent raters can provide
the external frame of reference against which differences
in their individual reliabilities can be
evaluated. Models for estimating individual rater
reliabilities are provided for use in selecting, evaluating,
and training participants in clinical research.
Index terms: attenuation, correlation, individual
raters, interrater reliability, multiple raters, rater reliability,
rating scales, reliability of ratings, significance.
Keywords
Description
Related to
Replaces
License
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Overall, John E & Magee, Kevin N. (1992). Estimating individual rater reliabilities. Applied Psychological Measurement, 16, 77-85. doi:10.1177/014662169201600109
Suggested citation
Overall, John E.; Magee, Kevin N.. (1992). Estimating individual rater reliabilities. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/115634.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.