Estimating rater agreement in 2x2 tables: Correction for chance and intraclass correlation

Blackman, Nicole J.-M.
Koval, John J.
1993
Thumbnail Image

View/Download File

v17n3p211.pdf (514.41 KB)

Persistent link to this item

https://hdl.handle.net/11299/116366
Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Estimating rater agreement in 2x2 tables: Correction for chance and intraclass correlation

Authors

Published Date

1993

Publisher

Type

Article

Abstract

Many estimators of the measure of agreement between two dichotomous ratings of a person have been proposed. The results of Fleiss (1975) are extended, and it is shown that four estimators- Scott’s (1955) π coefficient, Cohen’s (1960) kˆ, Maxwell & Pilliner’s (1968) r₁₁, and Mak’s (1988) p˜-are interpretable both as chance-corrected measures of agreement and as intraclass correlation coefficients for different ANOVA models. Relationships among these estimators are established for finite samples. Under Kraemer’s (1979) model, it is shown that these estimators are equivalent in large samples, and that the equations for their large sample variances are equivalent. Index terms: index of agreement, interrater reliability, intraclass correlation, kappa statistic.

Keywords

Description

Related to

Replaces

License

Collections

Applied Psychological Measurement, Volume 17, 1993

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Blackman, Nicole J.-M & Koval, John J. (1993). Estimating rater agreement in 2x2 tables: Correction for chance and intraclass correlation. Applied Psychological Measurement, 17, 211-223. doi:10.1177/014662169301700302

Suggested citation

Blackman, Nicole J.-M.; Koval, John J.. (1993). Estimating rater agreement in 2x2 tables: Correction for chance and intraclass correlation. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/116366.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.