Browsing by Author "Magee, Kevin N."
Now showing 1 - 2 of 2
Results Per Page
Sort Options
Item Estimating individual rater reliabilities(1992) Overall, John E.; Magee, Kevin N.Rating scales have no inherent reliability that is independent of the observers who use them. The often reported interrater reliability is an average of perhaps quite different individual rater reliabilities. It is possible to separate out the individual rater reliabilities given a number of independent raters who observe the same sample of ratees. Under certain assumptions, an external measure can replace one of the raters, and individual reliabilities of two independent raters can be estimated. In a somewhat similar fashion, estimates of treatment effects present in ratings by two independent raters can provide the external frame of reference against which differences in their individual reliabilities can be evaluated. Models for estimating individual rater reliabilities are provided for use in selecting, evaluating, and training participants in clinical research. Index terms: attenuation, correlation, individual raters, interrater reliability, multiple raters, rater reliability, rating scales, reliability of ratings, significance.Item Replication as a rule for determining the number of clusters in hierarchical cluster analysis(1992) Overall, John E.; Magee, Kevin N.A single higher-order cluster analysis can be used to group cluster mean profiles derived from several preliminary analyses. Replication is confirmed when each higher-order cluster contains one cluster mean profile from each of the several preliminary analyses. This study evaluated the utility of replication as a stopping rule in hierarchical cluster analysis. Replication defined by higher-order clustering identifies the correct number of underlying populations that have distinct density regions in the multivariate measurement space. When increased within-population variance obliterates population distinctions, the replication criterion provides an underestimation of the actual number of latent populations. In the case of no true cluster structure or in the case of only two latent populations, chance replication can occur. Thus, replication suggested by higher-order cluster analysis is not a conservative test for the absence of a cluster structure, but it does provide valid evidence concerning the number of latent populations when several are present. Index terms: cluster analysis, cluster means, hierarchical clustering, replication in cluster analysis, stopping rule in cluster analysis, validity of cluster analysis.