The traditional procedure for obtaining judged ratings,
to ascertain if treatment-related change has occurred,
involves the randomization of the materials to
be rated. An alternative approach (linked judgments)
is investigated as a potential solution to certain instrumentation-
related threats to statistical conclusion validity
of the incumbent rating procedure. Data from a
weight reduction study are presented which suggest
that linked raters’ judgments provide both a more
powerful and a more valid index of treatment effectiveness
than the traditional procedure.
Howard, George S, Obledo, Fernando H, Cole, David A & Maxwell, Scott E. (1983). Linked raters' judgments: Combating problems of statistical conclusion validity. Applied Psychological Measurement, 7, 57-62. doi:10.1177/014662168300700108
Howard, George S.; Obledo, Fernando H.; Cole, David A.; Maxwell, Scott E..
Linked raters' judgments: Combating problems of statistical conclusion validity.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital Conservancy may be subject to additional license and use restrictions applied by the depositor.