Nedelsky (1954) and Angoff (1971) have suggested
procedures for establishing a cutting score
based on raters’ judgments about the likely performance
of minimally competent examinees on each
item in a test. In this paper generalizability theory
is used to characterize and quantify expected variance
in cutting scores resulting from each procedure.
Experimental test data are used to illustrate
this approach and to compare the two procedures.
Consideration is also given to the impact of rater
disagreement on some issues of measurement reliability
or dependability. Results suggest that the differences
between the Nedel sky and Angoff procedures
may be of greater consequence than their apparent
similarities. In particular, the restricted nature
of the Nedelsky (inferred) probability scale may
constitute a basis for seriously questioning the applicability
of this procedure in certain contexts.
Brennan, Robert L & Lockwood, Robert E. (1980). A comparison of the Nedelsky and Angoff cutting score procedures using generalizability theory. Applied Psychological Measurement, 4, 219-240. doi:10.1177/014662168000400209
Brennan, Robert L.; Lockwood, Robert E..
A comparison of the Nedelsky and Angoff cutting score procedures using generalizability theory.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital Conservancy may be subject to additional license and use restrictions applied by the depositor.