In validity generalization research, the estimated
mean and variance of the true validity distribution are
often used to construct a credibility interval, an interval
containing a specified proportion of the true validity
distribution. The statistical interpretation of this interval
in the literature has varied between Bayesian
and classical (frequentist) viewpoints. Credibility intervals
are here discussed from the frequentist perspective.
These are known as "tolerance intervals" in the
statistical literature. Two new methods for constructing
a credibility interval are presented. Unlike the current
method of constructing the credibility interval,
tolerance intervals have known performance characteristics
across repeated applications, justifying confidence
statements. The new methods may be useful in
validity generalization research involving a small or
moderate number of validation studies. Index
terms: Bayesian statistics, Credibility intervals, Metaanalysis,
Tolerance intervals, True validity distribution, Validity generalization.
Millsap, Roger E. (1988). Tolerance intervals: Alternatives to credibility intervals in validity generalization research. Applied Psychological Measurement, 12, 27-32. doi:10.1177/014662168801200104
Millsap, Roger E..
Tolerance intervals: Alternatives to credibility intervals in validity generalization research.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital Conservancy may be subject to additional license and use restrictions applied by the depositor.