Based on recently published papers, it might be
tempting to routinely apply the beta-binomial
model to obtain a single administration estimate of
the reliability of a mastery test. Using real data, the
paper illustrates two practical problems with estimating
reliability in this manner. The first is that
the model might give a poor fit to data, which can
seriously affect the reliability estimate, and the second
is that inadmissible estimates of the parameters
in the beta-binomial model might be obtained.
Two possible solutions are described and illustrated.
Wilcox, Rand R..
A Cautionary Note on Estimating the Reliability of a Mastery Test with the Beta-Binomial Model.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital
Conservancy may be subject to additional license and use
restrictions applied by the depositor.