The effect of guessing on item reliability under answer-until-correct scoring

Loading...
Thumbnail Image

View/Download File

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

The effect of guessing on item reliability under answer-until-correct scoring

Published Date

1978

Publisher

Type

Article

Abstract

The answer-until-correct (AUC) procedure requires that examinees respond to a multiple-choice item until they answer it correctly. The examinee’s score on the item is then based on the number of responses required for the item. It was expected that the additional responses obtained under the AUC procedure would improve reliability by providing additional information on those examinees who fail to choose the correct alternative on their first attempt. However, when compared to the zero-one (ZO) scoring procedure, the AUC procedure has failed to yield consistent improvements in reliability. Using a modified version of Horst’s model for examinee behavior, this paper compares the effect of guessing on item reliability for the AUC procedure and the ZO procedure. The analysis shows that the relative efficiency of the two procedures depends strongly on the nature of the item alternatives and implies that the appropriate criteria for item selection are different for each procedure. Conflicting results reported for empirical comparisons of the reliabilities of the two procedures may result from a failure to control for the characteristics of the items.

Keywords

Description

Related to

Replaces

License

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Kane, Michael & Moloney, James. (1978). The effect of guessing on item reliability under answer-until-correct scoring. Applied Psychological Measurement, 2, 41-49. doi:10.1177/014662167800200104

Suggested citation

Kane, Michael T.; Moloney, James. (1978). The effect of guessing on item reliability under answer-until-correct scoring. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/99065.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.