DSpace DSpace

University of Minnesota Digital Conservancy >
University of Minnesota - Twin Cities >
Applied Psychological Measurement >
Volume 08, 1984 >

Please use this identifier to cite or link to this item: http://hdl.handle.net/11299/107561

Title: Bias and information of Bayesian adaptive testing
Authors: Weiss, David J.
McBride, James R.
Issue Date: 1984
Citation: Weiss, David J & McBride, James R. (1984). Bias and information of Bayesian adaptive testing. Applied Psychological Measurement, 8, 273-285. doi:10.1177/014662168400800303
Abstract: Monte carlo simulation was used to investigate score bias and information characteristics of Owen’s Bayesian adaptive testing strategy and to examine possible causes of score bias. Factors investigated in three related studies included effects of an accurate prior θ estimate, effects of item discrimination, and effects of fixed versus variable test length. Data were generated from a three-parameter logistic model for 3,100 simulees in each of eight data sets, and Bayesian adaptive tests were administered, drawing items from a "perfect" item pool. Results showed that the Bayesian adaptive test yielded unbiased θ estimates and relatively flat information functions only in the situation in which an accurate prior θ estimate was used. When a constant prior θ estimate was used with a fixed test length, severe bias was observed that varied with item discrimination. A different pattern of bias was observed with variable test length and a constant prior. Information curves for the constant prior conditions generally became more peaked and asymmetric with increasing item discrimination. In the variable test length condition, the test length required to achieve a specified level of the posterior variance of θ estimates was an increasing function of θ level. These results indicate that θ estimates from Owen’s Bayesian adaptive testing method are affected by the prior θ estimate used and that the method does not provide measurements that are unbiased and equiprecise except when an accurate prior θ estimate is used.
URI: http://purl.umn.edu/107561
Appears in Collections:Volume 08, 1984

Files in This Item:

File Description SizeFormat
v08n3p273.pdf829.07 kBPDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.