A method of automatically selecting items for
inclusion in a test that has constraints on item
content and statistical properties was applied to
real data. Two tests were assembled by test
specialists who assemble such tests on a routine
basis. Using the same pool of items and the same
constraints, the two tests were reassembled automatically.
Test specialists not involved in the original
manual assembly compared the tests constructed
manually to the tests constructed automatically. The
results indicated that the progress of automated test
assembly methods lies in improving item banking
systems, classification schemes, and quality control
measures, rather than in the development of different
algorithms or in the improvement of computer time
and cost. Index terms: heuristic algorithms, mathematical
programming, test assembly, test construction,
Stocking, Martha L, Swanson, Len & Pearlman, Mari. (1993). Application of an automated item selection method to real data. Applied Psychological Measurement, 17, 167-176. doi:10.1177/014662169301700206
Stocking, Martha L.; Swanson, Len; Pearlman, Mari.
Application of an automated item selection method to real data.
Retrieved from the University of Minnesota Digital Conservancy,
Content distributed via the University of Minnesota's Digital Conservancy may be subject to additional license and use restrictions applied by the depositor.