Evaluation of implied orders as a basis for tailored testing with simulation data

Abstract

Monte carlo research with TAILOR, a program using Implied Orders as a basis for tailored testing, is reported. Birnbaum’s (1968) three-parameter logistic model was used to generate data matrices under a variety of simulated conditions. It was found that TAILOR typically required about half the available items to estimate for each simulated examinee the responses on the remainder. Validity of Tailored score with True score was found to be within a few points of True score with Complete test score. Increasing item discrimination affected the efficiency of the tailored test, but the procedure was little affected by any of a variety of other factors.