Improving efficiency of cognitive diagnosis by using diagnostic items and adaptive testing.
2009-10
Loading...
View/Download File
Persistent link to this item
Statistics
View StatisticsJournal Title
Journal ISSN
Volume Title
Title
Improving efficiency of cognitive diagnosis by using diagnostic items and adaptive testing.
Authors
Published Date
2009-10
Publisher
Type
Thesis or Dissertation
Abstract
Diagnosing student use of problem-solving strategies (cognitive rules) is one of the major concerns of cognitive diagnostic assessment (CDA). With such information, subsequent instruction can be effectively tailored to meet individual student learning needs. For this purpose, student responses to assessment items should be interpretable in terms of cognitive rules. However, most of the current implementations of CDA still treat student responses dichotomously (correct versus incorrect), leading to substantial loss of diagnostic information. Diagnostic items are multiple choice items in which response options are explicitly associated with certain cognitive rules, and considered as a potentially useful tool for more efficient CDA. These considerations lead to the following research questions: (a) to what extent does the use of diagnostic items improve efficiency of cognitive diagnosis from treating student responses dichotomously, and (b) what characteristics of diagnostic items are more responsible for efficiency improvement than others? The present research comprised two studies and approached these questions quantitatively, using (a) a latent class model as a psychometric model for diagnostic items, (b) the number of items administered to reach a diagnosis as a measure of efficiency of cognitive diagnosis, and (c) adaptive testing simulations in which optimal items are sequentially selected for each examinee. Study 1 examined efficiency improvement using simulated responses to hypothetical diagnostic items whose characteristics were varied systematically. Study 2 examined efficiency improvement found in existing real response data on Siegler's Balance Scale Task. Both studies supported the use of diagnostic items in that they substantially improved efficiency of cognitive diagnosis, although several item characteristics had differential effects on the efficiency. Limitations to these studies included validity of the latent class model and simulation settings. Based on these limitations, future research should be directed to further understanding of student response behaviors relevant to cognitive rule usage and the corresponding extension of the current latent class model for diagnostic items.
Description
University of Minnesota Ph.D. dissertation. October 2009. Major:Educational Psychology. Advisors: William M. Bart and Ernest C. Davenport, Jr., 1 computer file (PDF); ix, 169 pages, appendices A-C.
Related to
Replaces
License
Collections
Series/Report Number
Funding information
Isbn identifier
Doi identifier
Previously Published Citation
Suggested citation
Kato, Kentaro. (2009). Improving efficiency of cognitive diagnosis by using diagnostic items and adaptive testing.. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/57169.
Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.