Journal article
Modification Indices for Diagnostic Classification Models
Multivariate behavioral research, Vol.58(3), pp.580-597
2023
DOI: 10.1080/00273171.2022.2049672
PMID: 35507677
Abstract
Diagnostic classification models (DCMs) are psychometric models for evaluating a student's mastery of the essential skills in a content domain based upon their responses to a set of test items. Currently, diagnostic model and/or Q-matrix misspecification is a known problem with limited avenues for remediation. To address this problem, this paper defines a one-sided score statistic that is a computationally efficient method for detecting under-specification at the item level of both the Q-matrix and the model parameters of the particular DCM chosen in an analysis. This method is analogous to the modification indices widely used in structural equation modeling. The results of a simulation study show the Type I error rate of modification indices for DCMs are acceptably close to the nominal significance level when the appropriate mixture
reference distribution is used. The simulation results indicate that modification indices are very powerful in the detection of an under-specified Q-matrix and have ample power to detect the omission of model parameters in large samples or when the items are highly discriminating. An application of modification indices for DCMs to an analysis of response data from a large-scale administration of a diagnostic test demonstrates how they can be useful in diagnostic model refinement.
Details
- Title: Subtitle
- Modification Indices for Diagnostic Classification Models
- Creators
- Christy Brown - Clemson UniversityJonathan Templin - Department of Psychological and Quantitative Foundations, University of Iowa
- Resource Type
- Journal article
- Publication Details
- Multivariate behavioral research, Vol.58(3), pp.580-597
- Publisher
- Routledge
- DOI
- 10.1080/00273171.2022.2049672
- PMID
- 35507677
- ISSN
- 0027-3171
- eISSN
- 1532-7906
- Language
- English
- Electronic publication date
- 05/04/2022
- Date published
- 2023
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9984371092002771
Metrics
5 Record Views