Journal article
Measuring the Reliability of Diagnostic Classification Model Examinee Estimates
Journal of Classification, Vol.30(2), pp.251-275
07/2013
DOI: 10.1007/s00357-013-9129-4
Abstract
Over the past decade, diagnostic classification models (DCMs) have become an active area of psychometric research. Despite their use, the reliability of examinee estimates in DCM applications has seldom been reported. In this paper, a reliability measure for the categorical latent variables of DCMs is defined. Using theory-and simulation-based results, we show how DCMs uniformly provide greater examinee estimate reliability than IRT models for tests of the same length, a result that is a consequence of the smaller range of latent variable values examinee estimates can take in DCMs. We demonstrate this result by comparing DCM and IRT reliability for a series of models estimated with data from an end-of-grade test, culminating with a discussion of how DCMs can be used to change the character of large scale testing, either by shortening tests that measure examinees unidimensionally or by providing more reliable multidimensional measurement for tests of the same length.
Details
- Title: Subtitle
- Measuring the Reliability of Diagnostic Classification Model Examinee Estimates
- Creators
- Jonathan Templin - Department of Educational Psychology The University of Georgia 323 Aderhold Hall Athens GA 30602 USALaine Bradshaw - Department of Educational Psychology The University of Georgia 323 Aderhold Hall Athens GA 30602 USA
- Contributors
- Carolyn Anderson (Editor)Jeff Douglas (Editor)
- Resource Type
- Journal article
- Publication Details
- Journal of Classification, Vol.30(2), pp.251-275
- Publisher
- Springer US; Boston
- DOI
- 10.1007/s00357-013-9129-4
- ISSN
- 0176-4268
- eISSN
- 1432-1343
- Language
- English
- Date published
- 07/2013
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9983993493602771
Metrics
31 Record Views