Logo image
Classification Consistency and Accuracy for Complex Assessments Under the Compound Multinomial Model
Journal article   Peer reviewed

Classification Consistency and Accuracy for Complex Assessments Under the Compound Multinomial Model

Won-Chan Lee, Robert L. Brennan and Lei Wan
Applied psychological measurement, Vol.33(5), pp.374-390
07/01/2009
DOI: 10.1177/0146621608321759

View Online

Abstract

For a test that consists of dichotomously scored items, several approaches have been reported in the literature for estimating classification consistency and accuracy indices based on a single administration of a test. Classification consistency and accuracy have not been studied much, however, for ``complex'' assessments—for example, those that involve polytomously scored items or mixtures of different types of items. This article describes procedures for estimating various types of single-administration classification consistency and accuracy indices using the multinomial and compound multinomial models for individuals and groups who take a single administration of a complex assessment. An alternative procedure using the bootstrap is also proposed. These procedures are illustrated using real data sets obtained from tests consisting of both polytomous and dichotomous items.

Details

Logo image