Journal article
Psychometric Properties of Scale Scores and Performance Levels for Performance Assessments Using Polytomous IRT
Journal of educational measurement, Vol.37(2), pp.141-162
06/2000
DOI: 10.1111/j.1745-3984.2000.tb01080.x
Abstract
With a focus on performance assessments, this paper describes procedures for calculating conditional standard error of measurement (CSEM) and reliability of scale scores and classification consistency of performance levels. Scale scores that are transformations of total raw scores are the focus of these procedures, although other types of raw scores are considered as well. Polytomous IRT models provide the psychometric foundation for the procedures that are described. The procedures are applied using test data from ACT's Work Keys Writing Assessment to demonstrate their usefulness. Two polytomous IRT models were compared, as were two different procedures for calculating scores. One simulation study was done using one of the models to evaluate the accuracy of the proposed procedures. The results suggest that the procedures provide quite stable estimates and have the potential to be useful in a variety of performance assessment situations.
Details
- Title: Subtitle
- Psychometric Properties of Scale Scores and Performance Levels for Performance Assessments Using Polytomous IRT
- Creators
- Tianyou Wang - University of IowaMichael J. Kolen - University of IowaDeborah J. Harris - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of educational measurement, Vol.37(2), pp.141-162
- Publisher
- Blackwell Publishing Ltd
- DOI
- 10.1111/j.1745-3984.2000.tb01080.x
- ISSN
- 0022-0655
- eISSN
- 1745-3984
- Number of pages
- 22
- Language
- English
- Date published
- 06/2000
- Academic Unit
- Center for Advanced Studies in Measurement and Assessment; Psychological and Quantitative Foundations
- Record Identifier
- 9984627337502771
Metrics
1 Record Views