Journal article
IRT Approaches to Modeling Scores on Mixed-Format Tests
Journal of educational measurement, Vol.57(2), pp.230-254
06/01/2020
DOI: 10.1111/jedm.12248
Abstract
This article considers psychometric properties of composite raw scores and transformed scale scores on mixed-format tests that consist of a mixture of multiple-choice and free-response items. Test scores on several mixed-format tests are evaluated with respect to conditional and overall standard errors of measurement, score reliability, and classification consistency and accuracy under three item response theory (IRT) frameworks: unidimensional IRT (UIRT), simple structure multidimensional IRT (SS-MIRT), and bifactor multidimensional IRT (BF-MIRT) models. Illustrative examples are presented using data from three mixed-format exams with various levels of format effects. In general, the two MIRT models produced similar results, while the UIRT model resulted in consistently lower estimates of reliability and classification consistency/accuracy indices compared to the MIRT models.
Details
- Title: Subtitle
- IRT Approaches to Modeling Scores on Mixed-Format Tests
- Creators
- Won-Chan Lee - Univ Iowa, Educ Measurement & Stat, 210E Lindquist Ctr, Iowa City, IA 52242 USAStella Y. Kim - Univ North Carolina Charlotte, Educ Res Measurement & Evaluat, COED 274,9201 Univ City Blvd, Charlotte, NC 28223 USAJiwon Choi - Univ Iowa, Educ Measurement & Stat Program, 210 Lindquist Ctr, Iowa City, IA 52242 USAYujin Kang - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of educational measurement, Vol.57(2), pp.230-254
- Publisher
- Wiley
- DOI
- 10.1111/jedm.12248
- ISSN
- 0022-0655
- eISSN
- 1745-3984
- Number of pages
- 25
- Language
- English
- Date published
- 06/01/2020
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9984371278502771
Metrics
4 Record Views