Book chapter
Construct Validity of Computer Scored Constructed Response Items in Undergraduate Introductory Biology Courses
Rasch Measurement, pp.223-240
Springer Singapore
2020
DOI: 10.1007/978-981-15-1800-3_12
Abstract
“Psychometrically sound” assessments possess the ability to make valid inferences of students’ conceptual understanding. However, there is a lack of validated assessments in college biology education. This study assesses the psychometric properties of the constructed response (CR) biology questions to establish construct validity and reliability. We used a polytomous Rasch Partial Credit Model to validate the eight CR items. Responses from 437 students were scored by automated scoring models that were trained on data scored by experts. All items reflected unidimensional construct of biology and local independency. The findings suggest that the instrument is a promising and valid tool to assess undergraduates’ biology concepts from introductory biology courses, but needs further revision to strengthen the psychometric properties, adding more items for low performing students and improving person reliability. The significance of this study lies in its potential to contribute to creating more valid and reliable CR assessments through Rasch calibration.
Details
- Title: Subtitle
- Construct Validity of Computer Scored Constructed Response Items in Undergraduate Introductory Biology Courses
- Creators
- Hye Sun YouKevin Haudek - Michigan State UniversityJohn Merrill - Michigan State UniversityMark Urban-Lurain - Michigan State University
- Resource Type
- Book chapter
- Publication Details
- Rasch Measurement, pp.223-240
- Publisher
- Springer Singapore; Singapore
- DOI
- 10.1007/978-981-15-1800-3_12
- Language
- English
- Date published
- 2020
- Academic Unit
- Teaching and Learning
- Record Identifier
- 9984371296102771
Metrics
3 Record Views