Journal article
The Influence of Changes in Assessment Design on the Psychometric Quality of Scores
Applied measurement in education, Vol.14(1), pp.91-107
2001
DOI: 10.1207/S15324818AME1401_07
Abstract
In this article, we address the problem of improving the measurement quality of a complex performance assessment through principled assessment design. We describe the characteristics and measurement impact of steps taken to improve assessment exercise design along with modifications in assessor training materials and procedures between the 1995-1996 and the 1996-1997 administrations of the National Board for Professional Teaching Standards Early Childhood/Generalist examination. Specifically, we describe how the revision of this assessment contributed to increases in the interassessor agreement, internal consistency, and generalizability of scores. All indexes we examined improved after the revisions. The results suggest that previously observed limits on the measurement quality of performance assessments due to the relatively small number of items that contribute to an assessment score may be altered significantly through attention to assessment design and related scoring processes.
Details
- Title: Subtitle
- The Influence of Changes in Assessment Design on the Psychometric Quality of Scores
- Creators
- Edward W. Wolfe - Michigan State UniversityDrew H. Gitomer - ETS, United States
- Resource Type
- Journal article
- Publication Details
- Applied measurement in education, Vol.14(1), pp.91-107
- DOI
- 10.1207/S15324818AME1401_07
- ISSN
- 0895-7347
- eISSN
- 1532-4818
- Number of pages
- 17
- Language
- English
- Date published
- 2001
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9985123697602771
Metrics
1 Record Views