Journal article
The effectiveness and efficiency of distributed online, regional online, and regional face-to-face training for writing assessment raters
The Journal of Technology, Learning and Assessment (Boston College), Vol.10(1), pp.1-22
2010
Abstract
This study examined the influence of rater training and scoring context on training time, scoring time, qualifying rate, quality of ratings, and rater perceptions. One hundred twenty raters participated in the study and experienced one of three training contexts: (a) online training in a distributed scoring context, (b) online training in a regional scoring context, and (c) stand-up training in a regional context. After training, raters assigned scores to qualification sets, scored 400 student essays, and responded to a questionnaire that measured their perceptions of the effectiveness of, and satisfaction with, the training and scoring process, materials, and staff. The results suggest that the only clear difference on the outcomes for these three groups of raters concerned training time--online training was considerably faster. There were no clear differences between groups concerning qualification rate, rating quality, or rater perceptions.
Details
- Title: Subtitle
- The effectiveness and efficiency of distributed online, regional online, and regional face-to-face training for writing assessment raters
- Creators
- Edward W. Wolfe - Pearson, United StatesStaci Matthews - Pearson, United StatesDaisy Vickers - Pearson, United States
- Resource Type
- Journal article
- Publication Details
- The Journal of Technology, Learning and Assessment (Boston College), Vol.10(1), pp.1-22
- ISSN
- 1540-2525
- Language
- English
- Date published
- 2010
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9985123700202771
Metrics
1 Record Views