Journal article
Assembling validity evidence for assessing academic writing: Rater reactions to integrated tasks
Assessing writing, Vol.21(1), pp.56-73
07/01/2014
DOI: 10.1016/j.asw.2014.03.002
Abstract
Integrated writing tasks that depend on input from other language abilities are gaining ground in teaching and assessment of L2 writing. Understanding how raters assign scores to integrated tasks is a necessary step for interpreting performance from this assessment method. The current study investigates how raters approach reading-to-write tasks, how they react to source use, the challenges they face, and the features influencing their scoring decisions. To address these issues, the study employed an inductive analysis of interviews and think-aloud data obtained from two raters. The results of the study showed raters attending to judgment strategies more than interpretation behaviors. In addition, the results found raters attending to a number of issues specifically related to source use: (a) locating source information, (b) citation mechanics, and (c) quality of source use. Furthermore, the analysis revealed a number of challenges faced by raters when working on integrated tasks. While raters focused on surface source use features at lower levels, they shifted their attention to more sophisticated issues at advanced levels. These results demonstrate the complex nature of integrated tasks and stress the need for writing professionals to consider the scoring and rating of these tasks carefully. (C) 2014 Elsevier Ltd. All rights reserved.
Details
- Title: Subtitle
- Assembling validity evidence for assessing academic writing: Rater reactions to integrated tasks
- Creators
- Atta Gebril - American University in CairoLia Plakans - Lia Plakans, Department of Teaching and Learning, N259 Lindquist Hall, Iowa City, IA 52242, USA
- Resource Type
- Journal article
- Publication Details
- Assessing writing, Vol.21(1), pp.56-73
- Publisher
- Elsevier
- DOI
- 10.1016/j.asw.2014.03.002
- ISSN
- 1075-2935
- eISSN
- 1873-5916
- Number of pages
- 18
- Language
- English
- Date published
- 07/01/2014
- Academic Unit
- Teaching and Learning
- Record Identifier
- 9984371120502771
Metrics
5 Record Views