Logo image
Back
Differentiation of Illusory and True Halo in Writing Scores
Journal article   Open access   Peer reviewed

Differentiation of Illusory and True Halo in Writing Scores

Emily R. Lai, Edward W. Wolfe and Daisy Vickers
Educational and psychological measurement, Vol.75(1), pp.102-125
02/01/2015
DOI: 10.1177/0013164414530990
PMCID: PMC5965510
PMID: 29795814
url
https://www.ncbi.nlm.nih.gov/pmc/articles/5965510View
Open Access

Abstract

This report summarizes an empirical study that addresses two related topics within the context of writing assessmentillusory halo and how much unique information is provided by multiple analytic scores. Specifically, we address the issue of whether unique information is provided by analytic scores assigned to student writing, beyond what is depicted by holistic scores, and to what degree multiple analytic scores assigned by a single rater display evidence of illusory halo. To that end, we analyze student responses to an expository writing prompt that were scored by six groups of ratersfour groups assigned single analytic scores, one group assigned multiple analytic scores, and one group assigned holistic scoresusing structural equation modeling. Our results suggest that there is evidence of illusory halo when raters assign multiple analytic scores to a single student response and that, at best, only two factors seem to be distinguishable in analytic writing scores assigned to expository essays.
 Mathematics Mathematics, Interdisciplinary Applications Physical Sciences Psychology Psychology, Educational Psychology, Mathematical Science & Technology Social Sciences

Details

Metrics

2 Record Views
Logo image