Rater discrepancy in the spanish university entrance examination

Abstract

ABSTRACT. This study investigated the level of inter-rater and intra-rater reliability of thirty-two raters in the evaluation of the composition subtest of the English Test (ET) in the Spanish University Entrance Examination (SUEEIt is well established that some raters are consistently harsher in their assessment of a candidate's ability than others […] From the point of view of the candidate, it becomes a matter of luck whether they are assessed by particular raters. A candidate may draw the most lenient member of the rating team and benefit as a result or, alternatively, s/he may draw the harshest member and may suffer the consequences of this. (Wigglesworth 1993: 305).