1 |
The effect of raters fatigue on scoring EFL writing tasks
|
|
|
|
In: Indonesian Journal of Applied Linguistics, Vol 10, Iss 1, Pp 1-13 (2020) (2020)
|
|
Abstract:
Given the importance of testing, in general, and scoring writing tasks in particular, the negative effect of fatigue on human raters is important to investigate. This study aimed to (1) explore the relationship between fatigue and scoring composition tasks written by upper-intermediate EFL learners; and (2) to investigate the discrepancy of the frequency of comments among EFL raters while scoring composition tasks. Four raters were selected, and each given 28 composition tasks to score and comment on. The data were analyzed through SPSS software by running ANOVA, Pearson correlation coefficient, and post-hoc tests. Results suggested that the scores assigned to the first 16 tasks were significantly lower than those assigned to the last 12 tasks and that the last four tasks were scored highest. Based on the results obtained from the questionnaire, the observed diversity is argued to be rooted in raters’ fatigue and result in test bias. Furthermore, findings indicated that the frequency of comments given by the raters on the first 12 essays was significantly higher than those on the last 16 essays (the highest and the lowest frequency of comments were observed in the first four, and the last four scored essays, respectively).
|
|
Keyword:
assessing writing; efl writing; fatigue; Language. Linguistic theory. Comparative grammar; LC8-6691; P101-410; rater consistency; reliability; scoring composition tasks; Special aspects of education
|
|
URL: https://doi.org/10.17509/ijal.v10i1.24956 https://doaj.org/article/de5af3d61a6244949a399685de699d1e
|
|
BASE
|
|
Hide details
|
|
2 |
RATERS’ FATIGUE AND THEIR COMMENTS DURING SCORING WRITING ESSAYS: A CASE OF IRANIAN EFL LEARNERS
|
|
|
|
In: Indonesian Journal of Applied Linguistics, Vol 7, Iss 2, Pp 302-314 (2017) (2017)
|
|
BASE
|
|
Show details
|
|
|
|