2 |
Toward Automated Multi-trait Scoring of Essays: Investigating Links among Holistic, Analytic, and Text Feature Scores
|
|
|
|
Abstract:
The main purpose of the study was to investigate the distinctness and reliability of analytic (or multi-trait) rating dimensions and their relationships to holistic scores and e-rater ® essay feature variables in the context of the TOEFL® computer-based test (TOEFL CBT) writing assessment. Data analyzed in the study were holistic and multi-trait essay scores provided by human raters and essay feature variable scores computed by e-rater ® (version 2.0) for two TOEFL CBT writing prompts. It was found that (i) all of the six multi-trait scores were not only correlated among themselves but also correlated with the holistic score, (ii) high correlations obtained among holistic and multi-trait scores were largely attributable to the impact of essay length on both holistic and multi-trait scoring, and (iii) some strong associations were confirmed between several e-rater variables and multi-trait rating dimensions. Implications are discussed for improving the multi-trait scoring of essays, refining e-rater essay feature variables, and validating automated essay scores.
|
|
Keyword:
Articles
|
|
URL: https://doi.org/10.1093/applin/amp040 http://applij.oxfordjournals.org/cgi/content/short/31/3/391
|
|
BASE
|
|
Hide details
|
|
3 |
Toward Automated Multi-trait Scoring of Essays: Investigating Links among Holistic, Analytic, and Text Feature Scores
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Differences in Written Discourse in Independent and Integrated Prototype Tasks for Next Generation TOEFL
|
|
|
|
BASE
|
|
Show details
|
|
|
|