Yang Liping, Xin Tao, Cao Canxi
Collaborative Innovation Center of Assessment Toward Basic Education Quality, Beijing Normal University, Beijing, China.
Front Psychol. 2020 Nov 12;11:531262. doi: 10.3389/fpsyg.2020.531262. eCollection 2020.
How to effectively evaluate students' essays based on a series of relatively objective writing criteria has always been a topic of discussion. With the development of automatic essay scoring, a key question is whether the writing quality can be evaluated systematically based on the scoring rubric. To address this issue, we used an innovative set of graph-based features to predict the quality of Chinese middle school students' essays. These features are divided into four sub-dimensions: basic characteristics, main idea, essay content, and essay development. The results show that graph-based features were significantly better at predicting human essay scores than the baseline features. This indicates that graph-based features can be used to reliably and systematically evaluate the quality of an essay based on the scoring rubric, and it can be used as an alternative tool to replace or supplement human evaluation.
如何基于一系列相对客观的写作标准有效地评估学生的作文一直是一个讨论的话题。随着自动作文评分的发展，一个关键问题是能否根据评分标准系统地评估写作质量。为了解决这个问题，我们使用了一组创新的基于图的特征来预测中国中学生作文的质量。这些特征分为四个子维度：基本特征、主旨、作文内容和作文发展。结果表明，基于图的特征在预测人工作文分数方面明显优于基线特征。这表明基于图的特征可用于根据评分标准可靠且系统地评估作文质量，并且它可以用作替代工具来取代或补充人工评估。
