An Automated Scoring Tool for Korean Supply-type Items Based on Semi-Supervised Learning

Abstract

Scoring short-answer questions has disadvantages that may take long time to grade and may be an issue on consistency in scoring. To alleviate the disadvantages, automated scoring systems are widely used in America or Europe, but, in Korea, there has been researches regarding the automated scoring. In this paper, we propose an automated scoring tool for Korean short-answer questions using a semisupervised learning method. The answers of students are analyzed and processed through natural language processing and unmarked-answers are automatically scored by machine learning methods. Then scored answers with high reliability are added in the training corpus iteratively and incrementally. Through the pilot experiment, the proposed system is evaluated for Korean and social subjects in Programme for National Student Assessment. We have showed that the processing time and the consistency of grades are promisingly improved. Using the proposed tool, various assessment methods have got to be development before applying to school test fields.

A Comprehensive Review of Automated Essay Scoring (AES) Research and Development

“…Next, the essays are processed to retain significant features in the Feature Selection process. Typical features in MLF were words (Cheon et al, 2015), syntactic and dependency features. Feature selection is an important step in many machine…”

“…In interpreting any kappa value, K can be considered as poor when lower than 0.4, fair to good when K between 0.4 and 0.75, and excellent when K is greater than 0.75. To interpret Pearson's correlation, r can be considered as very small when r lower than 0.2, small when r between 0.2 and 0.4, medium when r between 0.4 and 0.6, large when r between 0.6 and 0.8, and very large when r greater than 0.8 (Cheon et al, 2015). Theses evaluation methods are suitable for evaluating the multiclass classification model since it calculates a confusion matrix between the predicted and actual values.…”