Automatic Chinese Short Answer Grading with Deep Autoencoder

Short answer question is a common assessment type of teaching and learning. Automatic short answer grading is the task of automatically scoring short natural language responses. Most previous auto-graders mainly rely on target answers given by teachers. However, target answers are not always available. In this paper, a deep autoencoder based algorithm for automatic short answer grading is presented. The proposed algorithm can be built without expressly defining target answers, and learn the lower-dimensional representation of student responses. For the sake of reducing the influence of data imbalance, we introduce the expectation regularization term of label ratio into the model. The experimental results demonstrate the effectiveness of our proposed method.

[1]  Nitin Madnani,et al.  Automated Scoring of a Summary-Writing Task Designed to Measure Reading Comprehension , 2013, BEA@NAACL-HLT.

[2]  Kyong Hee Chon,et al.  Multivariate generalizability analysis of automated scoring for short answer items of social studies in large-scale assessment , 2017 .

[3]  Alexander F. Gelbukh,et al.  SOFTCARDINALITY: Hierarchical Text Overlap for Student Response Analysis , 2013, *SEMEVAL.

[4]  Benno Stein,et al.  The Eras and Trends of Automatic Short Answer Grading , 2015, International Journal of Artificial Intelligence in Education.

[5]  Li Chen,et al.  Automatic Assessment of Students' Free-Text Answers with Support Vector Machines , 2010, IEA/AIE.

[6]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[7]  Walt Detmar Meurers Diagnosing Meaning Errors in Short Answers to Reading Comprehension Questions , 2008 .

[8]  Libby Gerard,et al.  Validation of Automated Scoring of Science Assessments. , 2016 .

[9]  Chris Brew,et al.  Towards Effective Tutorial Feedback for Explanation Questions: A Dataset and Baselines , 2012, HLT-NAACL.

[10]  Omer Levy,et al.  UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis , 2013, *SEMEVAL.

[11]  Yuan Zhang,et al.  Deep Learning + Student Modeling + Clustering: a Recipe for Effective Automatic Short Answer Grading , 2016, EDM.

[12]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[13]  Xi Yang,et al.  Can Short Answers to Open Response Questions Be Auto-Graded Without a Grading Rubric? , 2017, AIED.

[14]  Fuzhen Zhuang,et al.  Supervised Representation Learning: Transfer Learning with Deep Autoencoders , 2015, IJCAI.