Machine Learning Techniques to Automate Scoring of Constructed-Response Type Assessments

Automated grading tools help instructors tremendously. One challenge that needs to be addressed in constructed-response type assessments is automatic recognition of answers that are equivalent to the specimen answers but are written with different words/formats. This paper proposes schemes that use natural language processing and machine learning techniques to automatically grade short answer type assessments. The schemes compare students' answers with specimen answers according to their semantics instead of the words in the answers. Experiments show that the proposed schemes can achieve high level accuracy while grading assessments.

[1]  Sathiamoorthy Manoharan,et al.  A Framework for Automated Assignment Generation and Marking for Plagiarism Mitigation , 2017, 2017 27th EAEEIE Annual Conference (EAEEIE).

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Yoshua Bengio,et al.  On Using Very Large Target Vocabulary for Neural Machine Translation , 2014, ACL.

[4]  Donald D. Carpenter,et al.  Engineering Students' Perceptions of and Attitudes Towards Cheating , 2006 .

[5]  Quoc V. Le,et al.  Massive Exploration of Neural Machine Translation Architectures , 2017, EMNLP.

[6]  Christopher D. Manning,et al.  Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks , 2015, ACL.

[7]  Sathiamoorthy Manoharan,et al.  Personalized Assessment as a Means to Mitigate Plagiarism , 2017, IEEE Transactions on Education.

[8]  Melissa A. Broeckelman-Post.  Faculty and Student Classroom Influences on Academic Dishonesty , 2008, IEEE Transactions on Education.

[9]  Wojciech Zaremba,et al.  Learning to Execute , 2014, ArXiv.

[10]  Kevin Gimpel,et al.  Towards Universal Paraphrastic Sentence Embeddings , 2015, ICLR.

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Justin Zobel.  Uni Cheats Racket: A Case Study in Plagiarism Investigation , 2004, ACE.

[13]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[14]  Quoc V. Le,et al.  Addressing the Rare Word Problem in Neural Machine Translation , 2014, ACL.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Vysoké Učení,et al.  Statistical Language Models Based on Neural Networks , 2012 .

[17]  Sanjeev Arora,et al.  A Simple but Tough-to-Beat Baseline for Sentence Embeddings , 2017, ICLR.

[18]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[19]  Roberta M. Berry,et al.  Cheating lessons : learning from academic dishonesty , 2013 .