Assisting tool for essay grading for Turkish language instructors

When learning languages, writing an essay is one of the main methods for assessing students’ knowledge. However, with the development of ICT, language learning is also being transferred to online platforms. At the same time, as the number of students’ increases, the problem of evaluating students’ essays arises. In this paper, we offer an automated system that facilitates instructors while evaluating students’ essays. Currently, the system works for essays written in Turkish. The system was built using the Zemberek library. It allows one to extract text features the essay of several people at the same time on several indicators, namely, morphological analysis, vocabulary, the use of different language structures, etc. Currently, many automated essay grading tools are proposed, and one of the main factors that defined their accuracy it the extraction of text features. Thus, as further work, it is planned to use the data obtained using this essay assessment system together with instructors’ evaluation to create an expert system for automatic essay evaluation using machine learning techniques.

[1]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[2]  William Wresch,et al.  The Imminence of Grading Essays by Computer-25 Years Later , 1993 .

[3]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[4]  Nizar Habash,et al.  Introduction to Arabic Natural Language Processing , 2010, Introduction to Arabic Natural Language Processing.

[5]  Schraudner Michael,et al.  The Online Teacher's Assistant : Using Automated Correction Programs to Supplement Learning and Lesson Planning , 2014 .

[6]  Timothy Z. Keith,et al.  Computer Analysis of Student Essays: Finding Trait Differences in Student Profile , 1997 .

[7]  Hwee Tou Ng,et al.  A Neural Approach to Automated Essay Scoring , 2016, EMNLP.

[8]  Laila Khreisat,et al.  A machine learning approach for Arabic text classification using N-gram frequency statistics , 2009, J. Informetrics.

[9]  Martin Chodorow,et al.  CriterionSM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays , 2003, IAAI.

[10]  Thorsten Brants,et al.  Large Language Models in Machine Translation , 2007, EMNLP.

[11]  W. B. Cavnar,et al.  N-gram-based text categorization , 1994 .

[12]  Suresh Venkatasubramanian,et al.  Sketching Techniques for Large Scale NLP , 2010, WAC@NAACL-HLT.

[13]  Philipp Koehn,et al.  Moses: Open Source Toolkit for Statistical Machine Translation , 2007, ACL.

[14]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[15]  T. Keith,et al.  Trait Ratings for Automated Essay Grading , 2002 .

[16]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[17]  Alexandru Ceausu,et al.  South-East European Times : A parallel corpus of Balkan languages , Francis Tyers and , 2010 .

[18]  Sampo Pyysalo,et al.  brat: a Web-based Tool for NLP-Assisted Text Annotation , 2012, EACL.

[19]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[20]  R. Ewijk,et al.  Same Work, Lower Grade? Student Ethnicity and Teachers' Subjective Assessments , 2010 .

[21]  Kaja Zupanc,et al.  Automated essay evaluation with semantic analysis , 2017, Knowl. Based Syst..

[22]  E. B. Page.  Computer Grading of Student Prose, Using Modern Concepts and Software , 1994 .