The NTNU-YZU System in the AESW Shared Task: Automated Evaluation of Scientific Writing Using a Convolutional Neural Network

This study describes the design of the NTNU-YZU system for the automated evaluation of scientific writing shared task. We employ a convolutional neural network with the Word2Vec/GloVe embedding representation to predict whether a sentence needs language editing. For the Boolean prediction track, our best F-score of 0.6108 ranked second among the ten submissions. Our system also achieved an F-score of 0.7419 for the probabilistic estimation track, ranking fourth among the nine submissions.

[1]  Lung-Hao Lee,et al.  Overview of the NLP-TEA 2015 Shared Task for Chinese Grammatical Error Diagnosis , 2015, NLP-TEA@ACL/IJCNLP.

[2]  Raymond Hendy Susanto,et al.  The CoNLL-2014 Shared Task on Grammatical Error Correction , 2014 .

[3]  Hwee Tou Ng,et al.  How Far are We from Fully Automatic High Quality Grammatical Error Correction? , 2015, ACL.

[4]  Hsin-Hsi Chen,et al.  Linguistic rules based Chinese error detection for second language learning , 2013, ICCE 2013.

[5]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[6]  Claudia Leacock,et al.  Automated Grammatical Error Correction for Language Learners , 2010, COLING.

[7]  Hwee Tou Ng,et al.  The CoNLL-2013 Shared Task on Grammatical Error Correction , 2013, CoNLL Shared Task.

[8]  Hwee Tou Ng,et al.  System Combination for Grammatical Error Correction , 2014, EMNLP.

[9]  Martin Chodorow,et al.  Problems in Evaluating Grammatical Error Detection Systems , 2012, COLING.

[10]  Boris Katz,et al.  Contrastive Analysis with Predictive Power: Typology Driven Estimation of Grammatical Error Distributions in ESL , 2015, CoNLL.

[11]  Hwee Tou Ng,et al.  Grammatical Error Correction Using Integer Linear Programming , 2013, ACL.

[12]  Marcin Junczys-Dowmunt,et al.  Human Evaluation of Grammatical Error Correction Systems , 2015, EMNLP.

[13]  Robert Dale,et al.  HOO 2012: A Report on the Preposition and Determiner Error Correction Shared Task , 2012, BEA@NAACL-HLT.

[14]  Dan Roth,et al.  Joint Learning and Inference for Grammatical Error Correction , 2013, EMNLP.

[15]  Yuen-Hsien Tseng,et al.  A Sentence Judgment System for Grammatical Error Detection , 2014, COLING.

[16]  Chung-Hsien Wu,et al.  Error Diagnosis of Chinese Sentences Using Inductive Learning Algorithm and Decomposition-Based Testing Mechanism , 2012, TALIP.

[17]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[18]  Hwee Tou Ng,et al.  Grammatical Error Correction with Alternating Structure Optimization , 2011, ACL.

[19]  Chung-Hsien Wu,et al.  Sentence Correction Incorporating Relative Position and Parse Template Language Models , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[20]  Ted Briscoe,et al.  Towards a standard evaluation method for grammatical error detection and correction , 2015, NAACL.

[21]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[22]  Adam Kilgarriff,et al.  Helping Our Own: The HOO 2011 Pilot Shared Task , 2011, ENLG.

[23]  Hsin-Hsi Chen,et al.  Detecting Word Ordering Errors in Chinese Sentences for Learning Chinese as a Foreign Language , 2012, COLING.

[24]  Dan Roth,et al.  Correcting Grammatical Verb Errors , 2014, EACL.

[25]  Rafael E. Banchs,et al.  A Report on the Automatic Evaluation of Scientific Writing Shared Task , 2016, BEA@NAACL-HLT.

[26]  Houfeng Wang,et al.  Go Climb a Dependency Tree and Correct the Grammatical Errors , 2014, EMNLP.