User Input and Interactions on Microsoft Research ESL Assistant

ESL Assistant is a prototype web-based writing-assistance tool that is being developed for English Language Learners. The system focuses on types of errors that are typically made by non-native writers of American English. A freely-available prototype was deployed in June 2008. User data from this system are manually evaluated to identify writing domain and measure system accuracy. Combining the user log data with the evaluated rewrite suggestions enables us to determine how effectively English language learners are using the system, across rule types and across writing domains. We find that repeat users typically make informed choices and can distinguish correct suggestions from incorrect.

[1]  Kevin Knight,et al.  Automated Postediting of Documents , 1994, AAAI.

[2]  Na-Rae Han,et al.  Detecting Errors in English Article Usage with a Maximum Entropy Classifier Trained on a Large, Diverse Corpus , 2004, LREC.

[3]  Francis Bond,et al.  Memory-Based Learning for Article Generation , 2000, CoNLL/LLL.

[4]  Hitoshi Isahara,et al.  Automatic Error Detection in the Japanese Learners’ English Spoken Data , 2003, ACL.

[5]  Eugene Charniak,et al.  Language Modeling for Determiner Selection , 2007, NAACL.

[6]  Masaki Murata,et al.  Determination of referential property and number of nouns in Japanese sentences for machine translation into English , 1994, ArXiv.

[7]  Martin Chodorow,et al.  The Ups and Downs of Preposition Error Detection in ESL Writing , 2008, COLING.

[8]  John Lee,et al.  Automatic Article Restoration , 2004, NAACL.

[9]  Jianfeng Gao,et al.  Using Contextual Speller Techniques and Language Modeling for ESL Error Correction , 2008, IJCNLP.

[10]  Martin Chodorow,et al.  Native Judgments of Non-Native Usage: Experiments in Preposition Error Detection , 2008, COLING 2008.

[11]  Fumito Masui,et al.  Detecting Article Errors Based on the Mass Count Distinction , 2005, IJCNLP.

[12]  Na-Rae Han,et al.  Detection of Grammatical Errors Involving Prepositions , 2007, ACL 2007.

[13]  Stephen G. Pulman,et al.  Automatically Acquiring Models of Preposition Use , 2007, ACL 2007.

[14]  Kentaro Ogura,et al.  Countability and Number in Japanese to English Machine Translation , 1994, COLING.

[15]  Jens Eeg-Olofsson,et al.  Automatic Grammar Checking for Second Language Learners – the Use of Prepositions , 2003 .

[16]  Na-Rae Han,et al.  Detecting errors in English article usage by non-native speakers , 2006, Natural Language Engineering.

[17]  Joel R. Tetreault,et al.  The utility of article and preposition error correction systems for English language learners: Feedback and assessment , 2010 .

[18]  Naoki Isu,et al.  A Feedback-Augmented Method for Detecting Errors in the Writing of Learners of English , 2006, ACL.

[19]  Julia E. Heine.  Definiteness Predictions for Japanese Noun Phrases , 1998, COLING-ACL.

[20]  Stephanie Seneff,et al.  Correcting Misuse of Verb Forms , 2008, ACL.