Shallow Semantic Analysis of Interactive Learner Sentences

Focusing on applications for analyzing learner language which evaluate semantic appropriateness and accuracy, we collect data from a task which models some aspects of interaction, namely a picture description task (PDT). We parse responses to the PDT into dependency graphs with an an off-the-shelf parser, then use a decision tree to classify sentences into syntactic types and extract the logical subject, verb, and object, finding 92% accuracy in such extraction. The specific goal in this paper is to examine the challenges involved in extracting these simple semantic representations from interactive learner sentences.

[1]  K. Forbes-McKay,et al.  Detecting subtle spontaneous language decline in early Alzheimer’s disease with a picture description task , 2005, Neurological Sciences.

[2]  Mª Del Pilar Agustín Llach,et al.  Lexical gap-filling mechanisms in foreign language writing , 2010 .

[3]  Na-Rae Han,et al.  Detection of Grammatical Errors Involving Prepositions , 2007, ACL 2007.

[4]  Christopher D. Manning,et al.  Generating Typed Dependency Parses from Phrase Structure Parses , 2006, LREC.

[5]  Christopher D. Manning,et al.  Stanford typed dependencies manual , 2010 .

[6]  Noah A. Smith,et al.  Dependency Parsing , 2009, Encyclopedia of Artificial Intelligence.

[7]  R. Ellis Current Issues in the Teaching of Grammar: An SLA Perspective , 2006 .

[8]  Eneko Agirre,et al.  SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity , 2012, *SEMEVAL.

[9]  Trude Heift,et al.  Heift Trude Schulze Mathias. Errors and Intelligence in Computer-Assisted Language Learning: Parsers and Pedagogues Routledge (Routledge series in computer-assisted language learning), 2007. xviii+283 Pages. ISBN: 978-0-415-36191-0. Price: $115 , 2009, ReCALL.

[10]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[11]  C. Chapelle,et al.  Natural Language Processing and Language Learning , 2012 .

[12]  R. Ellis Task-based research and language pedagogy , 2000 .

[13]  Walt Detmar Meurers,et al.  Evaluating the Meaning of Answers to Reading Comprehension Questions: A Semantics-Based Approach , 2012, BEA@NAACL-HLT.

[14]  Walt Detmar Meurers,et al.  On using intelligent computer-assisted language learning in real-life foreign language teaching and learning , 2011, ReCALL.

[15]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[16]  M. Celce-Murcia Grammar Pedagogy in Second and Foreign Language Teaching. , 1991 .

[17]  Patricia Lunn,et al.  On Teaching Grammar , 2010 .

[18]  Michael Collins,et al.  Head-Driven Statistical Models for Natural Language Parsing , 2003, CL.

[19]  Kenneth A. Petersen,et al.  Implicit corrective feedback in computer-guided interaction : does mode matter? , 2010 .

[20]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[21]  Walt Detmar Meurers,et al.  Analyzing Learner Language : Towards A Flexible NLP Architecture for Intelligent Language Tutors , 2010 .

[22]  Robert Dale,et al.  HOO 2012: A Report on the Preposition and Determiner Error Correction Shared Task , 2012, BEA@NAACL-HLT.

[23]  Detmar Meurers,et al.  Integrating parallel analysis modules to evaluate the meaning of answers to reading comprehension questions , 2011 .

[24]  William B. Dolan,et al.  Collecting Highly Parallel Data for Paraphrase Evaluation , 2011, ACL.

[25]  Martin Chodorow,et al.  C-rater: Automated Scoring of Short-Answer Questions , 2003, Comput. Humanit..

[26]  Z. Dörnyei,et al.  Do Language Learners Recognize Pragmatic Violations? Pragmatic Versus Grammatical Awareness in Instructed L2 Learning. , 1998 .

[27]  Trude Heift,et al.  Web Delivery of Adaptive and Interactive Language Tutoring: Revisited , 2016, International Journal of Artificial Intelligence in Education.