Intelligent Sentence Writing Tutor: A System Development Cycle

This article focuses on the use of natural language processing NLP to facilitate second language learning within the context of academic English. It describes a full cycle of educational software development, from needs analysis to software testing. Two studies are included: 1 the needs analysis conducted to develop the Intelligent Sentence Writing Tutor ISWT which diagnoses and at request corrects second language errors in writing, and 2 the summative evaluation of ISWT. The former comprises a survey of learning styles and learner corpus analysis which have both fed into the development of ISWT. The latter is addressed in a quantitative study with elements of both within-sample and comparison design. Due to the interdisciplinary nature of the examined phenomenon, the paper establishes links to previous and concurrent research in the fields of second language acquisition and ICALL intelligent computer assisted language learning, while relying on a variety of theories and approaches to address a specific educational problem. The comprehensive coverage of the development process takes precedence over the fine detail of individual development stages.

[1]  Trude Heift,et al.  Learner responses to corrective feedback for spelling errors in CALL , 2008 .

[2]  Stephanie Seneff,et al.  Spoken Dialogue Systems , 2008 .

[3]  David M. Magerman,et al.  Efficiency, Robustness and Accuracy in Picky Chart Parsing , 1992, ACL.

[4]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[5]  Uschi Felix,et al.  The unreasonable effectivness of CALL: What have we learned in two decades of research? , 2008, ReCALL.

[6]  Sylviane Granger,et al.  Error-tagged learner corpora and CALL: a promising synergy , 2003 .

[7]  Sharon Myers,et al.  Teaching Writing as a Process and Teaching Sentence-Level Syntax: Reformulation as ESL Composition Feedback. , 1997 .

[8]  Catherine Doughty,et al.  Focus on Form in Classroom Second Language Acquisition. The Cambridge Applied Linguistics Series. , 1998 .

[9]  Marta Benítez Fernández-Espartero.  The use of blogs as international feedback in the efl clasroom: a way to focus on form through conscious reflection , 2011 .

[10]  何高大,et al.  人工智能在外语教学中的应用——谦评《Artificial Intelligence in Second Language Learning： Raising Error Awareness》 , 2008 .

[11]  Masoud Yazdani,et al.  Intelligent Tutoring Systems for Foreign Language Learning , 1992, NATO ASI Series.

[12]  Wolfgang Menzel,et al.  Error Diagnosis for Language Learning Systems , 1999 .

[13]  John Clanchy,et al.  Study abroad : a manual for Asian students , 1984 .

[14]  R. Barnard.  Cognition and Second Language Instruction , 2003 .

[15]  Elena Tognini-Bonelli,et al.  Corpus Linguistics at Work , 2002, Computational Linguistics.

[16]  Michael H. Long.  The Role of the Linguistic Environment in Second Language Acquisition , 1996 .

[17]  Rod Ellis,et al.  Analysing Learner Language , 2005 .

[18]  Rod Ellis,et al.  SLA Research and Language Teaching , 1997 .

[19]  Kenneth A. Petersen,et al.  Implicit corrective feedback in computer-guided interaction : does mode matter? , 2010 .

[20]  Anthony Bruton,et al.  Process Writing and Communicative-Task-Based Instruction: Many Common Features, but More Common Limitations? , 2005 .

[21]  Ilona Leki,et al.  "Completely Different Worlds": EAP and the Writing Experiences of ESL Students in University Courses , 1997 .

[22]  Antonija Mitrovic,et al.  Towards Individualized Dialogue Support for Ill-Defined Domains , 2009, Int. J. Artif. Intell. Educ..

[23]  C. Chapelle,et al.  Natural Language Processing and Language Learning , 2012 .

[24]  G. Hu.  Developing an EAP Writing Course for Chinese ESL Students , 2007 .

[25]  Dawn Amsberry,et al.  Deconstructing Plagiarism: International Students and Textual Borrowing Practices , 2009 .

[26]  Jean Chandler,et al.  THE EFFICACY OF VARIOUS KINDS OF ERROR FEEDBACK FOR IMPROVEMENT IN THE ACCURACY AND FLUENCY OF L2 STUDENT WRITING , 2003 .

[27]  Íde O'Sullivan,et al.  Enhancing a process-oriented approach to literacy and language learning: The role of corpus consultation literacy , 2007, ReCALL.

[28]  James Dean Brown,et al.  The Elements of Language Curriculum: A Systematic Approach to Program Development , 1994 .

[29]  V. Ramanathan,et al.  CRITICAL LITERACIES AND LANGUAGE EDUCATION: GLOBAL AND LOCAL PERSPECTIVES , 2005, Annual Review of Applied Linguistics.

[30]  Sunny Hyon,et al.  Text, role, and context: Developing academic literacies , 1998 .

[31]  Ivo Düntsch,et al.  The IsoMetrics usability inventory: An operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems , 1999, Behav. Inf. Technol..

[32]  Detmar Meurers,et al.  Creation and Analysis of a Reading Comprehension Exercise Corpus : Towards Evaluating Meaning in Context , 2012 .

[33]  Morris L. Bigge.  Learning theories for teachers , 1964 .

[34]  Rodolfo Delmonte.  Linguistic Knowledge and Reasoning for Error Diagnosis and Feedback Generation , 2003 .

[35]  Paul Kei Matsuda,et al.  Notes Toward a Theory of Second Language Writing: William Grabe , 2012 .

[36]  P. Lightbown,et al.  Instruction and the Development of Questions in L2 Classrooms , 1993, Studies in Second Language Acquisition.

[37]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[38]  John Bitchener,et al.  The Effect of Different Types of Corrective Feedback on ESL Student Writing. , 2005 .

[39]  Michael Tomasello,et al.  Feedback for Language Transfer Errors , 1989, Studies in Second Language Acquisition.

[40]  A. Cohen,et al.  Second Language Writing: Feedback on compositions: teacher and student verbal reports , 1990 .

[41]  C. A. Moore,et al.  FIELD‐DEPENDENT AND FIELD‐INDEPENDENT COGNITIVE STYLES AND THEIR EDUCATIONAL IMPLICATIONS , 1975 .

[42]  Marina Dodigovic,et al.  Artificial Intelligence in Second Language Learning: Raising Error Awareness , 2005 .

[43]  V. Melissa Holland,et al.  Parsers in Tutors: What Are They Good For?. , 2013 .

[44]  R. Lyster,et al.  Patterns of Corrective Feedback and Uptake in an Adult ESL Classroom , 2002 .

[45]  J. Truscott.  EVIDENCE AND CONJECTURE ON THE EFFECTS OF CORRECTION: A RESPONSE TO CHANDLER , 2004 .

[46]  Erik Smitterberg.  Computer Learner Corpora, Second Language Acquisition and Foreign Language Teaching , 2004 .

[47]  D. Murray.  TECHNOLOGIES FOR SECOND LANGUAGE LITERACY , 2005, Annual Review of Applied Linguistics.

[48]  Trude Heift,et al.  Heift Trude Schulze Mathias. Errors and Intelligence in Computer-Assisted Language Learning: Parsers and Pedagogues Routledge (Routledge series in computer-assisted language learning), 2007. xviii+283 Pages. ISBN: 978-0-415-36191-0. Price: $115 , 2009, ReCALL.

[49]  B. MacWhinney,et al.  The Competition Model: the Input, the Context, and the Brain Part of the First and Second Language Acquisition Commons, and the Psychology Commons , 2022 .

[50]  Stephen Krashen,et al.  Principles and Practice in Second Language Acquisition , 1982 .

[51]  Kevin R. Gregg.  Cognition and Second Language Instruction: Learnability and second language acquisition theory , 2001 .

[52]  Michael H. Long,et al.  An introduction to second language acquisition research , 1990 .

[53]  William Grabe,et al.  3. RESEARCH ON TEACHING READING , 2004, Annual Review of Applied Linguistics.

[54]  I. Marsic,et al.  Natural communication with information systems , 2000, Proceedings of the IEEE.

[55]  Jo McDonough,et al.  Research Methods for English Language Teachers , 1997 .

[56]  Joan-Tomàs Pujolà,et al.  Did CALL feedback feed back? Researching learners’ use of feedback , 2001, ReCALL.

[57]  Trude Heift.  Multiple Learner Errors and Meaningful Feedback: A Challenge for ICALL Systems , 2013 .

[58]  Walt Detmar Meurers,et al.  Analyzing Learner Language : Towards A Flexible NLP Architecture for Intelligent Language Tutors , 2010 .

[59]  Norma A. Pravec.  Survey of learner corpora , 2002 .

[60]  Yeung,et al.  Cognitive Load and Learner Expertise: Split-Attention and Redundancy Effects in Reading with Explanatory Notes , 1998, Contemporary educational psychology.

[61]  Walt Detmar Meurers.  Diagnosing Meaning Errors in Short Answers to Reading Comprehension Questions , 2008 .

[62]  C. Doughty.  Cognitive Underpinnings of Focus on Form , 1999 .

[63]  O. Yevdokimov.  Critical Thinking : How to Prepare Students for a Rapidly Changing World , 2002 .

[64]  T. Pica.  Questions From the Language Classroom: Research Perspectives , 1994 .

[65]  Emilia Djonov.  Vivian Cook and Benedetta Bassetti (eds): Second Language Writing Systems. Multilingual Matters, 2005. , 2007 .

[66]  A. U. Chamot.  LANGUAGE LEARNING STRATEGY INSTRUCTION: CURRENT ISSUES AND RESEARCH , 2005, Annual Review of Applied Linguistics.

[67]  H. Douglas Brown,et al.  Language Assessment: Principles and Classroom Practices , 2003 .

[68]  Vivian Cook,et al.  Chapter 1: An Introduction to Researching Second Language Writing Systems , 2005 .

[69]  Virginia Yip,et al.  Interlanguage and learnability , 1995 .

[70]  S. Benesch,et al.  Needs Analysis and Curriculum Development in EAP: An Example of a Critical Approach , 1996 .

[71]  Hugh Gosden,et al.  An aspect of holistic modeling in academic writing: Propositional clusters as a heuristic for thematic control , 1998 .

[72]  Hsien-Chin Liou.  Development of an English Grammar Checker: A Progress Report , 1991 .

[73]  Carol A. Chapelle,et al.  CALL in the Year 2000: Still in Search of Research Paradigms? , 1997 .

[74]  Sebastien L'Haire,et al.  Error Diagnosis in the FreeText Project , 2003 .

[75]  Carol A. Chapelle,et al.  ESOL Tests and Testing , 2005 .

[76]  Markus Dickinson,et al.  A balancing act: how can intelligent computer-generated feedback be provided in learner-to-learner interactions? , 2008 .

[77]  D. Oanh.  Meeting Students' Needs in Two EAP Programmes in Vietnam and New Zealand A Comparative Study , 2007 .

[78]  A. Hughes.  Testing for language teachers , 1989 .

[79]  周彬彬,et al.  Interlanguage : forty years later , 2014 .

[80]  Khalid Al-Seghayer,et al.  THE EFFECT OF MULTIMEDIA ANNOTATION MODES ON L2 VOCABULARY ACQUISITION: A COMPARATIVE STUDY , 2001 .

[81]  Masoud Yazdani,et al.  Intelligent Tutoring Systems for Foreign Language Learning: The Bridge to International Communication , 2012 .

[82]  Cornelia Tschichold,et al.  Lexically Driven Error Detection and Correction , 2013, CALICO Journal.

[83]  Walt Detmar Meurers,et al.  On using intelligent computer-assisted language learning in real-life foreign language teaching and learning , 2011, ReCALL.

[84]  Ken Hyland,et al.  Second Language Writing , 2003 .

[85]  D. Nunan,et al.  Learning styles in adult migrant education , 1986 .

[86]  Maria Thomas-Ruzic,et al.  The Least You Should Know about Arabic: Implications for the ESL Writing Instructor. , 1983 .

[87]  Carl James,et al.  Errors in Language Learning and Use: Exploring Error Analysis , 1998 .

[88]  Maria Mantello,et al.  Error Correction in the L2 Classroom , 1997 .