Sprites and Rules: What ERPs and Procedural Memory Can Tell Us about Video Games and Language Learning

Language acquisition and the development of skills used in playing video games have in common the notion of proceduralization. In this chapter I argue that video games can tie together these two uses of procedural memory in order to maximize the chances of success in language learning. To support this argument I review research in the event-related potential (ERP) literature showing that, under controlled experimental conditions, computer games have already been used to train language learners to the point where they exhibit nativelike brain signatures of morphosyntactic processing. Crucially in these experiments, the morphosyntactic features to be acquired and perfected were tied to the mechanics of the game. In light of the success of these training games in controlled settings, I outline the learning principles detailed by Gee (2003) that facilitated learning in these cases, and propose that this practice of coupling morphosyntax with gameplay mechanics could also prove fruitful in real-world language learning settings. Turning to recent commercial video games, I show how game developers have relied on design techniques that take advantage of the audience’s expectations of gameplay procedures in a way that enhances the gameplay experience. Finally, I suggest directions for future studies on the interplay between gameplay mechanics and language acquisition, as well as ways of designing games to harness this connection for the benefit of the language learner.

[1]  Peter Hagoort,et al.  The Neural Integration of Speaker and Message , 2008, Journal of Cognitive Neuroscience.

[2]  Miguel Sicart,et al.  Defining Game Mechanics , 2008, Game Stud..

[3]  Bertram Opitz,et al.  Interactions of the hippocampal system and the prefrontal cortex in learning language-like rules , 2003, NeuroImage.

[4]  M. Ullman The functional neuroanatomy of inflectional morphology , 1999 .

[5]  M. Ullman Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[6]  D. Caplan,et al.  Electrophysiological distinctions in processing conceptual relationships within simple sentences. , 2003, Brain research. Cognitive brain research.

[7]  A. Friederici The neural basis of syntactic processes , 2004 .

[8]  A. Friederici,et al.  Brain Correlates of Language Learning: The Neuronal Dissociation of Rule-Based versus Similarity-Based Learning , 2004, The Journal of Neuroscience.

[9]  S. Pinker,et al.  A Neural Dissociation within Language: Evidence that the Mental Dictionary Is Part of Declarative Memory, and that Grammatical Rules Are Processed by the Procedural System , 1997, Journal of Cognitive Neuroscience.

[10]  M. I. Núñez-Peña,et al.  P600 related to rule violation in an arithmetic task. , 2004, Brain research. Cognitive brain research.

[11]  D. Poeppel,et al.  The linguistic processes underlying the P600 , 2010 .

[12]  Robert V. Reichle,et al.  Near-nativelike processing of contrastive focus in L2 French , 2010 .

[13]  M T Ullman,et al.  The Declarative/Procedural Model of Lexicon and Grammar , 2001, Journal of psycholinguistic research.

[14]  E. M. Avedon 2 – The Structural Elements of Games* , 1981 .

[15]  Mante S. Nieuwland,et al.  Right or Wrong? , 2009, Psychological science.

[16]  Rod Ellis,et al.  12. The Effects of Two Types of Input on Intake and the Acquisition of Implicit and Explicit Knowledge , 2009 .

[17]  H. Neville,et al.  Maturational Constraints on Functional Specializations for Language Processing: ERP and Behavioral Evidence in Bilingual Speakers , 1996, Journal of Cognitive Neuroscience.

[18]  M. Kutas,et al.  Bridging the Gap: Evidence from ERPs on the Processing of Unbounded Dependencies , 1993, Journal of Cognitive Neuroscience.

[19]  M. Kutas,et al.  Brain potentials during reading reflect word expectancy and semantic association , 1984, Nature.

[20]  Karsten Steinhauer,et al.  Brain signatures of artificial language processing: Evidence challenging the critical period hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Steven Pinker,et al.  Words and rules , 1998 .

[22]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[23]  M. Garrett,et al.  Syntactically Based Sentence Processing Classes: Evidence from Event-Related Brain Potentials , 1991, Journal of Cognitive Neuroscience.

[24]  Kara Morgan-Short,et al.  Second Language Acquisition of Gender Agreement in Explicit and Implicit Training Conditions: An Event-Related Potential Study. , 2010, Language learning.

[25]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[26]  Jutta L. Mueller Electrophysiological correlates of second language processing , 2005 .

[27]  Aniruddh D. Patel,et al.  Processing Syntactic Relations in Language and Music: An Event-Related Potential Study , 1998, Journal of Cognitive Neuroscience.

[28]  L. Osterhout,et al.  Novice Learners, Longitudinal Designs, and Event-Related Potentials: A Means for Exploring the Neurocognition of Second Language Processing. , 2006 .

[29]  Jutta L. Mueller,et al.  Native and Nonnative Speakers' Processing of a Miniature Version of Japanese as Revealed by ERPs , 2005, Journal of Cognitive Neuroscience.

[30]  Karsten Steinhauer,et al.  Temporal dynamics of late second language acquisition: evidence from event-related brain potentials , 2009 .

[31]  M. Kutas,et al.  Influences of semantic and syntactic context on open- and closed-class words , 1991, Memory & cognition.

[32]  P. Holcomb,et al.  Event-related brain potentials elicited by syntactic anomaly , 1992 .

[33]  Jutta L. Mueller L2 in a Nutshell: The Investigation of Second Language Processing in the Miniature Language Model. , 2006 .

[34]  H Eichenbaum,et al.  Declarative memory: insights from cognitive neurobiology. , 1997, Annual review of psychology.

[35]  Claudia Felser,et al.  How native-like is non-native language processing? , 2006, Trends in Cognitive Sciences.

[36]  J. Nicol,et al.  On the Distinctiveness, Independence, and Time Course of the Brain Responses to Syntactic and Semantic Anomalies. , 1999 .

[37]  R. Ellis,et al.  IMPLICIT AND EXPLICIT CORRECTIVE FEEDBACK AND THE ACQUISITION OF L2 GRAMMAR , 2006, Studies in Second Language Acquisition.

[38]  John R. Anderson The Architecture of Cognition , 1983 .

[39]  H. Kolk,et al.  Structure and limited capacity in verbal working memory: A study with event-related potentials , 2003, Brain and Language.

[40]  Manuel Martín-Loeches,et al.  Brain potentials to mathematical syntax problems. , 2006, Psychophysiology.