Help me if I can't: Social interaction effects in adult contextual word learning

A major challenge in second language acquisition is to build up new vocabulary. How is it possible to identify the meaning of a new word among several possible referents? Adult learners typically use contextual information, which reduces the number of possible referents a new word can have. Alternatively, a social partner may facilitate word learning by directing the learner's attention toward the correct new word meaning. While much is known about the role of this form of 'joint attention' in first language acquisition, little is known about its efficacy in second language acquisition. Consequently, we introduce and validate a novel visual word learning game to evaluate how joint attention affects the contextual learning of new words in a second language. Adult learners either acquired new words in a constant or variable sentence context by playing the game with a knowledgeable partner, or by playing the game alone on a computer. Results clearly show that participants who learned new words in social interaction (i) are faster in identifying a correct new word referent in variable sentence contexts, and (ii) temporally coordinate their behavior with a social partner. Testing the learned words in a post-learning recall or recognition task showed that participants, who learned interactively, better recognized words originally learned in a variable context. While this result may suggest that interactive learning facilitates the allocation of attention to a target referent, the differences in the performance during recognition and recall call for further studies investigating the effect of social interaction on learning performance. In summary, we provide first evidence on the role joint attention in second language learning. Furthermore, the new interactive learning game offers itself to further testing in complex neuroimaging research, where the lack of appropriate experimental set-ups has so far limited the investigation of the neural basis of adult word learning in social interaction.

[1]  Cordula Vesper,et al.  Making oneself predictable: reduced temporal variability facilitates joint action coordination , 2011, Experimental Brain Research.

[2]  Kenji Hakuta,et al.  Confounded age: Linguistic and cognitive factors in age differences for second language acquisition. , 1999 .

[3]  H. Walter,et al.  Do you mean me? Communicative intentions recruit the mirror and the mentalizing system. , 2014, Social cognitive and affective neuroscience.

[4]  H. Gleitman,et al.  The current status of the motherese hypothesis , 1984, Journal of Child Language.

[5]  N. Rader,et al.  Caregivers’ gestures direct infant attention during early word learning: the importance of dynamic synchrony , 2012 .

[6]  Jacqueline Nadel,et al.  From social behaviour to brain synchronization: Review and perspectives in hyperscanning , 2011 .

[7]  Kara D. Federmeier,et al.  Timed Action and Object Naming , 2005, Cortex.

[8]  Henk G Schmidt,et al.  Detrimental influence of contextual change on spacing effects in free recall. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[9]  J. Rączaszek-Leonardi,et al.  Pooling the ground: understanding and coordination in collective sense making , 2014, Front. Psychol..

[10]  Peter Ford Dominey,et al.  Indeterminacy in language acquisition: the role of child directed speech and joint attention , 2004, Journal of Neurolinguistics.

[11]  T. Bongaerts,et al.  Authenticity of pronunciation in naturalistic second language acquisition: The case of very advanced late learners of Dutch as a second language , 2000 .

[12]  Michael J Kahana,et al.  Contextual Variability in Free Recall. , 2011, Journal of memory and language.

[13]  H. Bekkering,et al.  Exploring the brain basis of joint action: Co-ordination of actions, goals and intentions , 2007, Social neuroscience.

[14]  D. Perani,et al.  Neural convergence for language comprehension and grammatical class production in highly proficient bilinguals is independent of age of acquisition , 2013, Cortex.

[15]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[16]  William E. Nagy,et al.  Learning Word Meanings From Context During Normal Reading , 1987 .

[17]  Kara D. Federmeier,et al.  Timed picture naming: Extended norms and validation against previous studies , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[18]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[19]  F. Bellezza,et al.  Encoding variability, memory organization, and the repetition effect. , 1982 .

[20]  Kerstin Fischer,et al.  Mindful tutors: Linguistic choice and action demonstration in speech to infants and a simulated robot , 2011 .

[21]  Gordon D. A. Brown,et al.  Contextual Diversity, Not Word Frequency, Determines Word-Naming and Lexical Decision Times , 2006, Psychological science.

[22]  Paula Fitzpatrick,et al.  Understanding social motor coordination. , 2011, Human movement science.

[23]  Kara D. Federmeier,et al.  Timed picture naming in seven languages , 2003, Psychonomic bulletin & review.

[24]  L. Gogate,et al.  A study of multimodal motherese: the role of temporal synchrony between verbal labels and gestures. , 2000, Child development.

[25]  J. Watson,et al.  Early socio–emotional development: Contingency perception and the social-biofeedback model. , 1999 .

[26]  Y. Yamaguchi,et al.  Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction , 2013, Scientific Reports.

[27]  J. Kelso,et al.  Binding of movement, sound and touch: multimodal coordination dynamics , 2006, Experimental Brain Research.

[28]  Thomas T. Hills,et al.  The Associative Structure of Language: Contextual Diversity in Early Word Learning. , 2010, Journal of memory and language.

[29]  F. N. Dempster,et al.  Effects of variable encoding and spaced presentations on vocabulary learning. , 1987 .

[30]  Martin J. Pickering,et al.  Alignment as the Basis for Successful Communication , 2006 .

[31]  S. Huettel,et al.  A nexus model of the temporal–parietal junction , 2013, Trends in Cognitive Sciences.

[32]  M. Pickering,et al.  The interactive-alignment model: Developments and refinements , 2004, Behavioral and Brain Sciences.

[33]  A. Baddeley,et al.  Context-dependent memory in two natural environments: on land and underwater. , 1975 .

[34]  C. F. Bond,et al.  Social facilitation: a meta-analysis of 241 studies. , 1983, Psychological bulletin.

[35]  S. Riek,et al.  The effect of attention on the release of anticipatory timing actions. , 2014, Behavioral neuroscience.

[36]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[37]  Katharina J. Rohlfing,et al.  Attention via Synchrony: Making Use of Multimodal Cues in Social Learning , 2009, IEEE Transactions on Autonomous Mental Development.

[38]  Michael Tomasello,et al.  The social-pragmatic theory of word learning. , 2000 .

[39]  S. Kotz,et al.  Play along: effects of music and social interaction on word learning , 2015, Front. Psychol..

[40]  Margaret Wilson,et al.  An oscillator model of the timing of turn-taking , 2005, Psychonomic bulletin & review.

[41]  A. Glenberg,et al.  Component-levels theory of the effects of spacing of repetitions on recall and recognition , 1979, Memory & cognition.

[42]  S. Cobb Speech and Brain-Mechanisms. , 1960 .

[43]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[44]  P. Keller,et al.  Neural correlates of auditory temporal predictions during sensorimotor synchronization , 2011, Front. Hum. Neurosci..

[45]  A. Glenberg Monotonic and nonmonotonic lag effects in paired-associate and recognition memory paradigms , 1976 .

[46]  L. Fadiga,et al.  Lexicality drives audio-motor transformations in Broca’s area , 2010, Brain and Language.

[47]  L. Gogate,et al.  Intersensory Redundancy and 7-Month-Old Infants' Memory for Arbitrary Syllable-Object Relations , 2001 .

[48]  M. Legerstee,et al.  Contingency, imitation, and affect sharing: Foundations of infants' social awareness. , 2006, Developmental psychology.

[49]  C. Frith,et al.  Mechanisms of social cognition. , 2012, Annual review of psychology.

[50]  Shigeru Sato,et al.  Learning second language vocabulary: Neural dissociation of situation-based learning and text-based learning , 2010, NeuroImage.

[51]  Alexander P. Demos,et al.  Journal of Experimental Psychology : General Rocking to the Beat : Effects of Music and Partner ' s Movements on Spontaneous Interpersonal Coordination , 2011 .

[52]  Rick Dale,et al.  Behavior Matching in Multimodal Communication Is Synchronized , 2012, Cogn. Sci..

[53]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[54]  J. Decety,et al.  The Role of the Right Temporoparietal Junction in Social Interaction: How Low-Level Computational Processes Contribute to Meta-Cognition , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[55]  Morris Moscovitch,et al.  Depth of processing, retrieval cues, and uniqueness of encoding as factors in recall , 1976 .

[56]  Linda B. Smith Learning How to Learn Words , 2000 .

[57]  Nadim Joni Shah,et al.  Minds Made for Sharing: Initiating Joint Attention Recruits Reward-related Neurocircuitry , 2010, Journal of Cognitive Neuroscience.

[58]  Gereon R Fink,et al.  The right temporoparietal junction in attention and social interaction: A transcranial magnetic stimulation study , 2016, Human brain mapping.

[59]  Dare A. Baldwin,et al.  Social gating and pedagogy: Mechanisms for learning and implications for robotics , 2010, Neural Networks.

[60]  N. Triplett,et al.  The Dynamogenic Factors in Pacemaking and Competition , 1898 .

[61]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[62]  Gian Luca Romani,et al.  Being an agent or an observer: Different spectral dynamics revealed by MEG , 2014, NeuroImage.

[63]  G. Csibra,et al.  Natural pedagogy , 2009, Trends in Cognitive Sciences.

[64]  Msl Swanborn,et al.  Incidental Word Learning While Reading: A Meta-Analysis , 1999 .

[65]  J. Hulstijn,et al.  INCIDENTAL VOCABULARY ACQUISITION IN A SECOND LANGUAGE: THE CONSTRUCT OF TASK-INDUCED INVOLVEMENT , 2001 .

[66]  D. Caplan,et al.  Processing of Visually Presented Sentences in Mandarin and English Studied with fMRI , 1999, Neuron.

[67]  Eraldo Paulesu,et al.  The role of age of acquisition and language usage in early, high‐proficient bilinguals: An fMRI study during verbal fluency , 2003, Human brain mapping.

[68]  Cordula Vesper,et al.  Are you ready to jump? Predictive mechanisms in interpersonal coordination. , 2013, Journal of experimental psychology. Human perception and performance.

[69]  P. Kuhl,et al.  Foreign-language experience in infancy: Effects of short-term exposure and social interaction on phonetic learning , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[70]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[71]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[72]  L. Schilbach,et al.  On the relationship of online and offline social cognition , 2014, Front. Hum. Neurosci..

[73]  Jessica S. Horst,et al.  The role of competition in word learning via referent selection. , 2010, Developmental science.

[74]  Ulrika Kahl,et al.  [The bilingual brain]. , 2002, Lakartidningen.

[75]  J. Bruner From communication to language—a psychological perspective , 1975, Cognition.

[76]  T. Striano,et al.  Sensitivity to triadic attention in early infancy. , 2005, Developmental science.

[77]  Michael Tomasello,et al.  Two-Year-Olds Use Pragmatic Cues to Differentiate Reference to Objects and Actions , 1995 .

[78]  V Bettinardi,et al.  The bilingual brain. Proficiency and age of acquisition of the second language. , 1998, Brain : a journal of neurology.

[79]  S. Kotz,et al.  How relevant is social interaction in second language learning? , 2013, Front. Hum. Neurosci..

[80]  P. Kuhl Is speech learning 'gated' by the social brain? , 2007, Developmental science.

[81]  C. Frith,et al.  Language as a Tool for Interacting Minds , 2010 .

[82]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[83]  Rebecca J. Brand,et al.  Breaking the language barrier: an emergentist coalition model for the origins of word learning. , 2000, Monographs of the Society for Research in Child Development.

[84]  Kenneth J. Malmberg,et al.  The effect of normative context variability on recognition memory. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[85]  Barry S. Stein,et al.  Depth of processing reexamined: The effects of the precision of encoding and test appropriateness , 1978 .

[86]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[87]  Markus Conci,et al.  Contextual learning of multiple target locations in visual search , 2012 .

[88]  M. Strube,et al.  What didTriplett really find? A contemporary analysis of the first experiment in social psychology. , 2005, The American journal of psychology.

[89]  Larissa K. Samuelson,et al.  Word learning emerges from the interaction of online referent selection and slow associative learning. , 2012, Psychological review.

[90]  E. Tulving,et al.  Relation between encoding specificity and levels of precessing , 1979 .

[91]  M. Jackson What do you mean? , 1989, Geriatric nursing.

[92]  L. Gogate,et al.  The intersensory origins of word‐comprehension: an ecological–dynamic systems view , 2001 .

[93]  R. Zajonc SOCIAL FACILITATION. , 1965, Science.

[94]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[95]  Daniel O. Jackson,et al.  Second Language Acquisition and the Critical Period Hypothesis , 2000 .

[96]  S. Waxman,et al.  Early word-learning entails reference, not merely associations , 2009, Trends in Cognitive Sciences.

[97]  Sebo Uithol,et al.  Engagement: Looking beyond the mirror to understand action understanding. , 2016, The British journal of developmental psychology.

[98]  Stefano F. Cappa,et al.  The bilingual brain as revealed by functional neuroimaging , 2001, The Bilingualism Reader.

[99]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[100]  Linda B. Smith,et al.  Social coordination in toddler's word learning: interacting systems of perception and action , 2008, Connect. Sci..

[101]  Jubin Abutalebi,et al.  Neural aspects of second language representation and language control. , 2008, Acta psychologica.

[102]  Cathy J Price,et al.  Convergence, degeneracy and control. , 2006, Language learning.

[103]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[104]  J. Elman,et al.  Learning to use words: Event-related potentials index single-shot contextual word learning , 2010, Cognition.

[105]  Katharina J. Rohlfing,et al.  Is ostension any more than attention? , 2014, Scientific Reports.

[106]  Relation Between Encoding Specificity and Levels of Processing , 2014 .

[107]  Larissa K. Samuelson,et al.  Learn Locally, Think Globally , 2010, Psychological science.

[108]  A. Rodríguez-Fornells,et al.  Neurophysiological mechanisms involved in language learning in adults , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[109]  M. Tomasello,et al.  Shared intentionality. , 2007, Developmental science.

[110]  C. Snow Mothers' Speech to Children Learning Language. , 1972 .

[111]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[112]  R. Marsh,et al.  An observation on the role of context variability in free recall. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[113]  Sean M. Polyn,et al.  A context maintenance and retrieval model of organizational processes in free recall. , 2009, Psychological review.

[114]  J. Kelso,et al.  Social coordination dynamics: Measuring human bonding , 2008, Social neuroscience.

[115]  Jochen Kaiser,et al.  Auditory–motor synchronization facilitates attention allocation , 2013, NeuroImage.

[116]  Ellen M. Markman,et al.  Constraints Children Place on Word Meanings , 1990, Cogn. Sci..

[117]  Chaozhe Zhu,et al.  Neural Synchronization during Face-to-Face Communication , 2012, The Journal of Neuroscience.