Sequence in a sequence: Learning of auditory but not visual patterns within a multimodal sequence.

The current study investigates whether a unimodal visual and a unimodal auditory sequence is learned separately in a multimodal learning situation. In two experiments participants faced a modified version of the Serial Reaction-Time task, in which auditory and visual elements followed each other, forming a multimodal sequence as well as two unimodal sequences. Learning of both the multimodal and the unimodal sequences were tested. Results showed evidence of multimodal sequence learning. The unimodal sequence formed by the auditory stimuli was also learned, while participants did not acquire the concurrent visual sequence. The experiments argue for a domain- and modality-general sequence learning mechanism that is more sensitive to auditory and response-based information than to visual information.

[1]  Aaron R. Seitz,et al.  Simultaneous and Independent Acquisition of Multisensory and Unisensory Associations , 2007, Perception.

[2]  U. Mayr,et al.  Spatial attention and implicit sequence learning: evidence for independent learning of spatial and nonspatial sequences. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Scott P. Johnson,et al.  Infant Rule Learning Facilitated by Speech , 2007, Psychological science.

[4]  B. Meier,et al.  Only correlated sequences that are actively processed contribute to implicit sequence learning. , 2012, Acta psychologica.

[5]  R. Tunney,et al.  Two modes of transfer in artificial grammar learning. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[6]  I Koch,et al.  Automatic and intentional activation of task sets. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Morten H. Christiansen,et al.  Modality-constrained statistical learning of tactile, visual, and auditory sequences. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[8]  M. Gluck,et al.  How do people solve the "weather prediction" task?: individual variability in strategies for probabilistic category learning. , 2002, Learning & memory.

[9]  M. Van der Linden,et al.  Implicit sequence learning in children. , 1998, Journal of experimental child psychology.

[10]  Jane E. Clark,et al.  Probabilistic Motor Sequence Yields Greater Offline and Less Online Learning than Fixed Sequence , 2016, Front. Hum. Neurosci..

[11]  Ferenc Kemény,et al.  Stimulus dependence in probabilistic category learning. , 2013, Acta psychologica.

[12]  E. Robertson.  The Serial Reaction Time Task: Implicit Motor Skill Learning? , 2007, The Journal of Neuroscience.

[13]  Z. Dienes,et al.  On the modality independence of implicitly learned grammatical knowledge , 1995 .

[14]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[15]  J. Witt,et al.  Evidence for separate representations for action and location in implicit motor sequencing , 2006, Psychonomic bulletin & review.

[16]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[17]  Á. Pascual-Leone,et al.  The role of the dorsolateral prefrontal cortex during sequence learning is specific for spatial information. , 2001, Cerebral cortex.

[18]  Ferenc Kemény,et al.  Stimulus dependence and cross-modal interference in sequence learning , 2017, Quarterly journal of experimental psychology.

[19]  Morten H. Christiansen,et al.  Timing is everything: Changes in presentation rate have opposite effects on auditory and visual implicit statistical learning , 2011, Quarterly journal of experimental psychology.

[20]  Richard J. Tunney,et al.  The transfer effect in artificial grammar learning: Reappraising the evidence on the transfer of sequential dependencies. , 1999 .

[21]  J. Saffran,et al.  Dog is a dog is a dog: Infant rule learning is not specific to language , 2007, Cognition.

[22]  Beat Meier,et al.  Multimodal sequence learning. , 2016, Acta psychologica.

[23]  B. Meier,et al.  Implicit task sequence learning with auditory stimuli , 2012 .

[24]  A. Baddeley.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[25]  Jane E. Clark,et al.  Children and Adults Both Learn Motor Sequences Quickly, But Do So Differently , 2017, Frontiers in psychology.

[26]  Brian MacWhinney,et al.  Statistical Learning in Linguistic and Nonlinguistic Domains , 2013 .

[27]  A. Reber.  Implicit learning of artificial grammars , 1967 .

[28]  Morten H. Christiansen,et al.  Domain generality versus modality specificity: the paradox of statistical learning , 2015, Trends in Cognitive Sciences.

[29]  Elger L. Abrahamse,et al.  Redundant sensory information does not enhance sequence learning in the serial reaction time task , 2012, Advances in cognitive psychology.

[30]  B. Meier,et al.  Incidental task sequence learning: perceptual rather than conceptual? , 2007, Psychological research.

[31]  Ferenc Kemény,et al.  Perceptual Effect on Motor Learning in the Serial Reaction-Time Task , 2011, The Journal of general psychology.

[32]  Thomas Goschke,et al.  On the modularity of implicit sequence learning: Independent acquisition of spatial, symbolic, and manual sequences , 2012, Cognitive Psychology.

[33]  Daniel B. Willingham,et al.  Implicit motor sequence learning is represented in response locations , 2000, Memory & cognition.

[34]  Walter Schneider,et al.  Dynamic Sensorimotor Planning during Long-Term Sequence Learning: The Role of Variability, Response Chunking and Planning Errors , 2012, PloS one.

[35]  Eric Soetens,et al.  Perceptual or motor learning in SRT tasks with complex sequence structures , 2006, Psychological research.

[36]  Aaron D. Mitchel,et al.  Learning across senses: cross-modal effects in multisensory statistical learning. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[37]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[38]  Thomas F. Münte,et al.  Influence of Stimulus Distance in Implicit Learning of Spatial and Nonspatial Event Sequences , 2002, Perceptual and motor skills.

[39]  A. Baddeley.  Working memory and language: an overview. , 2003, Journal of communication disorders.

[40]  Eric Soetens,et al.  Spatial processing and perceptual sequence learning in SRT tasks. , 2006, Experimental psychology.

[41]  Richard N Aslin,et al.  Statistical learning of new visual feature combinations by infants , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[42]  B. Meier,et al.  Are correlated streams of information necessary for implicit sequence learning? , 2010, Acta psychologica.

[43]  Eric Soetens,et al.  Effector-dependent and response location learning of probabilistic sequences in serial reaction time tasks , 2006, Experimental Brain Research.

[44]  Daniel B. Willingham,et al.  Implicit motor sequence learning is not purely perceptual , 1999, Memory & cognition.

[45]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[46]  Luis Jiménez,et al.  Temporal effects in sequence learning , 2003 .