Effects of Selective and Divided Attention on Audiovisual Interaction

In everyday life, visual and auditory are the most common forms of sensory information. Therefore, audiovisual interaction in the brain plays an important role in performance and perception. In addition, our attention system allows us to dynamically select and enhance the processing of objects and events that are the most relevant at each moment. Some studies suggest that attention can modulate audiovisual integration. However, different neural activity of multimodal audiovisual integration can be seen in different attention conditions. This review focuses on the question of what affects selective and divided attention in audiovisual interaction. Neural activities of audiovisual under selective and divided attention conditions are also discussed. This review aims to bring together and summarize previous studies on the interactions between attention and audiovisual integration.

[1]  Brigitte Röder,et al.  Multisensory processing in the redundant-target effect: A behavioral and event-related potential study , 2005, Perception & psychophysics.

[2]  John J. Foxe,et al.  Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness , 2011, NeuroImage.

[3]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[4]  P Pietrini,et al.  Cerebral metabolic response to passive audiovisual stimulation in patients with Alzheimer's disease and healthy volunteers assessed by PET. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[5]  P Bertelson,et al.  Directing spatial attention towards the illusory location of a ventriloquized sound. , 2001, Acta psychologica.

[6]  J. Pernier,et al.  Early auditory-visual interactions in human cortex during nonredundant target identification. , 2002, Brain research. Cognitive brain research.

[7]  B. Gordon,et al.  Receptive fields in deep layers of cat superior colliculus. , 1973, Journal of neurophysiology.

[8]  Jeff Miller,et al.  Timecourse of coactivation in bimodal divided attention , 1986, Perception & psychophysics.

[9]  Biomechanical Properties of the Foot Sole in Diabetic Mellitus Patients: A Preliminary Study to Understand Ulcer Formation , 2014 .

[10]  Geraint Rees,et al.  Sound alters activity in human V1 in association with illusory visual perception , 2006, NeuroImage.

[11]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[12]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[13]  P. Bertelson,et al.  The ventriloquist effect does not depend on the direction of deliberate visual attention , 2000, Perception & psychophysics.

[14]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[15]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[16]  P. Bertelson.  Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping , 1999 .

[17]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[18]  M. Wallace,et al.  Representation and integration of multiple sensory inputs in primate superior colliculus. , 1996, Journal of neurophysiology.

[19]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[20]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[21]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[22]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[23]  Steven A. Hillyard,et al.  Effects of Spatial Congruity on Audio-Visual Multimodal Integration , 2005, Journal of Cognitive Neuroscience.

[24]  Emiliano Macaluso,et al.  Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites , 2009, The European journal of neuroscience.

[25]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[26]  L. Busse,et al.  The spread of attention across modalities and space in a multisensory object. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[27]  E. Schröger,et al.  ERP effects of intermodal attention and cross-modal links in spatial attention. , 1998, Psychophysiology.

[28]  Tetsuo Touge,et al.  Multisensory Interactions Elicited by Audiovisual Stimuli Presented Peripherally in a Visual Attention Task: A Behavioral and Event-Related Potential Study in Humans , 2009, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[29]  J. Theeuwes,et al.  Attention and the multiple stages of multisensory integration: A review of audiovisual studies. , 2010, Acta psychologica.

[30]  Durk Talsma,et al.  Intermodal spatial attention differs between vision and audition: An event-related potential analysis , 2002 .

[31]  N. Bruneau,et al.  Cross-modal processing of auditory–visual stimuli in a no-task paradigm: A topographic event-related potential study , 2008, Clinical Neurophysiology.

[32]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[33]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[34]  Paul J. Laurienti,et al.  Modality-specific selective attention attenuates multisensory integration , 2007, Experimental Brain Research.

[35]  Tetsuo Touge,et al.  Audiovisual interaction enhances auditory detection in late stage: an event-related potential study , 2010, Neuroreport.

[36]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[37]  L M Ward,et al.  Involuntary Listening Aids Seeing: Evidence From Human Electrophysiology , 2000, Psychological science.

[38]  Paul J. Laurienti,et al.  Semantic congruence is a critical factor in multisensory behavioral performance , 2004, Experimental Brain Research.