Visual change detection recruits auditory cortices in early deafness

Although cross-modal recruitment of early sensory areas in deafness and blindness is well established, the constraints and limits of these plastic changes remain to be understood. In the case of human deafness, for instance, it is known that visual, tactile or visuo-tactile stimuli can elicit a response within the auditory cortices. Nonetheless, both the timing of these evoked responses and the functional contribution of cross-modally recruited areas remain to be ascertained. In the present study, we examined to what extent auditory cortices of deaf humans participate in high-order visual processes, such as visual change detection. By measuring visual ERPs, in particular the visual MisMatch Negativity (vMMN), and performing source localization, we show that individuals with early deafness (N=12) recruit the auditory cortices when a change in motion direction during shape deformation occurs in a continuous visual motion stream. Remarkably this "auditory" response for visual events emerged with the same timing as the visual MMN in hearing controls (N=12), between 150 and 300 ms after the visual change. Furthermore, the recruitment of auditory cortices for visual change detection in early deaf was paired with a reduction of response within the visual system, indicating a shift from visual to auditory cortices of part of the computational process. The present study suggests that the deafened auditory cortices participate at extracting and storing the visual information and at comparing on-line the upcoming visual events, thus indicating that cross-modally recruited auditory cortices can reach this level of computation.

[1]  S. Lomber,et al.  Cross-modal plasticity in specific auditory cortices underlies visual compensations in the deaf , 2010, Nature Neuroscience.

[2]  F. Perrin,et al.  Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. , 1990, Psychophysiology.

[3]  J. Ram,et al.  Inactivating and non-inactivating outward current channels in cell-attached patches ofHelix neurons , 1987, Brain Research.

[4]  Karen Emmorey,et al.  The neural correlates of sign versus word production , 2007, NeuroImage.

[5]  István Czigler,et al.  ERPs and deviance detection: Visual mismatch negativity to repeated visual stimuli , 2006, Neuroscience Letters.

[6]  P. Pazo-Álvarez,et al.  Automatic detection of motion direction changes in the human brain , 2004, The European journal of neuroscience.

[7]  K. Alho Cerebral Generators of Mismatch Negativity (MMN) and Its Magnetic Counterpart (MMNm) Elicited by Sound Changes , 1995, Ear and hearing.

[8]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[9]  Karen Emmorey,et al.  Neural systems underlying lexical retrieval for sign language , 2003, Neuropsychologia.

[10]  M. Davare,et al.  Reorganisation of the Right Occipito-Parietal Stream for Auditory Spatial Processing in Early Blind Humans. A Transcranial Magnetic Stimulation Study , 2009, Brain Topography.

[11]  M. Hallett,et al.  Functional relevance of cross-modal plasticity in blind humans , 1997, Nature.

[12]  E. Amenedo,et al.  MMN in the visual modality: a review , 2003, Biological Psychology.

[13]  Erich Schröger,et al.  Visual mismatch negativity and its importance in visual cognitive sciences , 2011, Neuroreport.

[14]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[15]  O. Collignon,et al.  Functional selectivity in sensory-deprived cortices. , 2011, Journal of neurophysiology.

[16]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults , 1987, Brain Research.

[17]  S. Levänen,et al.  Vibration-induced auditory-cortex activation in a congenitally deaf adult , 1998, Current Biology.

[18]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[19]  S. Debener,et al.  Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. , 2012, Brain : a journal of neurology.

[20]  Karim Jerbi,et al.  ELAN: A Software Package for Analysis and Visualization of MEG, EEG, and LFP Signals , 2011, Comput. Intell. Neurosci..

[21]  C. Büchel,et al.  Corticocortical Connections Mediate Primary Visual Cortex Responses to Auditory Stimulation in the Blind , 2010, The Journal of Neuroscience.

[22]  István Czigler,et al.  Automatic prediction error responses to hands with unexpected laterality: An electrophysiological study , 2012, NeuroImage.

[23]  R. Zatorre,et al.  Organization and Reorganization of Sensory-Deprived Cortex , 2012, Current Biology.

[24]  Manabu Honda,et al.  Critical Period for Cross-Modal Plasticity in Blind Humans: A Functional MRI Study , 2002, NeuroImage.

[25]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[26]  Zahra Hussain,et al.  The Representation of Audiovisual Regularities in the Human Brain , 2013, Journal of Cognitive Neuroscience.

[27]  István Czigler,et al.  Processing of unattended facial emotions: A visual mismatch negativity study , 2012, NeuroImage.

[28]  M. Lassonde,et al.  Cross-modal reorganization and speech perception in cochlear implant users. , 2006, Brain : a journal of neurology.

[29]  Shozo Tobimatsu,et al.  Functional characterization of mismatch negativity to a visual stimulus , 2005, Clinical Neurophysiology.

[30]  R. Zatorre,et al.  Voice perception in blind persons: A functional magnetic resonance imaging study , 2009, Neuropsychologia.

[31]  F. Perrin,et al.  Mapping of scalp potentials by surface spline interpolation. , 1987, Electroencephalography and clinical neurophysiology.

[32]  Paul D. Kieffaber,et al.  Measuring affective reactivity in individuals with autism spectrum personality traits using the visual mismatch negativity event-related brain potential , 2012, Front. Hum. Neurosci..

[33]  H. Tiitinen,et al.  Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. , 2010, Psychophysiology.

[34]  Stephen G Lomber,et al.  Modified areal cartography in auditory cortex following early- and late-onset deafness. , 2014, Cerebral cortex.

[35]  L. Merabet,et al.  Neural reorganization following sensory loss: the opportunity of change , 2010, Nature Reviews Neuroscience.

[36]  István Czigler,et al.  Visual Mismatch Negativity and Categorization , 2014, Brain Topography.

[37]  J. Pernier,et al.  Early auditory-visual interactions in human cortex during nonredundant target identification. , 2002, Brain research. Cognitive brain research.

[38]  Ana L. N. Fred,et al.  Unveiling the Biometric Potential of Finger-Based ECG Signals , 2011, Comput. Intell. Neurosci..

[39]  R. Mayberry,et al.  Age of acquisition effects on the functional organization of language in the adult brain , 2011, Brain and Language.

[40]  L. Cohen,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[41]  Lora T. Likova Drawing enhances cross-modal memory plasticity in the human brain: a case study in a totally blind adult , 2012, Front. Hum. Neurosci..

[42]  Bart Vanrumste,et al.  Validation of ICA as a tool to remove eye movement artifacts from EEG/ERP. , 2010, Psychophysiology.

[43]  Richard Reilly,et al.  Oscillatory entrainment of thalamic neurons by theta rhythm in freely moving rats. , 2011, Journal of neurophysiology.

[44]  Witaya Sungkarat,et al.  Vibrotactile activation of the auditory cortices in deaf versus hearing adults , 2007, Neuroreport.

[45]  István Czigler,et al.  Visual mismatch negativity is sensitive to symmetry as a perceptual category , 2013, The European journal of neuroscience.

[46]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[47]  A. Fort,et al.  Is the auditory sensory memory sensitive to visual information? , 2005, Experimental Brain Research.

[48]  Stephen G Lomber,et al.  Sound localization during homotopic and heterotopic bilateral cooling deactivation of primary and nonprimary auditory cortical areas in the cat. , 2007, Journal of neurophysiology.

[49]  M. Kuba,et al.  Visual mismatch negativity elicited by magnocellular system activation , 2006, Vision Research.

[50]  Gregory Hickok,et al.  Visual stimuli activate auditory cortex in deaf subjects: evidence from MEG , 2003, Neuroreport.

[51]  M. Fuchs,et al.  Clinical utility of distributed source modelling of interictal scalp EEG in focal epilepsy , 2010, Clinical Neurophysiology.

[52]  Cheryl M. Capek,et al.  The signing brain: the neurobiology of sign language , 2008, Trends in Cognitive Sciences.

[53]  M T Wallace,et al.  Onset of cross-modal synthesis in the neonatal superior colliculus is gated by the development of cortical influences. , 2000, Journal of neurophysiology.

[54]  R. Saxe,et al.  A sensitive period for language in the visual cortex: Distinct patterns of plasticity in congenitally versus late blind adults , 2011, Brain and Language.

[55]  K. Reinikainen,et al.  Attentive novelty detection in humans is governed by pre-attentive sensory memory , 1994, Nature.

[56]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[57]  M. Giard,et al.  Changes in Early Cortical Visual Processing Predict Enhanced Reactivity in Deaf Individuals , 2011, PloS one.

[58]  Steven A Hillyard,et al.  Auditory deprivation affects processing of motion, but not color. , 2002, Brain research. Cognitive brain research.

[59]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[60]  István Czigler,et al.  Is it a face of a woman or a man? Visual mismatch negativity is sensitive to gender category , 2013, Front. Hum. Neurosci..

[61]  Daphne Bavelier,et al.  Human brain plasticity: evidence from sensory deprivation and altered language experience. , 2002, Progress in brain research.

[62]  R. Näätänen,et al.  Automatic auditory intelligence: An expression of the sensory–cognitive core of cognitive processes , 2010, Brain Research Reviews.

[63]  Ione Fine,et al.  Comparing the Effects of Auditory Deprivation and Sign Language within the Auditory and Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[64]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[65]  S. Lomber,et al.  Crossmodal reorganization in the early deaf switches sensory, but not behavioral roles of auditory cortex , 2011, Proceedings of the National Academy of Sciences.

[66]  Piia Astikainen,et al.  Visual mismatch negativity for changes in orientation – a sensory memory‐dependent response , 2008, The European journal of neuroscience.

[67]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[68]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[69]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[70]  István Czigler,et al.  Visual change detection: event-related potentials are dependent on stimulus location in humans , 2004, Neuroscience Letters.

[71]  Ana Susac,et al.  Early cortical responses are sensitive to changes in face stimuli , 2010, Brain Research.

[72]  Jing Xu,et al.  Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN , 2010, Neuroscience Letters.

[73]  Jeremy D. Thorne,et al.  Visual movement perception in deaf and hearing individuals , 2013, Advances in cognitive psychology.

[74]  Rebecca Saxe,et al.  Sensitive Period for a Multimodal Response in Human Visual Motion Area MT/MST , 2010, Current Biology.

[75]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[76]  K. Sathian,et al.  Cross-modal plasticity of tactile perception in blindness. , 2010, Restorative neurology and neuroscience.

[77]  S. Debener,et al.  Source Localisation of Visual Evoked Potentials in Congenitally Deaf Individuals , 2013, Brain Topography.

[78]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[79]  R. Näätänen,et al.  A kind of auditory ‘primitive intelligence’ already present at birth , 2005, The European journal of neuroscience.

[80]  István Czigler,et al.  Visual temporal window of integration as revealed by the visual mismatch negativity event-related potential to stimulus omissions , 2006, Brain Research.

[81]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[82]  H. Neville,et al.  Altered Cross-Modal Processing in the Primary Auditory Cortex of Congenitally Deaf Adults: A Visual-Somatosensory fMRI Study with a Double-Flash Illusion , 2012, The Journal of Neuroscience.

[83]  L. Deouell The Frontal Generator of the Mismatch Negativity Revisited , 2007 .

[84]  Kensuke Sekihara,et al.  Localization bias and spatial resolution of adaptive and non-adaptive spatial filters for MEG source reconstruction , 2005, NeuroImage.

[85]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[86]  J. Pernier,et al.  Task-dependent activation latency in human visual extrastriate cortex , 2005, Neuroscience Letters.

[87]  Alison Abbott Costs of satellite camera threaten to push Europe out of the picture , 1996, Nature.

[88]  Ione Fine,et al.  Visual stimuli activate auditory cortex in the deaf , 2001, Nature Neuroscience.

[89]  Colline Poirier,et al.  Auditory motion perception activates visual motion areas in early blind subjects , 2006, NeuroImage.

[90]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. I. Normal hearing adults , 1987, Brain Research.

[91]  Anne Caclin,et al.  Audiovisual Events in Sensory Memory , 2007 .

[92]  Piia Astikainen,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Event-related Potentials to Task-irrelevant Changes in Facial Expressions Behavioral and Brain Functions Event-related Potentials to Task-irrelevant Changes in Facial Expressions , 2022 .

[93]  Xiaoping Hu,et al.  Neural processing underlying tactile microspatial discrimination in the blind: a functional magnetic resonance imaging study. , 2008, Journal of vision.

[94]  J. Pernier,et al.  Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. , 2002, Cerebral cortex.

[95]  G. Vandewalle,et al.  Functional specialization for auditory–spatial processing in the occipital cortex of congenitally blind humans , 2011, Proceedings of the National Academy of Sciences.

[96]  Pavel Zahorik,et al.  Decoding the direction of auditory motion in blind humans , 2011, NeuroImage.

[97]  István Winkler,et al.  Preattentive Binding of Auditory and Visual Stimulus Features , 2005, Journal of Cognitive Neuroscience.