Decoding Visual Location From Neural Patterns in the Auditory Cortex of the Congenitally Deaf

Sensory cortices of individuals who are congenitally deprived of a sense can exhibit considerable plasticity and be recruited to process information from the senses that remain intact. Here, we explored whether the auditory cortex of congenitally deaf individuals represents visual field location of a stimulus—a dimension that is represented in early visual areas. We used functional MRI to measure neural activity in auditory and visual cortices of congenitally deaf and hearing humans while they observed stimuli typically used for mapping visual field preferences in visual cortex. We found that the location of a visual stimulus can be successfully decoded from the patterns of neural activity in auditory cortex of congenitally deaf but not hearing individuals. This is particularly true for locations within the horizontal plane and within peripheral vision. These data show that the representations stored within neuroplastically changed auditory cortex can align with dimensions that are typically represented in visual cortex.

[1]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[2]  Yusuke Murayama,et al.  Attention But Not Awareness Modulates the BOLD Signal in the Human V1 During Binocular Suppression , 2011, Science.

[3]  A. Kral,et al.  Absence of cross-modal reorganization in the primary auditory cortex of congenitally deaf cats , 2003, Experimental Brain Research.

[4]  M. Sur,et al.  A map of visual space induced in primary auditory cortex. , 1990, Science.

[5]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[6]  Stephen G Lomber,et al.  Modified areal cartography in auditory cortex following early- and late-onset deafness. , 2014, Cerebral cortex.

[7]  S. Lomber,et al.  Crossmodal reorganization in the early deaf switches sensory, but not behavioral roles of auditory cortex , 2011, Proceedings of the National Academy of Sciences.

[8]  Karen R. Dobkins,et al.  Visual Field Asymmetries for Motion Processing in Deaf and Hearing Signers , 2002, Brain and Cognition.

[9]  Á. Pascual-Leone,et al.  Tactile spatial resolution in blind Braille readers , 2000, Neurology.

[10]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults , 1987, Brain Research.

[11]  Reynolds Hn,et al.  Effects of foveal stimulation on peripheral visual processing and laterality in deaf and hearing subjects. , 1993 .

[12]  Zhaoping Li,et al.  Neural Activities in V1 Create a Bottom-Up Saliency Map , 2012, Neuron.

[13]  Robert J. Zatorre,et al.  Reorganization of Auditory Cortex in Early-deaf People: Functional Connectivity and Relationship to Hearing Aid Use , 2015, Journal of Cognitive Neuroscience.

[14]  H. Neville,et al.  Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language , 1987, Brain Research.

[15]  Ione Fine,et al.  Comparing the Effects of Auditory Deprivation and Sign Language within the Auditory and Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[16]  S. Debener,et al.  Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. , 2012, Brain : a journal of neurology.

[17]  L. Krubitzer,et al.  Multisensory plasticity in congenitally deaf mice: How are cortical areas functionally specified? , 2006, Neuroscience.

[18]  H N Reynolds Effects of foveal stimulation on peripheral visual processing and laterality in deaf and hearing subjects. , 1993, The American journal of psychology.

[19]  H. Neville,et al.  Altered Cross-Modal Processing in the Primary Auditory Cortex of Congenitally Deaf Adults: A Visual-Somatosensory fMRI Study with a Double-Flash Illusion , 2012, The Journal of Neuroscience.

[20]  R. Hartmann,et al.  Response of the primary auditory cortex to electrical stimulation of the auditory nerve in the congenitally deaf white cat , 1997, Hearing Research.

[21]  L. Aitkin,et al.  Azimuthal sensitivity of neurons in primary auditory cortex of cats. II. Organization along frequency-band strips. , 1990, Journal of neurophysiology.

[22]  Andrej Kral,et al.  Reorganization of the Connectivity of Cortical Field DZ in Congenitally Deaf Cat , 2013, PloS one.

[23]  Hanna Damasio,et al.  Predicting visual stimuli on the basis of activity in auditory cortices , 2010, Nature Neuroscience.

[24]  S. Lomber,et al.  Cross-modal plasticity in specific auditory cortices underlies visual compensations in the deaf , 2010, Nature Neuroscience.

[25]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[26]  K. Hashikawa,et al.  Sign language ‘heard’ in the auditory cortex , 1999, Nature.

[27]  Helen J. Neville,et al.  Enhanced peripheral visual processing in congenitally deaf humans is supported by multiple brain regions, including primary auditory cortex , 2014, Front. Hum. Neurosci..

[28]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[29]  Bryan R. Conroy,et al.  A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex , 2011, Neuron.

[30]  D. L. Stewart,et al.  Absence of visually influenced cells in auditory cortex of normal and congenitally deaf cats. , 1970, Experimental neurology.

[31]  Ione Fine,et al.  Visual stimuli activate auditory cortex in the deaf , 2001, Nature Neuroscience.

[32]  Richard S. J. Frackowiak,et al.  Human Primary Auditory Cortex Follows the Shape of Heschl's Gyrus , 2011, The Journal of Neuroscience.

[33]  D. Poeppel,et al.  Sensory mapping in a congenitally deaf subject: MEG and fRMI studies of cross‐modal non‐plasticity , 1997, Human brain mapping.

[34]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[35]  S. Levänen,et al.  Vibration-induced auditory-cortex activation in a congenitally deaf adult , 1998, Current Biology.

[36]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[37]  Lars Muckli,et al.  Decoding Sound and Imagery Content in Early Visual Cortex , 2014, Current Biology.

[38]  S. Levänen,et al.  Feeling vibrations: enhanced tactile sensitivity in congenitally deaf humans , 2001, Neuroscience Letters.

[39]  J. Duyn,et al.  Investigation of Low Frequency Drift in fMRI Signal , 1999, NeuroImage.

[40]  O. Andreassen,et al.  Mice Deficient in Cellular Glutathione Peroxidase Show Increased Vulnerability to Malonate, 3-Nitropropionic Acid, and 1-Methyl-4-Phenyl-1,2,5,6-Tetrahydropyridine , 2000, The Journal of Neuroscience.

[41]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[42]  C. Hutton,et al.  Visual Attention to the Periphery Is Enhanced in Congenitally Deaf Individuals , 2000, The Journal of Neuroscience.

[43]  Alan C. Evans,et al.  Interhemispheric anatomical differences in human primary auditory cortex: probabilistic mapping and volume measurement from magnetic resonance scans. , 1996, Cerebral cortex.

[44]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[45]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[46]  E. Knudsen,et al.  Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of auditory space in the barn owl , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  S. Lomber,et al.  Somatosensory and visual crossmodal plasticity in the anterior auditory field of early-deaf cats , 2011, Hearing Research.

[48]  A. Cowey,et al.  Early Auditory Processing in Area V5/MT+ of the Congenitally Blind Brain , 2013, The Journal of Neuroscience.

[49]  Marlene C. Richter,et al.  Retinotopic Organization and Functional Subdivisions of the Human Lateral Geniculate Nucleus: A High-Resolution Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[50]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. I. Normal hearing adults , 1987, Brain Research.

[51]  Roy H. Hamilton,et al.  Tactile spatial resolution in blind Braille readers1 , 2000 .