Reading with Sounds: Sensory Substitution Selectively Activates the Visual Word Form Area in the Blind

Using a visual-to-auditory sensory-substitution algorithm, congenitally fully blind adults were taught to read and recognize complex images using "soundscapes"--sounds topographically representing images. fMRI was used to examine key questions regarding the visual word form area (VWFA): its selectivity for letters over other visual categories without visual experience, its feature tolerance for reading in a novel sensory modality, and its plasticity for scripts learned in adulthood. The blind activated the VWFA specifically and selectively during the processing of letter soundscapes relative to both textures and visually complex object categories and relative to mental imagery and semantic-content controls. Further, VWFA recruitment for reading soundscapes emerged after 2 hr of training in a blind adult on a novel script. Therefore, the VWFA shows category selectivity regardless of input sensory modality, visual experience, and long-term familiarity or expertise with the script. The VWFA may perform a flexible task-specific rather than sensory-specific computation, possibly linking letter shapes to phonology.

[1]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[2]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[3]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[4]  Rafael Malach,et al.  Large-Scale Mirror-Symmetry Organization of Human Occipito-Temporal Object Areas , 2003, Neuron.

[5]  Bruce D. McCandliss,et al.  Development of neural systems for reading. , 2007, Annual review of neuroscience.

[6]  Stanislas Dehaene,et al.  Specialization within the ventral stream: the case for the visual word form area , 2004, NeuroImage.

[7]  R. Malach,et al.  Negative BOLD Differentiates Visual Imagery and Perception , 2005, Neuron.

[8]  A. Amedi,et al.  The large-scale organization of "visual" streams emerges without visual experience. , 2012, Cerebral cortex.

[9]  H. Lyytinen,et al.  Brain sensitivity to print emerges when children learn letter–speech sound correspondences , 2010, Proceedings of the National Academy of Sciences.

[10]  Brian A Wandell,et al.  White matter pathways in reading , 2007, Current Opinion in Neurobiology.

[11]  K. Grill-Spector,et al.  Differential development of high-level visual cortex correlates with category-specific recognition memory , 2007, Nature Neuroscience.

[12]  Daphne Bavelier,et al.  Removing Brakes on Adult Brain Plasticity: From Molecular to Behavioral Interventions , 2010, The Journal of Neuroscience.

[13]  Bradford Z. Mahon,et al.  What drives the organization of object knowledge in the brain? , 2011, Trends in Cognitive Sciences.

[14]  Alex R. Wade,et al.  Long-term deprivation affects visual perception and cortex , 2003, Nature Neuroscience.

[15]  Bruce D. McCandliss,et al.  Development of Visual Expertise for Reading: Rapid Emergence of Visual Familiarity for an Artificial Script , 2010, Developmental neuropsychology.

[16]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Gui Xue,et al.  Language experience shapes fusiform activation when processing a logographic artificial language: An fMRI training study , 2006, NeuroImage.

[18]  Bradford Z. Mahon,et al.  Concepts and categories: a cognitive neuropsychological perspective. , 2009, Annual review of psychology.

[19]  Brenda Rapp,et al.  The orthography-specific functions of the left fusiform gyrus: Evidence of modality and category specificity , 2010, Cortex.

[20]  Amir Amedi,et al.  ‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution , 2012, PloS one.

[21]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[22]  Brian A. Wandell,et al.  The Development of Cortical Sensitivity to Visual Word Forms , 2011, Journal of Cognitive Neuroscience.

[23]  Kuniyoshi L Sakai,et al.  Learning letters in adulthood: direct visualization of cortical plasticity for forming a new link between orthography and phonology. , 2004, Neuron.

[24]  Brian A. Wandell,et al.  Position sensitivity in the visual word form area , 2012, Proceedings of the National Academy of Sciences.

[25]  S. Dehaene,et al.  Beyond Hemispheric Dominance: Brain Regions Underlying the Joint Lateralization of Language and Arithmetic to the Left Hemisphere , 2010, Journal of Cognitive Neuroscience.

[26]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[27]  Brian A. Wandell,et al.  Visual Feature-Tolerance in the Reading Network , 2011, Neuron.

[28]  Ethan M. Meyers,et al.  Visual Parsing After Recovery From Blindness , 2009, Psychological science.

[29]  W. Schneider,et al.  Cross‐cultural effect on the brain revisited: Universal structures plus writing system variation , 2005, Human brain mapping.

[30]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[31]  Amir Amedi,et al.  Neurophysiological Mechanisms Underlying Plastic Changes and Rehabilitation following Sensory Loss in Blindness and Deafness , 2012 .

[32]  T. Nazir,et al.  Developing normal reading skills: aspects of the visual processes underlying word recognition. , 2000, Journal of experimental child psychology.

[33]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[34]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[35]  S. Dehaene,et al.  The unique role of the visual word form area in reading , 2011, Trends in Cognitive Sciences.

[36]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[37]  S. Lomber,et al.  Cross-modal plasticity in specific auditory cortices underlies visual compensations in the deaf , 2010, Nature Neuroscience.

[38]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[39]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[40]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[41]  Andreas Kleinschmidt,et al.  Specialization for written words over objects in the visual cortex , 2011, NeuroImage.

[42]  L. Merabet,et al.  Neural reorganization following sensory loss: the opportunity of change , 2010, Nature Reviews Neuroscience.

[43]  D. Maurer,et al.  Amblyopia: background to the special issue on stroke recovery. , 2012, Developmental psychobiology.

[44]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[45]  M. Raichle,et al.  Adaptive changes in early and late blind: a fMRI study of Braille reading. , 2002, Journal of neurophysiology.

[46]  S. Dehaene,et al.  How Learning to Read Changes the Cortical Networks for Vision and Language , 2010, Science.

[47]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[48]  L. Merabet,et al.  The plastic human brain cortex. , 2005, Annual review of neuroscience.

[49]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[50]  Stanislas Dehaene,et al.  Distinct unimodal and multimodal regions for word processing in the left temporal cortex , 2004, NeuroImage.

[51]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[52]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[53]  Thomas A Zeffiro,et al.  Development of neural mechanisms for reading , 2003, Nature Neuroscience.

[54]  Stanislas Dehaene,et al.  Reading normal and degraded words: Contribution of the dorsal and ventral visual pathways , 2008, NeuroImage.

[55]  D. Maurer,et al.  Multiple sensitive periods in human visual development: evidence from visually deprived children. , 2005, Developmental psychobiology.

[56]  Russell A. Poldrack,et al.  The Neural Substrates of Visual Perceptual Learning of Words: Implications for the Visual Word Form Area Hypothesis , 2007, Journal of Cognitive Neuroscience.

[57]  B. Wandell The neurobiological basis of seeing words , 2011, Annals of the New York Academy of Sciences.

[58]  Justin L. Vincent,et al.  Intrinsic functional architecture in the anaesthetized monkey brain , 2007, Nature.

[59]  Marcin Szwed,et al.  Unconsciously deciphering handwriting: Subliminal invariance for handwritten words in the visual word form area , 2010, NeuroImage.

[60]  J. Rauschecker,et al.  Phoneme and word recognition in the auditory ventral stream , 2012, Proceedings of the National Academy of Sciences.

[61]  C. Price,et al.  The Interactive Account of ventral occipitotemporal contributions to reading , 2011, Trends in Cognitive Sciences.

[62]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[63]  S. Dehaene,et al.  Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. , 2002, Brain : a journal of neurology.

[64]  S. Dehaene,et al.  The visual word form area: a prelexical representation of visual words in the fusiform gyrus , 2002, Neuroreport.

[65]  Tali Bitan,et al.  Effects of alphabeticality, practice and type of instruction on reading an artificial script: an fMRI study. , 2005, Brain research. Cognitive brain research.

[66]  E. Warrington,et al.  Lasting Effects of Early Blindness a Case Study , 1974, The Quarterly journal of experimental psychology.

[67]  M. Sereno,et al.  Dissociation of Sensitivity to Spatial Frequency in Word and Face Preferential Areas of the Fusiform Gyrus , 2011, Cerebral cortex.

[68]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[69]  F. Lepore,et al.  Crossmodal plasticity in sensory loss. , 2011, Progress in brain research.

[70]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[71]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[72]  Karl J. Friston,et al.  How Many Subjects Constitute a Study? , 1999, NeuroImage.

[73]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[74]  A. Amedi,et al.  The brain as a flexible task machine: implications for visual rehabilitation using noninvasive vs. invasive approaches. , 2012, Current opinion in neurology.

[75]  D. Hubel,et al.  SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE. , 1963, Journal of neurophysiology.

[76]  Urs Maurer,et al.  Auditory Selective Attention to Speech Modulates Activity in the Visual Word Form Area , 2009, Cerebral cortex.