How vision matters for individuals with hearing loss

Hearing loss has obvious implications for communication and auditory functioning. A less obvious implication of hearing loss is its effect on the remaining sensory systems, particularly vision. This paper will review research demonstrating that deafness affects the development of specific visual functions and their neural substrates, including motion processing, face processing, and attention to peripheral space. Implications of this cross-modal plasticity are discussed in a review of studies with cochlear implant recipients. This latter work suggests that visual speech perception skills that develop during periods of deafness have positive implications for later perception of auditory speech. These effects are discussed in light of multimodal processing and perceptual learning.

[1]  K. Dobkins,et al.  Visual contrast sensitivity in deaf versus hearing populations: exploring the perceptual consequences of auditory deprivation and experience with a visual language. , 2001, Brain research. Cognitive brain research.

[2]  Karen Emmorey,et al.  Enhanced Facial Diserimination: Effects of Experience With American Sign Language , 1997 .

[3]  Diane C. Lillo-Martin,et al.  Enhancement of Spatial Cognition in Deaf Children , 1990 .

[4]  Linda B. Smith,et al.  Audition and visual attention: the developmental trajectory in deaf and hearing populations. , 1998, Developmental psychology.

[5]  David B Pisoni,et al.  Development of Audiovisual Comprehension Skills in Prelingually Deaf Children With Cochlear Implants , 2005, Ear and hearing.

[6]  Ursula Bellugi,et al.  Faces: The Relationship Between Language and Affect , 1990 .

[7]  Helen J. Neville,et al.  Asynchronies in the Development of Electrophysiological Responses to Motion and Color , 2004, Journal of Cognitive Neuroscience.

[8]  G. Recanzone Auditory influences on visual temporal rate perception. , 2003, Journal of neurophysiology.

[9]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[10]  H. Neville,et al.  Effects of Age and Experience on the Development of Neurocognitive Systems , 2003 .

[11]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[12]  Karen R. Dobkins,et al.  Visual Field Asymmetries for Motion Processing in Deaf and Hearing Signers , 2002, Brain and Cognition.

[13]  R. Zatorre,et al.  A Functional Neuroimaging Study of Sound Localization: Visual Cortex Activity Predicts Performance in Early-Blind Individuals , 2005, PLoS biology.

[14]  Aina Puce,et al.  Electrophysiology and brain imaging of biological motion. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  Kevin R. Gregg,et al.  SLA volume 17 issue 1 Cover and Front matter , 1995, Studies in Second Language Acquisition.

[16]  Ruxandra Sireteanu,et al.  Do Deaf People See Better? Texture Segmentation and Visual Search Compensate in Adult but Not in Juvenile Subjects , 1999, Journal of Cognitive Neuroscience.

[17]  David B Pisoni,et al.  Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. , 2003, Journal of speech, language, and hearing research : JSLHR.

[18]  Margot J. Taylor,et al.  Face Recognition Memory and Configural Processing: A Developmental ERP Study using Upright, Inverted, and Contrast-Reversed Faces , 2004, Journal of Cognitive Neuroscience.

[19]  Elissa L. Newport,et al.  The acquisition of American Sign Language. , 1985 .

[20]  Antígona Martínez,et al.  Hemispneric asymmetries in global and local processing: evidence from fMRI , 1997, Neuroreport.

[21]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[22]  H. Neville,et al.  Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language , 1987, Brain Research.

[23]  Daphne Bavelier,et al.  Motion velocity thresholds in deaf signers: changes in lateralization but not in overall sensitivity. , 2004, Brain research. Cognitive brain research.

[24]  J. Rauschecker,et al.  Auditory compensation for early blindness in cat cerebral cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  H Summala,et al.  Auditory processing in visual brain areas of the early blind: evidence from event-related potentials. , 1993, Electroencephalography and clinical neurophysiology.

[26]  D. Ashmead,et al.  Visual attention in children with normal hearing, children with hearing aids, and children with cochlear implants. , 2002, Journal of speech, language, and hearing research : JSLHR.

[27]  M. Dorman,et al.  Early Cochlear Implantation in Children Allows Normal Development of Central Auditory Pathways , 2002, The Annals of otology, rhinology & laryngology. Supplement.

[28]  Lawrence R. Frank,et al.  Functional MRI of Global and Local Processing in Children , 2002, NeuroImage.

[29]  R. P. Meier,et al.  Language Acquisition by Deaf Children , 1991 .

[30]  Karen R. Dobkins,et al.  Left-Hemisphere Dominance for Motion Processing in Deaf Signers , 1999 .

[31]  Karl J. Friston,et al.  A direct demonstration of functional specialization in human visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  M. Dorman,et al.  The influence of a sensitive period on central auditory development in children with unilateral and bilateral cochlear implants , 2005, Hearing Research.

[33]  J. Atkinson,et al.  Normal and anomalous development of visual motion processing: motion coherence and ‘dorsal-stream vulnerability’ , 2003, Neuropsychologia.

[34]  P. Sinha,et al.  Effects of early experience on children's recognition of facial displays of emotion. , 2002, Developmental psychology.

[35]  M. Lassonde,et al.  Cross-modal reorganization and speech perception in cochlear implant users. , 2006, Brain : a journal of neurology.

[36]  J. Atkinson,et al.  Visual and visuospatial development in young children with Williams syndrome , 2001, Developmental medicine and child neurology.

[37]  M A Schmuckler,et al.  The McGurk effect in infants. , 1995, Perception & psychophysics.

[38]  D. Scott Perceptual learning. , 1974, Queen's nursing journal.

[39]  P. Alku,et al.  The role of blind humans’ visual cortex in auditory change detection , 2005, Neuroscience Letters.

[40]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[41]  R. Yin Looking at Upside-down Faces , 1969 .

[42]  J. Morton,et al.  Developmental Neurocognition: Speech and Face Processing in the First Year of Life , 2008 .

[43]  Hyejin Kang,et al.  Preoperative differences of cerebral metabolism relate to the outcome of cochlear implants in congenitally deaf children , 2005, Hearing Research.

[44]  Wing Hong Lore,et al.  Central and peripheral visual processing in hearing and nonhearing individuals , 1991 .

[45]  A. Giraud,et al.  Cortical activity at rest predicts cochlear implantation outcome. , 2007, Cerebral cortex.

[46]  Richard S. J. Frackowiak,et al.  Cross-Modal Plasticity Underpins Language Recovery after Cochlear Implantation , 2001, Neuron.

[47]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[48]  D. Maurer,et al.  Neuroperception: Early visual experience and face processing , 2001, Nature.

[49]  O. Andreassen,et al.  Mice Deficient in Cellular Glutathione Peroxidase Show Increased Vulnerability to Malonate, 3-Nitropropionic Acid, and 1-Methyl-4-Phenyl-1,2,5,6-Tetrahydropyridine , 2000, The Journal of Neuroscience.

[50]  Margot J. Taylor,et al.  ERP evidence of developmental changes in processing of faces , 1999, Clinical Neurophysiology.

[51]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[52]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[53]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. I. Normal hearing adults , 1987, Brain Research.

[54]  T. Mitchell,et al.  Multimethod study of attention and behavior problems in hearing-impaired children , 1996 .

[55]  A. Cowey,et al.  Human cortical magnification factor and its relation to visual acuity , 2004, Experimental Brain Research.

[56]  FRANK MORRELL,et al.  Visual System's View of Acoustic Space , 1972, Nature.

[57]  J. Rauschecker,et al.  Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans , 1999, Nature Neuroscience.

[58]  Kevin J. Riggs,et al.  Motion processing in autism: evidence for a dorsal stream deficiency , 2000, Neuroreport.

[59]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[60]  D. Pisoni,et al.  ON SPOKEN LANGUAGE PROCESSING Progress Report No . 26 ( 2003-2004 ) Indiana University Development of Visual Attention Skills in Prelingually Deaf Children Who Use Cochlear Implants , 2004 .

[61]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[62]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[64]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[65]  U. Bellugi,et al.  The acquisition of conditionals in American Sign Language: Grammaticized facial expressions , 1990, Applied Psycholinguistics.

[66]  Ione Fine,et al.  Visual stimuli activate auditory cortex in the deaf , 2001, Nature Neuroscience.

[67]  S. Carey,et al.  From piecemeal to configurational representation of faces. , 1977, Science.

[68]  S. Hillyard,et al.  Improved auditory spatial tuning in blind humans , 1999, Nature.

[69]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[70]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[71]  D. Maurer,et al.  Multiple sensitive periods in human visual development: evidence from visually deprived children. , 2005, Developmental psychobiology.

[72]  Eric Truy,et al.  The contribution of visual areas to speech comprehension: a PET study in cochlear implants patients and normal-hearing subjects , 2002, Neuropsychologia.

[73]  T. Allison,et al.  Brain Activity Evoked by the Perception of Human Walking: Controlling for Meaningful Coherent Motion , 2003, The Journal of Neuroscience.

[74]  Ila Parasnis,et al.  Parafoveal attention in congenitally deaf and hearing young adults , 1985, Brain and Cognition.

[75]  H. Scheich,et al.  Invasion of visual cortex by the auditory system in the naturally blind mole rat , 1991, Neuroreport.

[76]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults , 1987, Brain Research.

[77]  Olivier Pascalis,et al.  Hemispheric Differences in Face Processing and Brain Maturation , 1993 .

[78]  J. Rauschecker,et al.  Auditory Localization Behaviour in Visually Deprived Cats , 1994, The European journal of neuroscience.

[79]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[80]  E. DeYoe,et al.  Graded effects of spatial and featural attention on human area MT and associated motion processing areas. , 1997, Journal of neurophysiology.

[81]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[82]  David P Corina,et al.  Recognition of affective and noncanonical linguistic facial expressions in hearing and deaf subjects , 1989, Brain and Cognition.

[83]  G. Maccarthy,et al.  Physiological studies of face processing in humans , 2000 .

[84]  Craig J. Brozinsky,et al.  Impact of Early Deafness and Early Exposure to Sign Language on the Cerebral Organization for Motion Processing , 2001, The Journal of Neuroscience.

[85]  Linda B. Smith,et al.  The Impact of Audition on the Development of Visual Attention , 1994 .

[86]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[87]  G. Recanzone Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[88]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[89]  D. Maurer,et al.  Configural Face Processing Develops more Slowly than Featural Face Processing , 2002, Perception.

[90]  Brigitte Röder,et al.  Hearing Cheats Touch, but Less in Congenitally Blind Than in Sighted Individuals , 2004, Psychological science.

[91]  M. Dorman,et al.  A Sensitive Period for the Development of the Central Auditory System in Children with Cochlear Implants: Implications for Age of Implantation , 2002, Ear and hearing.

[92]  Virginie van Wassenhove,et al.  Auditory-visual fusion in speech perception in children with cochlear implants. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[93]  Steven A Hillyard,et al.  Auditory deprivation affects processing of motion, but not color. , 2002, Brain research. Cognitive brain research.

[94]  M. Sereno,et al.  Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. , 2005, Brain research. Cognitive brain research.

[95]  J. Horton,et al.  The representation of the visual field in human striate cortex. A revision of the classic Holmes map. , 1991, Archives of ophthalmology.

[96]  C. Hutton,et al.  Visual Attention to the Periphery Is Enhanced in Congenitally Deaf Individuals , 2000, The Journal of Neuroscience.

[97]  T. Nikolopoulos,et al.  Age at Implantation: Its Importance in Pediatric Cochlear Implantation , 1999, The Laryngoscope.

[98]  Ione Fine,et al.  Comparing the Effects of Auditory Deprivation and Sign Language within the Auditory and Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[99]  D. Horn,et al.  Behavioral Inhibition and Clinical Outcomes in Children with Cochlear Implants , 2005, The Laryngoscope.

[100]  D. Bavelier,et al.  Changes in the Spatial Distribution of Visual Attention after Early Deafness , 2002, Journal of Cognitive Neuroscience.

[101]  V. Samar,et al.  Does deafness lead to enhancement of visual spatial cognition in children? Negative evidence from deaf nonsigners. , 1996, Journal of deaf studies and deaf education.

[102]  J. Rovamo,et al.  An estimation and application of the human cortical magnification factor , 2004, Experimental Brain Research.

[103]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[104]  J. S. Lee,et al.  Deafness: Cross-modal plasticity and cochlear implants , 2001, Nature.