Enhanced audio–visual interactions in the auditory cortex of elderly cochlear-implant users

Auditory deprivation and the restoration of hearing via a cochlear implant (CI) can induce functional plasticity in auditory cortical areas. How these plastic changes affect the ability to integrate combined auditory (A) and visual (V) information is not yet well understood. In the present study, we used electroencephalography (EEG) to examine whether age, temporary deafness and altered sensory experience with a CI can affect audio-visual (AV) interactions in post-lingually deafened CI users. Young and elderly CI users and age-matched NH listeners performed a speeded response task on basic auditory, visual and audio-visual stimuli. Regarding the behavioral results, a redundant signals effect, that is, faster response times to cross-modal (AV) than to both of the two modality-specific stimuli (A, V), was revealed for all groups of participants. Moreover, in all four groups, we found evidence for audio-visual integration. Regarding event-related responses (ERPs), we observed a more pronounced visual modulation of the cortical auditory response at N1 latency (approximately 100 ms after stimulus onset) in the elderly CI users when compared with young CI users and elderly NH listeners. Thus, elderly CI users showed enhanced audio-visual binding which may be a consequence of compensatory strategies developed due to temporary deafness and/or degraded sensory input after implantation. These results indicate that the combination of aging, sensory deprivation and CI facilitates the coupling between the auditory and the visual modality. We suggest that this enhancement in multisensory interactions could be used to optimize auditory rehabilitation, especially in elderly CI users, by the application of strong audio-visually based rehabilitation strategies after implant switch-on.

[1]  A. Büchner,et al.  Audio-Tactile Integration in Congenitally and Late Deaf Cochlear Implant Users , 2014, PloS one.

[2]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[3]  R. Labadie,et al.  Cochlear Implant Performance in Senior Citizens , 2000, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[4]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[5]  David Friedman,et al.  An event-related potential study of age-related changes in sensitivity to stimulus deviance , 1998, Neurobiology of Aging.

[6]  B Kollmeier,et al.  Development and evaluation of a German sentence test for objective and subjective speech intelligibility assessment. , 1997, The Journal of the Acoustical Society of America.

[7]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[8]  A. Bacciu,et al.  Speech recognition in elderly cochlear implant recipients. , 2003, Clinical otolaryngology and allied sciences.

[9]  S. Debener,et al.  Visuo-tactile interactions in the congenitally deaf: a behavioral and event-related potential study , 2015, Front. Integr. Neurosci..

[10]  S. Debener,et al.  Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. , 2012, Brain : a journal of neurology.

[11]  Eric Truy,et al.  Imaging Plasticity in Cochlear Implant Patients , 2001, Audiology and Neurotology.

[12]  Daniel Brandeis,et al.  Human central auditory plasticity associated with tone sequence learning. , 2004, Learning & memory.

[13]  S. Birge,et al.  Clock Completion: An Objective Screening Test for Dementia , 1993, Journal of the American Geriatrics Society.

[14]  M. Giard,et al.  Changes in Early Cortical Visual Processing Predict Enhanced Reactivity in Deaf Individuals , 2011, PloS one.

[15]  D. Raab DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[16]  J. A. Pruszynski,et al.  Neural correlates , 2023 .

[17]  Franco Lepore,et al.  Multisensory gain within and across hemispaces in simple and choice reaction time paradigms , 2011, Experimental Brain Research.

[18]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[19]  H. Djalilian,et al.  Cochlear Implantation in the Elderly: Results and Quality-of-Life Assessment , 2002, The Annals of otology, rhinology, and laryngology.

[20]  Ding Jinhong,et al.  An event-related potential study of memory encoding , 2003 .

[21]  T. Sejnowski,et al.  Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion , 2007, The Journal of Neuroscience.

[22]  S. Debener,et al.  Rapid bilateral improvement in auditory cortex activity in postlingually deafened adults following cochlear implantation , 2015, Clinical Neurophysiology.

[23]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[24]  C. Thiel,et al.  Age-related hearing loss increases cross-modal distractibility , 2014, Hearing Research.

[25]  J. Guillemot,et al.  Temporary Deafness Can Impair Multisensory Integration , 2013, Psychological science.

[26]  Ione Fine,et al.  Visual stimuli activate auditory cortex in the deaf , 2001, Nature Neuroscience.

[27]  Karl-Heinz Hahlbrock,et al.  Sprachaudiometie Grundlagen und Pratische Anwendung Einer Sprachaudiometric f??r das Deutsche Sprachgebiet , 1957 .

[28]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[29]  J. Morris,et al.  The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part I. Clinical and neuropsychological assesment of Alzheimer's disease , 1989, Neurology.

[30]  L. Abbott,et al.  The Plastic Human Brain Cortex , 2007 .

[31]  John J. Foxe,et al.  Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness , 2011, NeuroImage.

[32]  Virginie van Wassenhove,et al.  Auditory-visual fusion in speech perception in children with cochlear implants. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[33]  R. Ratcliff Group reaction time distributions and an analysis of distribution statistics. , 1979, Psychological bulletin.

[34]  J. Allen,et al.  Loudness growth in 1/2-octave bands (LGOB)--a procedure for the assessment of loudness. , 1990, The Journal of the Acoustical Society of America.

[35]  Francesco Pavani,et al.  Visual change detection recruits auditory cortices in early deafness , 2014, NeuroImage.

[36]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[37]  Christoph Kayser,et al.  Behavioral/systems/cognitive Functional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex , 2022 .

[38]  C. Barnes,et al.  Neural plasticity in the ageing brain , 2006, Nature Reviews Neuroscience.

[39]  R. Hari,et al.  Auditory evoked transient and sustained magnetic fields of the human brain localization of neural generators , 1980, Experimental Brain Research.

[40]  J. Nadol,et al.  Patterns of neural degeneration in the human cochlea and auditory nerve: implications for cochlear implantation. , 1997, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[41]  N. Kraus,et al.  Audiovisual Deficits in Older Adults with Hearing Loss: Biological Evidence , 2009, Ear and hearing.

[42]  Gnau Fb,et al.  Cochlear implant. , 1985, ASHA.

[43]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[44]  Jacek Smurzynski,et al.  Temporal resolution in young and elderly subjects as measured by mismatch negativity and a psychoacoustic gap detection task , 2002, Clinical Neurophysiology.

[45]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[46]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[47]  P. Barone,et al.  Visual activity predicts auditory recovery from deafness after adult cochlear implantation. , 2013, Brain : a journal of neurology.

[48]  Rolf Ulrich,et al.  Testing the race model inequality: An algorithm and computer programs , 2007, Behavior research methods.

[49]  S. Debener,et al.  Late auditory evoked potentials asymmetry revisited , 2007, Clinical Neurophysiology.

[50]  Jeannette R. Mahoney,et al.  Multisensory integration across the senses in young and old adults , 2011, Brain Research.

[51]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[52]  Erich Schröger,et al.  Filter Effects and Filter Artifacts in the Analysis of Electrophysiological Data , 2012, Front. Psychology.

[53]  B. Fraysse,et al.  Evidence that cochlear-implanted deaf patients are better multisensory integrators , 2007, Proceedings of the National Academy of Sciences.

[54]  S. Waltzman,et al.  The Effects of Cochlear Implantation on Speech Perception in Older Adults , 2011, Journal of the American Geriatrics Society.

[55]  F. Pavani,et al.  Response speed advantage for vision does not extend to touch in early deaf adults , 2014, Experimental Brain Research.

[56]  M. Kilgard,et al.  Environmental enrichment improves response strength, threshold, selectivity, and latency of auditory cortex neurons. , 2004, Journal of neurophysiology.

[57]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[58]  D. Barth,et al.  The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex , 1995, Brain Research.

[59]  Richard S. J. Frackowiak,et al.  Cross-Modal Plasticity Underpins Language Recovery after Cochlear Implantation , 2001, Neuron.

[60]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[61]  D. Raab Statistical facilitation of simple reaction times. , 1962, Transactions of the New York Academy of Sciences.

[62]  Michael S Beauchamp,et al.  See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex , 2005, Current Opinion in Neurobiology.

[63]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[64]  Lutz Jäncke,et al.  Evaluation of evoked potentials to dyadic tones after cochlear implantation. , 2009, Brain : a journal of neurology.

[65]  Larry W. Thompson,et al.  Auditory averaged evoked potentials and aging: Factors of stimulus, task and topography , 1980, Biological Psychology.

[66]  Kensuke Sekihara,et al.  Localization bias and spatial resolution of adaptive and non-adaptive spatial filters for MEG source reconstruction , 2005, NeuroImage.

[67]  T. Eichele,et al.  Neurophysiological evidence of impaired musical sound perception in cochlear-implant users , 2010, Clinical Neurophysiology.

[68]  Paul J Laurienti,et al.  Age-related multisensory enhancement in a simple audiovisual detection task , 2007, Neuroreport.

[69]  Anu Sharma,et al.  Cross-Modal Re-Organization in Adults with Early Stage Hearing Loss , 2014, PloS one.

[70]  J. Nadol,et al.  Diameter of the Cochlear Nerve in Deaf Humans: Implications for Cochlear Implantation , 1992, The Annals of otology, rhinology, and laryngology.

[71]  B Fraysse,et al.  Increased audiovisual integration in cochlear‐implanted deaf patients: independent components analysis of longitudinal positron emission tomography data , 2015, The European journal of neuroscience.

[72]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[73]  Gregory Hickok,et al.  Visual stimuli activate auditory cortex in deaf subjects: evidence from MEG , 2003, Neuroreport.

[74]  F. Zeng Loudness growth in forward masking: relation to intensity discrimination. , 1994, The Journal of the Acoustical Society of America.

[75]  M. Lichtenstein Hearing and visual impairments. , 1992, Clinics in geriatric medicine.

[76]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[77]  Michael Gaebler,et al.  Phonological processing in post-lingual deafness and cochlear implant outcome , 2010, NeuroImage.

[78]  N. Weisz,et al.  Revisiting the adaptive and maladaptive effects of crossmodal plasticity , 2014, Neuroscience.

[79]  R J Glynn,et al.  Survival of Spiral Ganglion Cells in Profound Sensorineural Hearing Loss: Implications for Cochlear Implantation , 1989, The Annals of otology, rhinology, and laryngology.

[80]  Stefan Debener,et al.  Uncovering auditory evoked potentials from cochlear implant users with independent component analysis. , 2011, Psychophysiology.

[81]  C. Muchnik,et al.  Neural Correlates of Auditory-Cognitive Processing in Older Adult Cochlear Implant Recipients , 2015, Audiology and Neurotology.

[82]  C Shawn Green,et al.  Increasing Speed of Processing With Action Video Games , 2009, Current directions in psychological science.

[83]  C Pantev,et al.  Dynamics of auditory plasticity after cochlear implantation: a longitudinal study. , 2006, Cerebral cortex.

[84]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[85]  J. Faubert,et al.  Larger effect of aging on the perception of higher-order stimuli , 2000, Vision Research.

[86]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[87]  G. Csibra,et al.  Age and inter-stimulus interval effects on event-related potentials to frequent and infrequent auditory stimuli , 1992, Biological Psychology.

[88]  F. Mauguière,et al.  Revisiting the oddball paradigm. Non-target vs neutral stimuli and the evaluation of ERP attentional effects , 1992, Neuropsychologia.

[89]  J. Ford,et al.  Age-related changes in auditory event-related potentials. , 1980, Electroencephalography and clinical neurophysiology.

[90]  Jeremy D. Thorne,et al.  Visual movement perception in deaf and hearing individuals , 2013, Advances in cognitive psychology.

[91]  Martin Meyer,et al.  Age-related differences in auditory evoked potentials as a function of task modulation during speech–nonspeech processing , 2013, Brain and behavior.

[92]  D. Woods,et al.  Auditory selective attention in middle-aged and elderly subjects: an event-related brain potential study. , 1992, Electroencephalography and clinical neurophysiology.

[93]  M. Dorman,et al.  The influence of a sensitive period for auditory-visual integration in children with cochlear implants. , 2010, Restorative neurology and neuroscience.

[94]  M. Merzenich,et al.  Brain plasticity-based therapeutics , 2014, Front. Hum. Neurosci..

[95]  Antígona Martínez,et al.  Effect of Attention on Early Cortical Processes Associated with the Sound-induced Extra Flash Illusion , 2010, Journal of Cognitive Neuroscience.

[96]  I. Hochmair-Desoyer,et al.  The HSM sentence test as a tool for evaluating the speech understanding in noise of cochlear implant users. , 1997, The American journal of otology.

[97]  E. Juratovac,et al.  Age-Related Changes , 2017 .

[98]  Anna Grabowska,et al.  Response inhibition of children with ADHD in the stop-signal task: an event-related potential study. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[99]  Daniel J. Lee,et al.  Differential cochlear implant outcomes in older adults , 2013, The Laryngoscope.

[100]  Daniel A. Braun,et al.  Assessing randomness and complexity in human motion trajectories through analysis of symbolic sequences , 2014, Front. Hum. Neurosci..

[101]  J. Morris,et al.  The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part XIII. , 1996, Neurology.

[102]  David R Friedland,et al.  Case-control analysis of cochlear implant performance in elderly patients. , 2010, Archives of otolaryngology--head & neck surgery.

[103]  Micah M. Murray,et al.  Early, Low-Level Auditory-Somatosensory Multisensory Interactions Impact Reaction Time Speed , 2009, Front. Integr. Neurosci..

[104]  Lutz Jäncke,et al.  Electrical brain imaging reveals spatio-temporal dynamics of timbre perception in humans , 2006, NeuroImage.

[105]  Jay T Rubinstein,et al.  Music perception in cochlear implant users and its relationship with psychophysical capabilities. , 2008, Journal of rehabilitation research and development.

[106]  N. Nusbaum Aging and sensory senescence. , 1999, Southern medical journal.

[107]  A. Beynon,et al.  Pre-, Per- and Postoperative Factors Affecting Performance of Postlinguistically Deaf Adults Using Cochlear Implants: A New Conceptual Model over Time , 2012, PloS one.