Neuronal populations in the occipital cortex of the blind synchronize to the temporal dynamics of speech

The occipital cortex of early blind individuals (EB) activates during speech processing, challenging the notion of a hard-wired neurobiology of language. But, at what stage of speech processing do occipital regions participate in EB?Here we demonstrate that parieto-occipital regions in EB enhance their synchronization to acoustic fluctuations in human speech in the theta-range (corresponding to syllabic rate), irrespective of speech intelligibility. Crucially, enhanced synchronization to the intelligibility of speech was selectively observed in primary visual cortex in EB, suggesting that this region is at the interface between speech perception and comprehension. Moreover, EB showed overall enhanced functional connectivity between temporal and occipital cortices sensitive to speech intelligibility and altered directionality when compared to the sighted group. These findings suggest that the occipital cortex of the blind adopts an architecture allowing the tracking of speech material, and therefore does not fully abstract from the reorganized sensory inputs it receives.

[1]  Matthew H. Davis,et al.  Neural Oscillations Carry Speech Rhythm through to Comprehension , 2012, Front. Psychology.

[2]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[3]  D. Poeppel,et al.  Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex , 2007, Neuron.

[4]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[5]  D. Lewkowicz Infants' perception of the audible, visible, and bimodal attributes of multimodal syllables. , 2000, Child development.

[6]  M. Bedny,et al.  “Visual” Cortex of Congenitally Blind Adults Responds to Syntactic Movement , 2015, The Journal of Neuroscience.

[7]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[8]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[9]  M. Hauser,et al.  Five-month-old infants' identification of the sources of vocalizations , 2009, Proceedings of the National Academy of Sciences.

[10]  D. Maurer,et al.  Long-Lasting Crossmodal Cortical Reorganization Triggered by Brief Postnatal Visual Deprivation , 2015, Current Biology.

[11]  Ben Deen,et al.  Occipital Cortex of Blind Individuals Is Functionally Coupled with Executive Control Areas of Frontal Cortex , 2015, Journal of Cognitive Neuroscience.

[12]  D. Lewkowicz,et al.  The decline of cross-species intersensory perception in human infants. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Harold Burton,et al.  Recognition memory for Braille or spoken words: An fMRI study in early blind , 2012, Brain Research.

[14]  G. Burnstock,et al.  The expanding field of purinergic signalling , 2009, Trends in Neurosciences.

[15]  D. Lewkowicz,et al.  Three‐month‐old infants learn arbitrary auditory–visual pairings between voices and faces , 2001 .

[16]  J. Simon,et al.  Cortical entrainment to continuous speech: functional roles and interpretations , 2014, Front. Hum. Neurosci..

[17]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[18]  David S. Lorberbaum,et al.  Genetic evidence that Nkx2.2 acts primarily downstream of Neurog3 in pancreatic endocrine lineage development , 2017, eLife.

[19]  A. Woods,et al.  Context Modulates the Contribution of Time and Space in Causal Inference , 2012, Front. Psychology.

[20]  D. Lewkowicz Infant perception of audio-visual speech synchrony. , 2010, Developmental psychology.

[21]  V. Jousmäki,et al.  The pace of prosodic phrasing couples the listener's cortex to the reader's voice , 2013, Human brain mapping.

[22]  O. Jensen,et al.  Neuromagnetic localization of rhythmic activity in the human brain: a comparison of three methods , 2005, NeuroImage.

[23]  William D. Marslen-Wilson,et al.  Brain Network Connectivity During Language Comprehension: Interacting Linguistic and Perceptual Subsystems , 2014, Cerebral cortex.

[24]  N. Mesgarani,et al.  Selective cortical representation of attended speaker in multi-talker speech perception , 2012, Nature.

[25]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[26]  Gregor Thut,et al.  Lip movements entrain the observers’ low-frequency brain oscillations to facilitate speech intelligibility , 2016, eLife.

[27]  Jonathan H. Venezia,et al.  Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. , 2010, Cerebral cortex.

[28]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[29]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[30]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[31]  Noam Chomsky,et al.  Evolution, brain, and the nature of language , 2013, Trends in Cognitive Sciences.

[32]  Inga M. Schepers,et al.  Functionally specific oscillatory activity correlates between visual and auditory cortex in the blind. , 2012, Brain : a journal of neurology.

[33]  Franco Lepore,et al.  Auditory motion in the sighted and blind: Early visual deprivation triggers a large-scale imbalance between auditory and “visual” brain regions , 2016, NeuroImage.

[34]  Agnes Volein,et al.  Electrophysiological evidence of illusory audiovisual speech percept in human infants , 2008, Proceedings of the National Academy of Sciences.

[35]  Jean-Luc Schwartz,et al.  No, There Is No 150 ms Lead of Visual Speech on Auditory Speech, but a Range of Audiovisual Asynchronies Varying from Small Audio Lead to Large Audio Lag , 2014, PLoS Comput. Biol..

[36]  Jonas Obleser,et al.  Bilateral Speech Comprehension Reflects Differential Sensitivity to Spectral and Temporal Features , 2008, The Journal of Neuroscience.

[37]  A. Boemio,et al.  Hierarchical and asymmetric temporal sensitivity in human auditory cortices , 2005, Nature Neuroscience.

[38]  Stefano Panzeri,et al.  The Laminar and Temporal Structure of Stimulus Information in the Phase of Field Potentials of Auditory Cortex , 2011, The Journal of Neuroscience.

[39]  Virginie van Wassenhove,et al.  Speech through ears and eyes: interfacing the senses with the supramodal brain , 2013, Front. Psychol..

[40]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[41]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[42]  Jean-Francois Mangin,et al.  Hearing Faces: How the Infant Brain Matches the Face It Sees with the Speech It Hears , 2009, Journal of Cognitive Neuroscience.

[43]  Ione Fine,et al.  Early Blindness Results in Developmental Plasticity for Auditory Motion Processing within Auditory and Occipital Cortex , 2016, Front. Hum. Neurosci..

[44]  D. Poeppel,et al.  Auditory Cortex Tracks Both Auditory and Visual Stimulus Dynamics Using Low-Frequency Neuronal Phase Modulation , 2010, PLoS biology.

[45]  C. Büchel,et al.  Corticocortical Connections Mediate Primary Visual Cortex Responses to Auditory Stimulation in the Blind , 2010, The Journal of Neuroscience.

[46]  Alfonso Caramazza,et al.  Tool Selectivity in Left Occipitotemporal Cortex Develops without Vision , 2013, Journal of Cognitive Neuroscience.

[47]  J. Rauschecker,et al.  A Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind , 2000, The Journal of Neuroscience.

[48]  Y. Samson,et al.  Lateralization of Speech and Auditory Temporal Processing , 1998, Journal of Cognitive Neuroscience.

[49]  Colline Poirier,et al.  Auditory motion perception activates visual motion areas in early blind subjects , 2006, NeuroImage.

[50]  K. Müller,et al.  Robustly estimating the flow direction of information in complex physical systems. , 2007, Physical review letters.

[51]  Rufin VanRullen,et al.  Selective Perceptual Phase Entrainment to Speech Rhythm in the Absence of Spectral Energy Fluctuations , 2015, The Journal of Neuroscience.

[52]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[53]  Christian Büchel,et al.  Cortical hierarchy turned on its head , 2003, Nature Neuroscience.

[54]  D. Abrams,et al.  Right-Hemisphere Auditory Cortex Is Dominant for Coding Syllable Patterns in Speech , 2008, The Journal of Neuroscience.

[55]  D. Lewkowicz,et al.  Intersensory Perception at Birth: Newborns Match Nonhuman Primate Faces and Voices. , 2010, Infancy : the official journal of the International Society on Infant Studies.

[56]  R. Saxe,et al.  “Visual” Cortex Responds to Spoken Language in Blind Children , 2015, The Journal of Neuroscience.

[57]  H. Burton,et al.  Dissociating cortical regions activated by semantic and phonological tasks: a FMRI study in blind and sighted people. , 2003, Journal of neurophysiology.

[58]  D. Lewkowicz,et al.  Multisensory Processes: A Balancing Act across the Lifespan , 2016, Trends in Neurosciences.

[59]  Whitney M. Weikum,et al.  Visual Language Discrimination in Infancy , 2007, Science.

[60]  E. Bates,et al.  Language and the infant brain. , 1999, Journal of communication disorders.

[61]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[62]  Robin A. A. Ince,et al.  Frontal Top-Down Signals Increase Coupling of Auditory Low-Frequency Oscillations to Continuous Speech in Human Listeners , 2015, Current Biology.

[63]  R. Malach,et al.  Cortical activity during tactile exploration of objects in blind and sighted humans. , 2010, Restorative neurology and neuroscience.

[64]  Joachim Gross,et al.  Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension , 2012, Cerebral cortex.

[65]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[66]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[67]  D. Poeppel,et al.  Speech perception at the interface of neurobiology and linguistics , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[68]  H H Donaldson,et al.  LOCALIZATION IN THE BRAIN. , 1884, Science.

[69]  Vincent L. Gracco,et al.  Repetition Suppression for Speech Processing in the Associative Occipital and Parietal Cortex of Congenitally Blind Adults , 2013, PloS one.

[70]  G. Nolte The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. , 2003, Physics in medicine and biology.

[71]  Asif A. Ghazanfar,et al.  The Natural Statistics of Audiovisual Speech , 2009, PLoS Comput. Biol..

[72]  Marcelo A. Montemurro,et al.  Spike-Phase Coding Boosts and Stabilizes Information Carried by Spatial and Temporal Spike Patterns , 2009, Neuron.

[73]  M A Schmuckler,et al.  The McGurk effect in infants. , 1995, Perception & psychophysics.

[74]  P. Matthews,et al.  Defining a left-lateralized response specific to intelligible speech using fMRI. , 2003, Cerebral cortex.

[75]  M. Raichle,et al.  Adaptive changes in early and late blind: a FMRI study of verb generation to heard nouns. , 2002, Journal of neurophysiology.

[76]  A. Caramazza,et al.  Functional connectivity of visual cortex in the blind follows retinotopic organization principles , 2015, Brain : a journal of neurology.

[77]  M. Bedny Evidence from Blindness for a Cognitively Pluripotent Cortex , 2017, Trends in Cognitive Sciences.

[78]  Lucie Hertz-Pannier,et al.  Nature and nurture in language acquisition: anatomical and functional brain-imaging studies in infants , 2006, Trends in Neurosciences.

[79]  John J. Foxe,et al.  Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. , 2006, Cerebral cortex.

[80]  E. Bullmore,et al.  Activation of auditory cortex during silent lipreading. , 1997, Science.

[81]  Michael Don Palmer,et al.  Reflections on language , 1977 .

[82]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[83]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[84]  Amir Amedi,et al.  Origins of the specialization for letters and numbers in ventral occipitotemporal cortex , 2015, Trends in Cognitive Sciences.

[85]  E. Zohary,et al.  Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects , 2004, Nature Neuroscience.

[86]  Robin A A Ince,et al.  Irregular Speech Rate Dissociates Auditory Cortical Entrainment, Evoked Responses, and Frontal Alpha , 2015, The Journal of Neuroscience.

[87]  Elizabeth Bates,et al.  ON THE NATURE AND NURTURE OF LANGUAGE , 1999 .

[88]  Jan Kujala,et al.  The right hemisphere is highlighted in connected natural speech production and perception , 2017, NeuroImage.

[89]  Á. Pascual-Leone,et al.  Transcranial Magnetic Stimulation , 2014, Neuromethods.

[90]  Amir Amedi,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[91]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[92]  M. Lassonde,et al.  Cross-modal plasticity for the spatial processing of sounds in visually deprived subjects , 2008, Experimental Brain Research.

[93]  Michael S Beauchamp,et al.  Neural Correlates of Interindividual Differences in Children's Audiovisual Speech Perception , 2011, The Journal of Neuroscience.

[94]  David J. Lewkowicz,et al.  Infants' perception of the audible, visible and bimodal attributes of talking and singing faces , 1999, AVSP.

[95]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[96]  M. Raichle,et al.  Adaptive changes in early and late blind: a fMRI study of Braille reading. , 2002, Journal of neurophysiology.

[97]  U. Hasson,et al.  Structural neuroplasticity of the superior temporal plane in early and late blindness , 2017, Brain and Language.

[98]  Frédéric E Theunissen,et al.  The Hierarchical Cortical Organization of Human Speech Processing , 2017, The Journal of Neuroscience.

[99]  G. Vandewalle,et al.  Impact of blindness onset on the functional organization and the connectivity of the occipital cortex. , 2013, Brain : a journal of neurology.

[100]  Stefano Panzeri,et al.  Contributions of local speech encoding and functional connectivity to audio-visual speech perception , 2017, eLife.

[101]  Gregory B. Cogan,et al.  Visual Input Enhances Selective Speech Envelope Tracking in Auditory Cortex at a “Cocktail Party” , 2013, The Journal of Neuroscience.

[102]  A. Puce,et al.  Neuronal oscillations and visual amplification of speech , 2008, Trends in Cognitive Sciences.

[103]  H. Burton Visual Cortex Activity in Early and Late Blind People , 2003, The Journal of Neuroscience.

[104]  F. Rösler,et al.  Speech processing activates visual cortex in congenitally blind humans , 2002, The European journal of neuroscience.

[105]  Matthew H. Davis,et al.  Hierarchical Processing for Speech in Human Auditory Cortex and Beyond , 2010, Front. Hum. Neurosci..

[106]  P. Schyns,et al.  Speech Rhythms and Multiplexed Oscillatory Sensory Coding in the Human Brain , 2013, PLoS biology.

[107]  D. Lewkowicz,et al.  Infants deploy selective attention to the mouth of a talking face when learning speech , 2012, Proceedings of the National Academy of Sciences.

[108]  Ingrid S. Johnsrude,et al.  The role of domain-general frontal systems in language comprehension: Evidence from dual-task interference and semantic ambiguity , 2010, Brain and Language.

[109]  Alfonso Caramazza,et al.  Selectivity for large nonmanipulable objects in scene-selective visual cortex does not require visual experience , 2013, NeuroImage.

[110]  J. Werker,et al.  Two-month-old infants match phonetic information in lips and voice , 2003 .

[111]  Franco Lepore,et al.  Plasticity in Sensory Systems: Building the Brain in the Dark: Functional and Specific Crossmodal Reorganization in the Occipital Cortex of Blind Individuals , 2012 .

[112]  Matthew H. Davis,et al.  The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. , 2005, Cerebral cortex.

[113]  Uri Hasson,et al.  Congenital blindness is associated with large-scale reorganization of anatomical networks , 2016, NeuroImage.

[114]  G. Vandewalle,et al.  Functional specialization for auditory–spatial processing in the occipital cortex of congenitally blind humans , 2011, Proceedings of the National Academy of Sciences.

[115]  Tzipi Horowitz-Kraus,et al.  Right is not always wrong: DTI and fMRI evidence for the reliance of reading comprehension on language-comprehension networks in the right hemisphere , 2014, Brain Imaging and Behavior.

[116]  D. Lewkowicz,et al.  Narrowing of intersensory speech perception in infancy , 2009, Proceedings of the National Academy of Sciences.

[117]  A. Meltzoff,et al.  The bimodal perception of speech in infancy. , 1982, Science.