An Application of Univariate and Multivariate Approaches in fMRI to Quantifying the Hemispheric Lateralization of Acoustic and Linguistic Processes

The question of hemispheric lateralization of neural processes is one that is pertinent to a range of subdisciplines of cognitive neuroscience. Language is often assumed to be left-lateralized in the human brain, but there has been a long running debate about the underlying reasons for this. We addressed this problem with fMRI by identifying the neural responses to amplitude and spectral modulations in speech and how these interact with speech intelligibility to test previous claims for hemispheric asymmetries in acoustic and linguistic processes in speech perception. We used both univariate and multivariate analyses of the data, which enabled us to both identify the networks involved in processing these acoustic and linguistic factors and to test the significance of any apparent hemispheric asymmetries. We demonstrate bilateral activation of superior temporal cortex in response to speech-derived acoustic modulations in the absence of intelligibility. However, in a contrast of amplitude-modulated and spectrally modulated conditions that differed only in their intelligibility (where one was partially intelligible and the other unintelligible), we show a left dominant pattern of activation in STS, inferior frontal cortex, and insula. Crucially, multivariate pattern analysis showed that there were significant differences between the left and the right hemispheres only in the processing of intelligible speech. This result shows that the left hemisphere dominance in linguistic processing does not arise because of low-level, speech-derived acoustic factors and that multivariate pattern analysis provides a method for unbiased testing of hemispheric asymmetries in processing.

[1]  Kenneth Hugdahl,et al.  Effective connectivity analysis demonstrates involvement of premotor cortex during speech perception , 2011, NeuroImage.

[2]  P. C. Pandey,et al.  The Journal of the Acoustical Society of America , 1939 .

[3]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[4]  D. Pisoni,et al.  Speech perception without traditional speech cues. , 1981, Science.

[5]  G. Flandin,et al.  Predicting Language Lateralization from Gray Matter , 2009, The Journal of Neuroscience.

[6]  Richard S. J. Frackowiak,et al.  Representation of the temporal envelope of sounds in the human brain. , 2000, Journal of neurophysiology.

[7]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[8]  M. Schönwiesner,et al.  Hemispheric asymmetry for spectral and temporal processing in the human antero‐lateral auditory belt cortex , 2005, The European journal of neuroscience.

[9]  L. Lisker “Voicing” in English: A Catalogue of Acoustic Features Signaling /b/ Versus /p/ in Trochees , 1986, Language and speech.

[10]  P T Parikh,et al.  Evaluation of Image Quality of a 32-Channel versus a 12-Channel Head Coil at 1.5T for MR Imaging of the Brain , 2011, American Journal of Neuroradiology.

[11]  D. J. Hermes,et al.  Vowel-onset detection by vowel-strength measurement, cochlear-nucleus simulation, and multilayer perceptrons. , 1996, The Journal of the Acoustical Society of America.

[12]  Sophie K. Scott,et al.  Hemispheric Asymmetries in Speech Perception: Sense, Nonsense and Modulations , 2011, PloS one.

[13]  S. Scott,et al.  The Pathways for Intelligible Speech: Multivariate and Univariate Perspectives , 2013, Cerebral cortex.

[14]  Sophie K. Scott,et al.  The neural processing of masked speech , 2013, Hearing Research.

[15]  R. Zatorre,et al.  Spectral and temporal processing in human auditory cortex. , 2001, Cerebral cortex.

[16]  Jochen Kaiser,et al.  Processing of spectral and amplitude envelope of animal vocalizations in the human auditory cortex , 2010, Neuropsychologia.

[17]  J B Poline,et al.  A cortical region sensitive to auditory spectral motion , 2000, Neuroreport.

[18]  Joachim Gross,et al.  Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension , 2012, Cerebral cortex.

[19]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[20]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[21]  J Bamford,et al.  The BKB (Bamford-Kowal-Bench) sentence lists for partially-hearing children. , 1979, British journal of audiology.

[22]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[23]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[24]  P. Matthews,et al.  Defining a left-lateralized response specific to intelligible speech using fMRI. , 2003, Cerebral cortex.

[25]  Alan R Palmer,et al.  Amplitude and frequency-modulated stimuli activate common regions of human auditory cortex. , 2003, Cerebral cortex.

[26]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[27]  Evan Balaban,et al.  Multivariate activation and connectivity patterns discriminate speech intelligibility in Wernicke's, Broca's, and Geschwind's areas. , 2013, Cerebral cortex.

[28]  Nikolaus Kriegeskorte,et al.  Comparison of multivariate classifiers and response normalizations for pattern-information fMRI , 2010, NeuroImage.

[29]  S. Scott,et al.  Functional Integration across Brain Regions Improves Speech Perception under Adverse Listening Conditions , 2007, The Journal of Neuroscience.

[30]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[31]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[32]  R. Weisskoff,et al.  Improved auditory cortex imaging using clustered volume acquisitions , 1999, Human brain mapping.

[33]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[34]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[35]  Sophie K. Scott,et al.  Do temporal processes underlie left hemisphere dominance in speech perception? , 2013, Brain and Language.

[36]  C Büchel,et al.  Brain regions involved in articulation , 1999, The Lancet.

[37]  Richard S. J. Frackowiak,et al.  Neurophysiological origin of human brain asymmetry for speech and language , 2010, Proceedings of the National Academy of Sciences.

[38]  R. Bowtell,et al.  “sparse” temporal sampling in auditory fMRI , 1999, Human brain mapping.

[39]  E. Jung,et al.  Improving the spatial accuracy in functional magnetic resonance imaging (fMRI) based on the blood oxygenation level dependent (BOLD) effect: benefits from parallel imaging and a 32-channel head array coil at 1.5 Tesla. , 2009, Clinical hemorheology and microcirculation.

[40]  I. Johnsrude,et al.  Spectral and temporal processing in human auditory cortex. , 2002, Cerebral cortex.

[41]  Patti Adank,et al.  Design choices in imaging speech comprehension: An Activation Likelihood Estimation (ALE) meta-analysis , 2012, NeuroImage.

[42]  D. D. Greenwood A cochlear frequency-position function for several species--29 years later. , 1990, The Journal of the Acoustical Society of America.

[43]  Richard S. J. Frackowiak,et al.  Endogenous Cortical Rhythms Determine Cerebral Specialization for Speech Perception and Production , 2007, Neuron.

[44]  Jonathan H. Venezia,et al.  Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. , 2010, Cerebral cortex.

[45]  Ferath Kherif,et al.  Does Semantic Context Benefit Speech Understanding through “Top–Down” Processes? Evidence from Time-resolved Sparse fMRI , 2011, Journal of Cognitive Neuroscience.

[46]  Jonas Obleser,et al.  Bilateral Speech Comprehension Reflects Differential Sensitivity to Spectral and Temporal Features , 2008, The Journal of Neuroscience.

[47]  Sophie K. Scott,et al.  The functional neuroanatomy of prelexical processing in speech perception , 2004, Cognition.

[48]  Christian E Stilp,et al.  Rapid efficient coding of correlated complex acoustic properties , 2010, Proceedings of the National Academy of Sciences.

[49]  Y. Samson,et al.  Lateralization of Speech and Auditory Temporal Processing , 1998, Journal of Cognitive Neuroscience.

[50]  David Poeppel,et al.  Feedforward and feedback in speech perception: Revisiting analysis by synthesis , 2011 .

[51]  S. Scott,et al.  A Common System for the Comprehension and Production of Narrative Speech , 2007, The Journal of Neuroscience.

[52]  Joseph T. Devlin,et al.  On-line plasticity in spoken sentence comprehension: Adapting to time-compressed speech , 2010, NeuroImage.

[53]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[54]  Sophie K. Scott,et al.  Cortical asymmetries in speech perception: what's wrong, what's right and what's left? , 2012, Trends in Cognitive Sciences.

[55]  A. Boemio,et al.  Hierarchical and asymmetric temporal sensitivity in human auditory cortices , 2005, Nature Neuroscience.

[56]  Kayoko Okada,et al.  Area Spt in the Human Planum Temporale Supports Sensory-motor Integration for Speech Processing Establishing the Existence of Distinct Sen- Sory versus Motor Activation Patterns Would Establish That , 2022 .

[57]  S. Scott,et al.  Inferior Frontal Gyrus Activation Predicts Individual Differences in Perceptual Learning of Cochlear-Implant Simulations , 2010, The Journal of Neuroscience.

[58]  Stuart Rosen,et al.  Neural correlates of intelligibility in speech investigated with noise vocoded speech--a positron emission tomography study. , 2006, The Journal of the Acoustical Society of America.

[59]  N. Dronkers A new brain region for coordinating speech articulation , 1996, Nature.

[60]  R. Poldrack Region of interest analysis for fMRI. , 2007, Social cognitive and affective neuroscience.

[61]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[62]  Willy Serniclaes,et al.  Neural correlates of switching from auditory to speech perception , 2005, NeuroImage.

[63]  David A. Medler,et al.  Cerebral Cortex doi:10.1093/cercor/bhi040 Cerebral Cortex Advance Access published February 9, 2005 , 2022 .

[64]  Pim van Dijk,et al.  Spectrotemporal features of the auditory cortex: the activation in response to dynamic ripples , 2003, NeuroImage.