Representations of Invariant Musical Categories Are Decodable by Pattern Analysis of Locally Distributed BOLD Responses in Superior Temporal and Intraparietal Sulci.

In categorical perception (CP), continuous physical signals are mapped to discrete perceptual bins: mental categories not found in the physical world. CP has been demonstrated across multiple sensory modalities and, in audition, for certain over-learned speech and musical sounds. The neural basis of auditory CP, however, remains ambiguous, including its robustness in nonspeech processes and the relative roles of left/right hemispheres; primary/nonprimary cortices; and ventral/dorsal perceptual processing streams. Here, highly trained musicians listened to 2-tone musical intervals, which they perceive categorically while undergoing functional magnetic resonance imaging. Multivariate pattern analyses were performed after grouping sounds by interval quality (determined by frequency ratio between tones) or pitch height (perceived noncategorically, frequency ratios remain constant). Distributed activity patterns in spheres of voxels were used to determine sound sample identities. For intervals, significant decoding accuracy was observed in the right superior temporal and left intraparietal sulci, with smaller peaks observed homologously in contralateral hemispheres. For pitch height, no significant decoding accuracy was observed, consistent with the non-CP of this dimension. These results suggest that similar mechanisms are operative for nonspeech categories as for speech; espouse roles for 2 segregated processing streams; and support hierarchical processing models for CP.

[1]  R. Zatorre Category-boundary effects and speeded sorting with a harmonic musical-interval continuum: evidence for dual processing. , 1983, Journal of experimental psychology. Human perception and performance.

[2]  W. D. Ward,et al.  Categorical perception--phenomenon or epiphenomenon: evidence from experiments in the perception of melodic musical intervals. , 1978, The Journal of the Acoustical Society of America.

[3]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[4]  Richard Granger,et al.  Investigation of melodic contour processing in the brain using multivariate pattern-based fMRI , 2011, NeuroImage.

[5]  David A. Medler,et al.  Cerebral Cortex doi:10.1093/cercor/bhi040 Cerebral Cortex Advance Access published February 9, 2005 , 2022 .

[6]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[7]  Stefan Pollmann,et al.  PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data , 2009, Neuroinformatics.

[8]  Norman J. Lass,et al.  Speech and Language: Advances in Basic Research and Practice , 1979 .

[9]  David Poeppel,et al.  What Does the Right Hemisphere Know about Phoneme Categories? , 2011, Journal of Cognitive Neuroscience.

[10]  E. Formisano,et al.  Auditory Cortex Encodes the Perceptual Interpretation of Ambiguous Sound , 2011, The Journal of Neuroscience.

[11]  D. Pisoni Auditory short-term memory and vowel perception , 1975, Memory & cognition.

[12]  Arjan van Hessen,et al.  The end of categorical perception as we know it , 2003, Speech Commun..

[13]  Alan C. Evans,et al.  Event-Related fMRI of the Auditory Cortex , 1998, NeuroImage.

[14]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[15]  R. Zatorre,et al.  Identification, discrimination, and selective adaptation of simultaneous musical intervals , 1979 .

[16]  M. Bornstein,et al.  Discrimination and matching within and between hues measured by reaction times: some implications for categorical perception and levels of information processing , 1984, Psychological research.

[17]  N. Kriegeskorte,et al.  Revealing representational content with pattern-information fMRI--an introductory guide. , 2009, Social cognitive and affective neuroscience.

[18]  Jody C Culham,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Reveals the Neural Substrates of Arm Transport and Grip Formation in Reach-to-Grasp Actions in Humans , 2010 .

[19]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[20]  D. Massaro,et al.  Categorical results do not imply categorical perception , 1982, Perception & psychophysics.

[21]  Robert J. Zatorre,et al.  A role for the right superior temporal sulcus in categorical perception of musical chords , 2011, Neuropsychologia.

[22]  Paul E. Downing,et al.  A comparison of volume-based and surface-based multi-voxel pattern analysis , 2011, NeuroImage.

[23]  Russell A. Poldrack,et al.  Analyses of regional-average activation and multivoxel pattern information tell complementary stories , 2012, Neuropsychologia.

[24]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[25]  Robert J. Zatorre,et al.  Repetition Suppression in Auditory–Motor Regions to Pitch and Temporal Structure in Music , 2013, Journal of Cognitive Neuroscience.

[26]  B. Repp Categorical Perception: Issues, Methods, Findings , 1984 .

[27]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[28]  Kayoko Okada,et al.  Area Spt in the Human Planum Temporale Supports Sensory-motor Integration for Speech Processing Establishing the Existence of Distinct Sen- Sory versus Motor Activation Patterns Would Establish That , 2022 .

[29]  M Studdert-Kennedy,et al.  Selective anchoring and adaptation of phonetic and nonphonetic continua. , 1978, The Journal of the Acoustical Society of America.

[30]  Noël Staeren,et al.  Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex , 2009, Current Biology.

[31]  Rajeev D. S. Raizada,et al.  Selective Amplification of Stimulus Differences during Categorical Processing of Speech , 2007, Neuron.

[32]  Alan C. Evans,et al.  A general statistical analysis for fMRI data , 2000, NeuroImage.

[33]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[34]  Emily B. Myers,et al.  Inferior Frontal Regions Underlie the Perception of Phonetic Category Invariance , 2009, Psychological science.

[35]  M. Turvey,et al.  The motor theory of speech perception reviewed , 2006, Psychonomic bulletin & review.

[36]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[37]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[38]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[39]  Lori L. Holt,et al.  Expertise with Artificial Nonspeech Sounds Recruits Speech-Sensitive Cortical Regions , 2009, The Journal of Neuroscience.

[40]  Leslie G. Ungerleider,et al.  Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys , 1982, Behavioural Brain Research.

[41]  Janaina Mourão Miranda,et al.  The impact of temporal compression and space selection on SVM analysis of single-subject and multi-subject fMRI data , 2006, NeuroImage.

[42]  R. Zatorre,et al.  A role for the intraparietal sulcus in transforming musical pitch information. , 2010, Cerebral cortex.

[43]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[44]  Bruce D. McCandliss,et al.  Brain mechanisms implicated in the preattentive categorization of speech sounds revealed using FMRI and a short-interval habituation trial paradigm. , 2007, Cerebral cortex.

[45]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[46]  Emily B. Myers,et al.  An event-related fMRI investigation of voice-onset time discrimination , 2008, NeuroImage.

[47]  E. Formisano,et al.  Learning of New Sound Categories Shapes Neural Response Patterns in Human Auditory Cortex , 2012, The Journal of Neuroscience.

[48]  Richard Granger,et al.  Categorical Speech Processing in Broca's Area: An fMRI Study Using Multivariate Pattern-Based Analysis , 2012, The Journal of Neuroscience.

[49]  N. Kanwisher,et al.  Neuroimaging of cognitive functions in human parietal cortex , 2001, Current Opinion in Neurobiology.