Intracranial recordings from human auditory cortex reveal a neural population selective for song

How are neural representations of music organized in the human brain? While neuroimaging has suggested some segregation between responses to music and other sounds, it remains unclear whether finer-grained organization exists within the domain of music. To address this question, we measured cortical responses to natural sounds using intracranial recordings from human patients and inferred canonical response components using a data-driven decomposition algorithm. The inferred components replicated many prior findings including distinct neural selectivity for speech and music. Our key novel finding is that one component responded nearly exclusively to music with singing. Song selectivity was not explainable by standard acoustic features and was co-located with speech- and music-selective responses in the middle and anterior superior temporal gyrus. These results suggest that neural representations of music are fractionated into subpopulations selective for different types of music, at least one of which is specialized for the analysis of song.

[1]  Orrin Devinsky,et al.  Multiscale integration organizes hierarchical computation in human , 2020 .

[2]  Sam V. Norman-Haignere,et al.  Hierarchical integration across multiple timescales in human auditory cortex , 2020, bioRxiv.

[3]  Nancy Kanwisher,et al.  Music-selective neural populations arise without musical training , 2020, bioRxiv.

[4]  Josh H McDermott,et al.  Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex , 2018, bioRxiv.

[5]  J. Armony,et al.  Singing in the brain: Neural representation of music and voice as revealed by fMRI , 2018, Human brain mapping.

[6]  Erik Edwards,et al.  A Spatial Map of Onset and Sustained Responses to Speech in the Human Superior Temporal Gyrus , 2018, Current Biology.

[7]  Daniel L. K. Yamins,et al.  A Task-Optimized Neural Network Replicates Human Auditory Behavior, Predicts Brain Responses, and Reveals a Cortical Processing Hierarchy , 2018, Neuron.

[8]  J. Stein What is Developmental Dyslexia? , 2018, Brain sciences.

[9]  Surya Ganguli,et al.  Unsupervised Discovery of Demixed, Low-Dimensional Neural Dynamics across Multiple Timescales through Tensor Component Analysis , 2017, Neuron.

[10]  Max M. Krasnow,et al.  Parent-offspring conflict and the evolution of infant-directed song , 2017 .

[11]  M. Chait,et al.  Great expectations: Is there evidence for predictive coding in auditory cortex? , 2017, Neuroscience.

[12]  Michael A. Casey,et al.  Music of the 7Ts: Predicting and Decoding Multivoxel fMRI Responses with Acoustic, Schematic, and Categorical Music Features , 2017, Front. Psychol..

[13]  Kristofer E. Bouchard,et al.  Sparse coding of ECoG signals identifies interpretable components for speech control in human sensorimotor cortex , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Aniruddh D. Patel,et al.  Temporal modulations in speech and music , 2017, Neuroscience & Biobehavioral Reviews.

[15]  Isabelle Peretz,et al.  Neurobiology of Congenital Amusia , 2016, Trends in Cognitive Sciences.

[16]  Timothy J. O'Donnell,et al.  The Natural History of Song , 2016 .

[17]  Barbara Tillmann,et al.  Pitch-Responsive Cortical Regions in Congenital Amusia , 2016, The Journal of Neuroscience.

[18]  Andrew J. King,et al.  Measuring the Performance of Neural Models , 2016, Front. Comput. Neurosci..

[19]  Josh H. McDermott,et al.  Distinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition , 2015, Neuron.

[20]  Thomas E. Currie,et al.  Statistical universals reveal the structures and functions of human music , 2015, Proceedings of the National Academy of Sciences.

[21]  David Poeppel,et al.  The cortical analysis of speech-specific temporal structure revealed by responses to sound quilts , 2015, Nature Neuroscience.

[22]  I. Peretz,et al.  Neural overlap in processing music and speech , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  Arafat Angulo-Perkins,et al.  Music listening engages specific cortical regions within the temporal lobes: Differences between musicians and non-musicians , 2014, Cortex.

[24]  Keith Johnson,et al.  Phonetic Feature Encoding in Human Superior Temporal Gyrus , 2014, Science.

[25]  Essa Yacoub,et al.  Encoding of Natural Sounds at Multiple Spectral and Temporal Resolutions in the Human Auditory Cortex , 2014, PLoS Comput. Biol..

[26]  Josh H. McDermott,et al.  Cortical Pitch Regions in Humans Respond Primarily to Resolved Harmonics and Are Located in Specific Tonotopic Regions of Anterior Auditory Cortex , 2013, The Journal of Neuroscience.

[27]  Timothy D. Griffiths,et al.  A unified framework for the organization of the primate auditory cortex , 2013, Front. Syst. Neurosci..

[28]  D. Deutsch,et al.  Speech versus song: multiple pitch-sensitive areas revealed by a naturally occurring musical illusion. , 2013, Cerebral cortex.

[29]  Nancy Kanwisher,et al.  Sensitivity to musical structure in the human brain. , 2012, Journal of neurophysiology.

[30]  Gregory Hickok,et al.  Orthogonal acoustic dimensions define auditory field maps in human cortex , 2012, Proceedings of the National Academy of Sciences.

[31]  Robert J. Zatorre,et al.  Musical Training as a Framework for Brain Plasticity: Behavior, Function, and Structure , 2012, Neuron.

[32]  Elia Formisano,et al.  Processing of Natural Sounds in Human Auditory Cortex: Tonotopy, Spectral Tuning, and Relation to Voice Sensitivity , 2012, The Journal of Neuroscience.

[33]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[34]  A. Bartels,et al.  Coding of Melodic Gestalt in Human Auditory Cortex , 2012, Cerebral cortex.

[35]  M. Bangert,et al.  Perception of Words and Pitch Patterns in Song and Speech , 2012, Front. Psychology.

[36]  Michael A. Casey,et al.  Population Codes Representing Musical Timbre for High-Level fMRI Categorization of Music Genres , 2011, MLINI.

[37]  Richard S. J. Frackowiak,et al.  Human Primary Auditory Cortex Follows the Shape of Heschl's Gyrus , 2011, The Journal of Neuroscience.

[38]  Aniruddh D. Patel Language, music, and the brain: a resource-sharing framework , 2011 .

[39]  J. Maunsell,et al.  Different Origins of Gamma Rhythm and High-Gamma Activity in Macaque Visual Cortex , 2011, PLoS biology.

[40]  J. Rauschecker,et al.  Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category , 2010, The Journal of Neuroscience.

[41]  Alan Forster,et al.  Measuring performance , 2010, Canadian Medical Association Journal.

[42]  Colin Humphries,et al.  Tonotopic organization of human auditory cortex , 2010, NeuroImage.

[43]  N. Logothetis,et al.  Frequency-Band Coupling in Surface EEG Reflects Spiking Activity in Monkey Visual Cortex , 2009, Neuron.

[44]  M. Schönwiesner,et al.  Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI , 2009, Proceedings of the National Academy of Sciences.

[45]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[46]  Mitchell Steinschneider,et al.  Spectrotemporal analysis of evoked and induced electroencephalographic responses in primary auditory cortex (A1) of the awake monkey. , 2008, Cerebral cortex.

[47]  Powen Ru,et al.  Multiresolution spectrotemporal analysis of complex sounds. , 2005, The Journal of the Acoustical Society of America.

[48]  Andrew J Oxenham,et al.  A Neural Representation of Pitch Salience in Nonprimary Human Auditory Cortex Revealed with Functional Magnetic Resonance Imaging , 2004, The Journal of Neuroscience.

[49]  C. Schreiner,et al.  Short-term adaptation of auditory receptive fields to dynamic stimuli. , 2004, Journal of neurophysiology.

[50]  N. C. Singh,et al.  Modulation spectra of natural sounds and ethological theories of auditory processing. , 2003, The Journal of the Acoustical Society of America.

[51]  Thomas E. Nichols,et al.  Nonparametric Permutation Tests for Functional Neuroimaging , 2003 .

[52]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[53]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[54]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[55]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[56]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[57]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[58]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[59]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[60]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[61]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[62]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[63]  A. Lomax Folk Song Style and Culture , 1969 .

[64]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[65]  C. Spearman CORRELATION CALCULATED FROM FAULTY DATA , 1910 .

[66]  Mounya Elhilali,et al.  Modulation Representations for Speech and Music , 2019, Timbre: Acoustics, Perception, and Cognition.

[67]  B. Pennington,et al.  Developmental dyslexia. , 2015, Annual review of clinical psychology.

[68]  Konstantinos Tzanakakis,et al.  Measuring the Performance , 2013 .

[69]  Steven Brown,et al.  The Origins of Music: Edited by Nils L. Wallin, Björn Merker, and Steven Brown, Cambridge, MA: The MIT Press, 2000, xii+ 498 pages, ISBN 0-262-23206-5, US$60.00 , 2000 .

[70]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .