Natural music evokes correlated EEG responses reflecting temporal structure and beat

The brain activity of multiple subjects has been shown to synchronize during salient moments of natural stimuli, suggesting that correlation of neural responses indexes a brain state operationally termed 'engagement'. While past electroencephalography (EEG) studies have considered both auditory and visual stimuli, the extent to which these results generalize to music-a temporally structured stimulus for which the brain has evolved specialized circuitry-is less understood. Here we investigated neural correlation during natural music listening by recording EEG responses from N=48 adult listeners as they heard real-world musical works, some of which were temporally disrupted through shuffling of short-term segments (measures), reversal, or randomization of phase spectra. We measured correlation between multiple neural responses (inter-subject correlation) and between neural responses and stimulus envelope fluctuations (stimulus-response correlation) in the time and frequency domains. Stimuli retaining basic musical features, such as rhythm and melody, elicited significantly higher behavioral ratings and neural correlation than did phase-scrambled controls. However, while unedited songs were self-reported as most pleasant, time-domain correlations were highest during measure-shuffled versions. Frequency-domain measures of correlation (coherence) peaked at frequencies related to the musical beat, although the magnitudes of these spectral peaks did not explain the observed temporal correlations. Our findings show that natural music evokes significant inter-subject and stimulus-response correlations, and suggest that the neural correlates of musical 'engagement' may be distinct from those of enjoyment.

[1]  Lucas C. Parra,et al.  Correlated Components Analysis - Extracting Reliable Dimensions in Multivariate Data , 2018, Neurons, Behavior, Data analysis, and Theory.

[2]  Lucas C. Parra,et al.  Action enhances perception: Visually evoked neural responses are enhanced when engaging in a motor task , 2019 .

[3]  Christopher J. Honey,et al.  Selective and Invariant Neural Responses to Spoken and Written Narratives , 2013, The Journal of Neuroscience.

[4]  Lucas C. Parra,et al.  EEG in the classroom: Synchronised neural recordings during video presentation , 2016, Scientific Reports.

[5]  G. Madison,et al.  Repeated Listening Increases the Liking for Music Regardless of Its Complexity: Implications for the Appreciation and Aesthetics of Music , 2017, Front. Neurosci..

[6]  K. S. Moore,et al.  A systematic review on the neural effects of music on emotion regulation: implications for music therapy practice. , 2013, Journal of music therapy.

[7]  David J. Heeger,et al.  The neural processing of hierarchical structure in music and speech at different timescales , 2015, Front. Neurosci..

[8]  G. Curio,et al.  ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song , 2014, Front. Hum. Neurosci..

[9]  Robert T. Knight,et al.  Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing , 2014, NeuroImage.

[10]  Jan W. H. Schnupp,et al.  Frequency tagging cannot measure neural tracking of beat or meter , 2019, Proceedings of the National Academy of Sciences.

[11]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[12]  Parag Chordia,et al.  Inter‐subject synchronization of brain responses during natural music listening , 2013, The European journal of neuroscience.

[13]  H. C. Li,et al.  Enhanced Cortical Connectivity in Absolute Pitch Musicians: A Model for Local Hyperconnectivity , 2011, Journal of Cognitive Neuroscience.

[14]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[15]  Jason J. Ki,et al.  Attention Strongly Modulates Reliability of Neural Responses to Naturalistic Narrative Stimuli , 2016, The Journal of Neuroscience.

[16]  D. Tucker Spatial sampling of head electrical fields: the geodesic sensor net. , 1993, Electroencephalography and clinical neurophysiology.

[17]  John J. Foxe,et al.  Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG. , 2015, Cerebral cortex.

[18]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[19]  Mikko Sams,et al.  Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm , 2012, NeuroImage.

[20]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[21]  Mark Levy Improving Perceptual Tempo Estimation with Crowd-Sourced Annotations , 2011, ISMIR.

[22]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[23]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[24]  E. Basar,et al.  Gamma, alpha, delta, and theta oscillations govern cognitive processes. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  L. Parra,et al.  Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses , 2016, eNeuro.

[26]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[27]  Björn Herrmann,et al.  What can we learn about beat perception by comparing brain signals and stimulus envelopes? , 2017, PloS one.

[28]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[29]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[30]  Patrik Vuilleumier,et al.  Temporal dynamics of musical emotions examined through intersubject synchrony of brain activity. , 2015, Social cognitive and affective neuroscience.

[31]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[32]  Robin I. M. Dunbar,et al.  Music and social bonding: “self-other” merging and neurohormonal mechanisms , 2014, Front. Psychol..

[33]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[34]  Michael H. Thaut,et al.  Neurologic Music Therapy in Stroke Rehabilitation , 2014, Current Physical Medicine and Rehabilitation Reports.

[35]  E. Bigand,et al.  Music, emotion, and time perception: the influence of subjective emotional valence and arousal? , 2013, Front. Psychol..

[36]  Jonathan Berger,et al.  Neurophysiological and Behavioral Measures of Musical Engagement , 2016 .

[37]  Daniel J. Levitin,et al.  The rewards of music listening: Response and physiological connectivity of the mesolimbic system , 2005, NeuroImage.

[38]  Jacek Dmochowski,et al.  NMED-T: A Tempo-Focused Dataset of Cortical and Behavioral Responses to Naturalistic Music , 2017, ISMIR.

[39]  Theiler,et al.  Generating surrogate data for time series with several simultaneously measured variables. , 1994, Physical review letters.

[40]  D. Ellis Beat Tracking by Dynamic Programming , 2007 .

[41]  Fred L. Bookstein,et al.  Comparing Covariance Matrices by Relative Eigenanalysis, with Applications to Organismal Biology , 2013, Evolutionary Biology.

[42]  Anne-Sophie Homassel,et al.  Neuropsychological functioning, age, and medication adherence in bipolar disorder , 2017, PloS one.

[43]  T. Picton,et al.  Human Cortical Responses to the Speech Envelope , 2008, Ear and hearing.

[44]  Benjamin Nagari Music as Image: Analytical psychology and music in film , 2015 .

[45]  Isabelle Peretz,et al.  Tagging the Neuronal Entrainment to Beat and Meter , 2011, The Journal of Neuroscience.

[46]  Mireille Besson,et al.  Words and Melody Are Intertwined in Perception of Sung Words: EEG and Behavioral Evidence , 2010, PloS one.

[47]  Lucas C. Parra,et al.  Visually evoked responses are enhanced when engaging in a video game , 2019 .

[48]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[49]  Lucas C. Parra,et al.  Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity , 2017, NeuroImage.

[50]  Jacek Dmochowski,et al.  Maximally reliable spatial filtering of steady state visual evoked potentials , 2014, NeuroImage.

[51]  Vinod Menon,et al.  Musical structure is processed in “language” areas of the brain: a possible role for Brodmann Area 47 in temporal coherence , 2003, NeuroImage.

[52]  Anders Friberg,et al.  Expressive Timing Facilitates the Neural Processing of Phrase Boundaries in Music: Evidence from Event-Related Potentials , 2013, PloS one.

[53]  John J. Foxe,et al.  Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution , 2010, The European journal of neuroscience.

[54]  Jacek Dmochowski,et al.  Decoding Neurally Relevant Musical Features Using Canonical Correlation Analysis , 2017, ISMIR.

[55]  Michael Fell,et al.  Lyrics-based Analysis and Classification of Music , 2014, COLING.

[56]  L. Parra,et al.  Human Neuroscience Original Research Article Correlated Components of Ongoing Eeg Point to Emotionally Laden Attention – a Possible Marker of Engagement? , 2022 .

[57]  Riitta Hari,et al.  Intersubject consistency of cortical MEG signals during movie viewing , 2014, NeuroImage.

[58]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[59]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[60]  Jason Farquhar,et al.  Shared processing of perception and imagery of music in decomposed EEG , 2013, NeuroImage.

[61]  Shakuntala Rao,et al.  The Globalization of Bollywood: An Ethnography of Non-Elite Audiences in India , 2007 .

[62]  J. Stephen Downie,et al.  When Lyrics Outperform Audio for Music Mood Classification: A Feature Analysis , 2010, ISMIR.

[63]  Isabelle Peretz,et al.  Selective Neuronal Entrainment to the Beat and Meter Embedded in a Musical Rhythm , 2012, The Journal of Neuroscience.

[64]  P. Marler,et al.  Singing in the brain. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Lucas C Parra,et al.  Music synchronizes brainwaves across listeners with strong effects of repetition, familiarity and training , 2019, Scientific Reports.

[66]  Gabriel Curio,et al.  Multi-Variate EEG Analysis as a Novel Tool to Examine Brain Responses to Naturalistic Music Stimuli , 2015, PloS one.

[67]  Shawn Malley Indiana Jones and the Kingdom of the Crystal Skull , 2018, Excavating the Future.

[68]  Jonathan Berger,et al.  Neural Dynamics of Event Segmentation in Music: Converging Evidence for Dissociable Ventral and Dorsal Networks , 2007, Neuron.

[69]  D. Coakley,et al.  Investigating the Enhancing Effect of Music on Autobiographical Memory in Mild Alzheimer’s Disease , 2006, Dementia and Geriatric Cognitive Disorders.

[70]  G. Norman Likert scales, levels of measurement and the “laws” of statistics , 2010, Advances in health sciences education : theory and practice.

[71]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[72]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[73]  Jason Farquhar,et al.  Name that tune: Decoding music from the listening brain , 2011, NeuroImage.

[74]  F. E. Maus,et al.  Music as Narrative , 1991 .

[75]  Peter E. Keller,et al.  Neural tracking of the musical beat is enhanced by low-frequency sounds , 2018, Proceedings of the National Academy of Sciences.

[76]  Alexandros Tsaptsinos Lyrics-Based Music Genre Classification Using a Hierarchical Attention Network , 2017, ISMIR.

[77]  Tzyy-Ping Jung,et al.  Extended ICA Removes Artifacts from Electroencephalographic Recordings , 1997, NIPS.

[78]  Jonathan Berger,et al.  NATURALISTIC MUSIC EEG DATASET—HINDI (NMED-H) 2.0: NEW RELEASE AND CROSS-DATASET COMPATIBILITY , 2019 .

[79]  Lucas C. Parra,et al.  Divergent neural responses to narrative speech in disorders of consciousness , 2017, Annals of clinical and translational neurology.

[80]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[81]  I. Peretz,et al.  Singing in the Brain: Independence of Lyrics and Tunes , 1998 .

[82]  Sylvie Nozaradan,et al.  Exploring how musical rhythm entrains brain activity with electroencephalogram frequency-tagging , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[83]  Lucas C Parra,et al.  Engaging narratives evoke similar neural activity and lead to similar time perception , 2017, bioRxiv.

[84]  James J. Kellaris,et al.  The influence of music on consumers' temporal perceptions: Does time fly when you're having fun? , 1992 .

[85]  John S. Johnson,et al.  Audience preferences are predicted by temporal reliability of neural processing , 2014, Nature Communications.