Neurophysiological and Behavioral Measures of Musical Engagement

Inter-subject correlations (ISCs) of cortical responses have been shown to index audience engagement with narrative works. In parallel lines of research, continuous self-reports and physiological measures have linked listener engagement and arousal with specific musical events. Here we combine EEG-ISCs, physiological responses, and continuous self-reports to assess listener engagement and arousal in response to a full-length musical excerpt. The temporal resolution of these measures permits connections to be drawn among them, and also to corresponding musical events in the stimulus. Simultaneous 128-channel EEG, ECG, and respiratory inductive plethysmography were recorded from 13 musicians who heard the first movement of Elgar’s E-Minor Cello Concerto in original and reversed conditions. Continuous self-reports of engagement with each excerpt were collected in a separate listen. ISCs of EEG responses were computed in the subspace of its maximally correlated component. Temporally resolved measures of activity and synchrony were computed from heart rate, respiratory rate, respiratory amplitude, and continuous behavioral responses. Results indicate that all but one of the response measures (heart rate activity) achieves statistical significance over the course of the original excerpt. Furthermore, regions of statistical significance can be linked to salient musical events. Finally, activity and synchrony of a given physiological or behavioral response at times occur in alternation, highlighting the utility of considering both measures. These findings constitute a first step toward relating EEG-based measures of engagement to physiology and behavior, while also helping to further disentangle engagement and arousal.

[1]  P. Gomez,et al.  Affective and physiological responses to environmental noises and music. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  Emery Schubert Modeling Perceived Emotion With Continuous Musical Features , 2004 .

[3]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[4]  P. Gomez,et al.  Relationships between musical structure and psychophysiological measures of emotion. , 2007, Emotion.

[5]  S. Koelsch,et al.  Effects of Unexpected Chords and of Performer's Expression on Brain Responses and Electrodermal Activity , 2008, PloS one.

[6]  A. Norcia,et al.  TOWARD AN OBJECTIVE MEASURE OF LISTENER ENGAGEMENT WITH NATURAL MUSIC USING INTER-SUBJECT EEG CORRELATION , 2014 .

[7]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[8]  John M. Geringer,et al.  Differential Patterns of Music Listening: Focus of Attention of Musicians versus Nonmusicians. , 1990 .

[9]  P. Juslin,et al.  Emotional responses to music: experience, expression, and physiology , 2009 .

[10]  E. Altenmüller,et al.  Emotions over time: synchronicity and development of subjective, physiological, and facial affective reactions to music. , 2007, Emotion.

[11]  R. Oostenveld,et al.  Increased auditory cortical representation in musicians , 1998, Nature.

[12]  C. Stevens,et al.  Identifying Regions of Good Agreement among Responders in Engagement with a Piece of Live Dance , 2013 .

[13]  L. Parra,et al.  Human Neuroscience Original Research Article Correlated Components of Ongoing Eeg Point to Emotionally Laden Attention – a Possible Marker of Engagement? , 2022 .

[14]  Kofi Agawu Structural 'Highpoints' in Schumann's 'Dichterliebe' , 1984 .

[15]  E. Altenmüller,et al.  Chills in different sensory domains: Frisson elicited by acoustical, visual, tactile and gustatory stimuli , 2011 .

[16]  J. I The Design of Experiments , 1936, Nature.

[17]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[18]  Jacek Dmochowski,et al.  Maximally reliable spatial filtering of steady state visual evoked potentials , 2014, NeuroImage.

[19]  Uri Hasson,et al.  Engaged listeners: shared neural processing of powerful political speeches. , 2015, Social cognitive and affective neuroscience.

[20]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[21]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[22]  Tzyy-Ping Jung,et al.  Extended ICA Removes Artifacts from Electroencephalographic Recordings , 1997, NIPS.

[23]  Emery Schubert,et al.  Reliability issues regarding the beginning, middle and end of continuous emotion ratings to music , 2013 .

[24]  C. Krumhansl A Perceptual Analysis of Mozart's Piano Sonata K. 282: Segmentation, Tension, and Musical Ideas , 1996 .

[25]  Gillian M. Sandstrom,et al.  Predicting musically induced emotions from physiological inputs: linear and neural network models , 2013, Front. Psychol..

[26]  N. Rickard Intense emotional responses to music: a test of the physiological arousal hypothesis , 2004 .

[27]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[28]  Jacek Dmochowski,et al.  Neuroimaging Methods for Music Information Retrieval: Current Findings and Future Prospects , 2015, ISMIR.

[29]  Geraint A. Wiggins,et al.  Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[30]  John S. Johnson,et al.  Audience preferences are predicted by temporal reliability of neural processing , 2014, Nature Communications.

[31]  Jens Haueisen,et al.  Involuntary Motor Activity in Pianists Evoked by Music Perception , 2001, Journal of Cognitive Neuroscience.

[32]  Stefan Koelsch,et al.  The Role of Harmonic Expectancy Violations in Musical Emotions: Evidence from Subjective, Physiological, and Neural Responses , 2006, Journal of Cognitive Neuroscience.

[33]  R. Kopiez,et al.  Listening To Music As A Re-Creative Process: Physiological, Psychological, And Psychoacoustical Correlates Of Chills And Strong Emotions , 2007 .

[34]  Victoria Romero,et al.  Physiological Synchronization Is Associated with Narrative Emotionality and Subsequent Behavioral Response , 2014, HCI.

[35]  Marie Schmidt,et al.  Nonparametrics Statistical Methods Based On Ranks , 2016 .

[36]  M. Grigutsch,et al.  Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. , 2007, Psychophysiology.

[37]  Ruth V. Brittin,et al.  An Empirical Method for Measuring the Aesthetic Experience to Music , 1993 .

[38]  Reinhard Kopiez,et al.  The Chill Parameter: Goose Bumps and Shivers as Promising Measures in Emotion Research , 2009 .