Emotion in Motion: A Study of Music and Affective Response

'Emotion in Motion' is an experiment designed to understand the emotional responses of people to a variety of musical excerpts, via self-report questionnaires and the recording of electrodermal activity EDA and heart rate HR signals. The experiment ran for 3 months as part of a public exhibition in Dublin, having nearly 4000 participants and over 12000 listening samples. This paper presents the methodology used by the authors to approach this research, as well as preliminary results derived from the self-report data and the physiology.

[1]  V. Salomaa,et al.  White coat effect, blood pressure and mortality in men: prospective cohort study. , 2000, European heart journal.

[2]  J. Lacey,et al.  THE EVALUATION OF AUTONOMIC RESPONSES: TOWARD A GENERAL SOLUTION , 1956, Annals of the New York Academy of Sciences.

[3]  R S Paffenbarger,et al.  Heart rate and cardiovascular mortality: the Framingham Study. , 1987, American heart journal.

[4]  Yechiam Ostchega,et al.  Resting pulse rate reference data for children, adolescents, and adults: United States, 1999-2008. , 2011, National health statistics reports.

[5]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[6]  Harry W. Agius,et al.  Emotion in HCI – Designing for People Proceedings of the 2008 International Workshop , 2009 .

[7]  Rosalind W. Picard.  Affective computing: (526112012-054) , 1997 .

[8]  M. Christie.  Electrodermal Activity in the 1980s: A Review 1 , 1981, Journal of the Royal Society of Medicine.

[9]  J. Fortrat,et al.  White coat effect and reactivity to stress: cardiovascular and autonomic nervous system responses. , 1998, Hypertension.

[10]  Sylvia D. Kreibig,et al.  Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. , 2007, Psychophysiology.

[11]  P. Venables,et al.  Direct measurement of skin conductance: a proposal for standardization. , 1971, Psychophysiology.

[12]  Gregory P. Lee,et al.  Different Contributions of the Human Amygdala and Ventromedial Prefrontal Cortex to Decision-Making , 1999, The Journal of Neuroscience.

[13]  Jennifer Healey,et al.  Digital processing of affective signals , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[14]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[15]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[16]  Rosalind W. Picard.  Affective Computing , 1997 .

[17]  D. Sapoznikov,et al.  Determinants of Short-Period Heart Rate Variability in the General Population , 2001, Cardiology.

[18]  J. Sloboda.  Music Structure and Emotional Response: Some Empirical Findings , 1991 .

[19]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[20]  Josef Wilder,et al.  Das „Ausgangswert-Gesetz“, ein unbeachtetes biologisches Gesetz und seine Bedeutung für Forschung und Praxis , 1931 .

[21]  F. Wilhelm,et al.  Emotions beyond the laboratory: Theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment , 2010, Biological Psychology.

[22]  W. Boucsein.  Electrodermal activity, 2nd ed. , 2012 .

[23]  Laila Dybkjær,et al.  Affective Dialogue Systems , 2004, Lecture Notes in Computer Science.

[24]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[25]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[26]  R. Zatorre,et al.  Anatomically distinct dopamine release during anticipation and experience of peak emotion to music , 2011, Nature Neuroscience.

[27]  Dan Ziegler,et al.  Standardized tests of heart rate variability: normal ranges obtained from 309 healthy humans, and effects of age, gender, and heart rate , 2001, Clinical Autonomic Research.

[28]  P. Ekman.  An argument for basic emotions , 1992 .

[29]  Mircea Miclea,et al.  Emotions induced by operatic music: Psychophysiological effects of music, plot, and acting A scientist’s tribute to Maria Callas , 2011, Brain and Cognition.

[30]  M Ericson,et al.  Heart rate variability in healthy subjects is related to age and gender. , 1997, Acta physiologica Scandinavica.

[31]  Ferdinand J. Venditti,et al.  Reduced Heart Rate Variability and Mortalit Risk in an Elderly Cohort: The Framingham Heart Study , 1994, Circulation.

[32]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[33]  M. Zentner,et al.  Mapping Aesthetic Musical Emotions in the Brain , 2011, Cerebral cortex.

[34]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[35]  Christine L. Lisetti,et al.  Toward Recognizing Individual's Subjective Emotion from Physiological Signals in Practical Application , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[36]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[37]  J. Panksepp.  The emotional sources of "chills" induced by music. , 1995 .

[38]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[39]  R W Barnes,et al.  Age, race, and sex differences in autonomic cardiac function measured by spectral analysis of heart rate variability--the ARIC study. Atherosclerosis Risk in Communities. , 1995, The American journal of cardiology.

[40]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[41]  Eckart Altenmüller,et al.  How Does Music Arouse “Chills”? , 2005, Annals of the New York Academy of Sciences.

[42]  James R. Hopgood,et al.  Nonconcurrent multiple speakers tracking based on extended Kalman particle filter , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[43]  S. D. Fokkema,et al.  Skin conductance as a measure of tonic and phasic arousal. , 1967, Acta psychologica.

[44]  M. Bradley,et al.  Emotion and motivation. , 2007 .

[45]  J. Kostis,et al.  The Effect of Age on Heart Rate in Subjects Free of Heart Disease: Studies By Ambulatory Electrocardiography and Maximal Exercise Stress Test , 1982, Circulation.

[46]  J. Russell.  A circumplex model of affect. , 1980 .

[47]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.