Directing Physiology and Mood through Music: Validation of an Affective Music Player

Music is important in everyday life, as it provides entertainment and influences our moods. As music is widely available, it is becoming increasingly difficult to select songs to suit our mood. An affective music player can remove this obstacle by taking a desired mood as input and then selecting songs that direct toward that desired mood. In the present study, we validate the concept of an affective music player directing the energy dimension of mood. User models were trained for 10 participants based on skin conductance changes to songs from their own music database. Based on the resulting user models, the songs that most increased or decreased the skin conductance level of the participants were selected to induce either a relatively energized or a calm mood. Experiments were conducted in a real-world office setting. The results showed that a reliable prediction can be made of the impact of a song on skin conductance, that skin conductance and mood can be directed toward an energized or calm state and that skin conductance remains in these states for at least 30 minutes. All in all, this study shows that the concept and models of the affective music player worked in an ecologically valid setting, suggesting the feasibility of using physiological responses in real-life affective computing applications.

[1]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[2]  B. Mittelmann,et al.  Emotions and Skin temperature: Observations on Patients During Psychotherapeutic (Psychoanalytic) Interviews1 , 1943 .

[3]  W. Dewhurst Stimulus and response—The law of initial value , 1968 .

[4]  W. A. Wagenaar Note on the construction of digram-balanced Latin squares. , 1969 .

[5]  D. Berlyne,et al.  Aesthetics and Psychobiology , 1975 .

[6]  V. Konečni 17 – Social Interaction and Musical Preference , 1982 .

[7]  R. A. Mcfarland Relationship of skin temperature changes to the emotions accompanying music , 1985, Biofeedback and self-regulation.

[8]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[9]  Dylan M. Jones,et al.  Refining the measurement of mood: The UWIST Mood Adjective Checklist , 1990 .

[10]  R. A. Mcfarland,et al.  Sex differences in finger temperature response to music. , 1991, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  A. Isen,et al.  Positive affect and decision making. , 1993 .

[12]  R. Geenen,et al.  A simple test of the Law of Initial Values. , 1993, Psychophysiology.

[13]  J. Kagan,et al.  The psychological significance of changes in skin temperature , 1996 .

[14]  Rosalind W. Picard Affective Computing , 1997 .

[15]  I. Nyklíček,et al.  Cardiorespiratory differentiation of musically-induced emotions. , 1997 .

[16]  C. Krumhansl An exploratory study of musical emotions and psychophysiology. , 1997, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[17]  Jennifer Healey,et al.  A New Affect-Perceiving Interface and Its Application to Personalized Music Selection , 1998 .

[18]  G. Gendolla On the Impact of Mood on Behavior: An Integrative Theory and a Review , 2000 .

[19]  Heiner Stuckenschmidt,et al.  A personalized music system for motivation in sport performance , 2005, IEEE Pervasive Computing.

[20]  Janto Skowronek,et al.  Ground truth for automatic music mood classification , 2006, ISMIR.

[21]  G. Scott Vercoe,et al.  The affective remixer: personalized music arranging , 2006, CHI Extended Abstracts.

[22]  Nuria Oliver,et al.  PAPA: Physiology and Purpose-Aware Automatic Playlist Generation , 2006, ISMIR.

[23]  S. Fairclough,et al.  Prediction of subjective states from psychophysiology: A multivariate approach , 2006, Biological Psychology.

[24]  U. Nater,et al.  Sex differences in emotional and psychophysiological responses to musical stimuli. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  Nuria Oliver,et al.  MPTrain: a mobile, music and physiology-based personal trainer , 2006, Mobile HCI.

[26]  P. Wilhelm,et al.  Assessing Mood in Daily Life Structural Validity, Sensitivity to Change, and Reliability of a Short-Scale to Measure Three Basic Dimensions of Mood , 2007 .

[27]  K. Lambert Handbook of Emotion Regulation , 2007 .

[28]  Janto Skowronek,et al.  A Demonstrator for Automatic Music Mood Estimation , 2007, ISMIR.

[29]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[30]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Kristina Höök,et al.  Affective Loop Experiences - What Are They? , 2008, PERSUASIVE.

[32]  Marjolein D. van der Zwaag,et al.  A Middleware Architecture for Human-Centred Pervasive Adaptive Applications , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops.

[33]  Shiliang Zhang,et al.  Affective MTV analysis based on arousal and valence features , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[34]  P. Juslin Emotional Responses to Music , 2008 .

[35]  P. Juslin,et al.  Emotional responses to music: experience, expression, and physiology , 2009 .

[36]  Wolfram Boucsein,et al.  Combining electrodermal responses and cardiovascular measures for probing adaptive automation during simulated flight. , 2009, Applied ergonomics.

[37]  D de Waard,et al.  Cardiovascular state changes during performance of a simulated ambulance dispatchers' task: potential use for adaptive support. , 2009, Applied ergonomics.

[38]  G. Cassidy,et al.  The effects of music choice on task performance: A study of the impact of self-selected and experimenter-selected music on driving game performance and experience , 2009 .

[39]  Egon L. van den Broek,et al.  Deploying music characteristics for an affective music player , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[40]  Egon L. van den Broek,et al.  Personalized affective music player , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[41]  K. Höök Affective loop experiences: designing for interactional embodiment , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  S. Fairclough,et al.  The influence of performance feedback on goal-setting and mental effort regulation , 2009 .

[43]  遠山 正彌,et al.  人体の解剖生理学 = Human anatomy & physiology , 2010 .

[44]  Rosalind W. Picard,et al.  A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity , 2010, IEEE Transactions on Biomedical Engineering.

[45]  Teresa Lesiuk The effect of preferred music on mood and performance in a high-cognitive demand occupation. , 2010, Journal of music therapy.

[46]  Martin Ouwerkerk,et al.  Unobtrusive Emotions Sensing in Daily Life , 2010 .

[47]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[48]  Marko Munih,et al.  Measuring motor actions and psychophysiology for task difficulty estimation in human-robot interaction , 2010, MB '10.

[49]  Wijnand A. IJsselsteijn,et al.  Intimate Heartbeats: Opportunities for Affective Communication Technology , 2010, IEEE Transactions on Affective Computing.

[50]  S. O’Neill The Social and Applied Psychology of Music , 2011 .

[51]  Stephen H. Fairclough,et al.  The Impact of Music on Affect during Anger Inducing Drives , 2011, ACII.

[52]  J. Sloboda,et al.  Handbook of Music and Emotion: Theory, Research, Applications , 2011 .

[53]  J. Westerink,et al.  Emotional and psychophysiological responses to tempo, mode, and percussiveness , 2011 .

[54]  Egon L. van den Broek,et al.  Tune in to your emotions: a robust personalized affective music player , 2012, User Modeling and User-Adapted Interaction.

[55]  Tim J. W. Tijs Personalized relax music to reduce patient anxiety , 2011 .

[56]  D. de Waard,et al.  The influence of music on mood and performance while driving , 2012, Ergonomics.

[57]  J. Wilder,et al.  Stimulus and Response: the Law of Initial Value , 2014 .