Unconscious emotions: quantifying and logging something we are not aware of

Lifelogging tools aim to precisely capture daily experiences of people from the first-person perspective. Although there have been numerous lifelogging tools developed for users to record the external environment around them, the internal part of experience characterized by emotions seems to be neglected in the lifelogging field. However, the internal experiences of people are important and, therefore, lifelogging tools should be able to capture not only the environmental data, but also emotional experiences, thereby providing a more complete archive of past events. Moreover, there are implicit emotions that cannot be consciously experienced, but still influence human behaviors and memories. It has been proven that conscious emotions can be recognized from physiological signals of the human body. This fact may be used to enhance life-logs with information about unconscious emotions, which otherwise would remain hidden. On the other hand, it is not clear if unconscious emotions can be recognized from physiological signals and differentiated from conscious emotions. Therefore, an experiment was designed to elicit emotions (both conscious and unconscious) with visual and auditory stimuli and to record cardiovascular responses of 34 participants. The experimental results showed that heart rate responses to the presentation of the stimuli are unique for every category of the emotional stimuli and allow differentiation between various emotional experiences of the participants.

[1]  Seong-in Kim,et al.  A computer system for art therapy assessment of elements in structured mandala , 2009 .

[2]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[3]  Sylvia D. Kreibig,et al.  Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. , 2007, Psychophysiology.

[4]  R. Krauss,et al.  Facial and autonomic manifestations of the dimensional structure of emotion , 1984 .

[5]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[6]  Rosalind W. Picard Affective Computing: From Laughter to IEEE , 2010 .

[7]  Atr Carol Thayer Cox Ma,et al.  Mandala Artwork by Clients with DID: Clinical Observations Based on Two Theoretical Models , 2000 .

[8]  Nathan Mascaro,et al.  Empirical Study on the Healing Nature of Mandalas , 2007 .

[9]  P. Black Physiological Correlates of Emotion , 2012 .

[10]  Y.C. Chesnokov,et al.  Individually adaptable automatic QT detector , 2006, 2006 Computers in Cardiology.

[11]  Alan F. Smeaton,et al.  Everyday concept detection in visual lifelogs: validation, relationships and trends , 2010, Multimedia Tools and Applications.

[12]  Egon L. van den Broek,et al.  Guidelines for affective signal processing (ASP): From lab to life , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[13]  C. Jung,et al.  Man and His Symbols , 1964 .

[14]  K. Scherer,et al.  The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance , 2011, Behavior research methods.

[15]  G. Schwartz,et al.  A randomized controlled trial of mindfulness meditation versus relaxation training: Effects on distress, positive states of mind, rumination, and distraction , 2007, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[16]  Morgan Gaydos,et al.  Mandala drawings as an assessment tool for women with breast cancer , 2009 .

[17]  Carol A. Bush,et al.  Dreams, mandalas, and music imagery: Therapeutic uses in a case study , 1988 .

[18]  Leonid Ivonin,et al.  A New Representation of Emotion in Affective Computing , 2012 .

[19]  B. C. Lacey,et al.  10 – SOME AUTONOMIC-CENTRAL NERVOUS SYSTEM INTERRELATIONSHIPS , 1970 .

[20]  Thomas Singer,et al.  ARAS: Archetypal Symbolism and Images , 2007 .

[21]  Abigail Sellen,et al.  Now let me see where i was: understanding how lifelogs mediate memory , 2010, CHI.

[22]  Loel Tronsky,et al.  Physiological effects of mandala making in adults with intellectual disability , 2011 .

[23]  Alex Pentland,et al.  The familiar: a living diary and companion , 2001, CHI Extended Abstracts.

[24]  Richard Burns,et al.  Business Research Methods and Statistics Using SPSS , 2008 .

[25]  L. F. Barrett Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[26]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[27]  A. Angrilli,et al.  Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Renée van der Vennet,et al.  Can Coloring Mandalas Reduce Anxiety? A Replication Study , 2012 .

[29]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[30]  Kristina Höök,et al.  Experiencing the Affective Diary , 2009, Personal and Ubiquitous Computing.

[31]  Alex Pentland,et al.  InSense: Interest-Based Life Logging , 2006, IEEE MultiMedia.

[32]  J. Kihlstrom The psychological unconscious. , 1990 .

[33]  C. Malchiodi Medical art therapy with children , 1999 .

[34]  Maralynn Hagood Slegelis A study of Jung's Mandala and its relationship to art psychotherapy☆ , 1987 .

[35]  C. Jung The Archetypes and the Collective Unconscious , 1968 .

[36]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[37]  Christine L. Lisetti,et al.  A User-Modeling Approach to Build User's Psycho-Physiological Maps of Emotions using Bio-Sensors , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[38]  K. Berridge,et al.  What is an unconscious emotion?(The case for unconscious "liking") , 2003, Cognition & emotion.

[39]  Christine L. Lisetti,et al.  A User Model of Psycho-physiological Measure of Emotion , 2007, User Modeling.

[40]  Cristina Conati,et al.  User Modeling 2007, 11th International Conference, UM 2007, Corfu, Greece, June 25-29, 2007, Proceedings , 2007, User Modeling.

[41]  G. Skolidis,et al.  Automatic classification of arrhythmic beats using Gaussian Processes , 2008, 2008 Computers in Cardiology.

[42]  Hatice Gunes,et al.  Automatic, Dimensional and Continuous Emotion Recognition , 2010, Int. J. Synth. Emot..

[43]  Matthias Rauterberg,et al.  Emotions: The Voice of the Unconscious , 2010, ICEC.

[44]  Tim Kasser,et al.  Can Coloring Mandalas Reduce Anxiety? , 2005 .

[45]  C. Jung,et al.  Memories, Dreams, Reflections , 1962 .