A wearable system for mood assessment considering smartphone features and data from mobile ECGs

Traditionally, mood is assessed by either considering physiological data or smartphones-based self-reports. Physiological data is objective and continuous, but difficult to be collected in-field and lacks a subjective component. Smartphones provide subjective feedback and objective data, but lack physiological data. We propose to combine smartphones as a rich sensor system and smartwatches as a wearable heart rate monitor. Both serve as a platform for reporting mood states. Within an explorative user study with six subjects over four weeks, we collected smartphone data and heart rate in addition to subjective ground truth via self-reports. We assessed all three mood dimensions valence, energetic arousal and calmness, but only consider valence in the context of this paper. Analyzing the information gain, we identified the relevance of temporal features (daytime, weekday, type of day) as well as the heart rate. Decision tree classifiers trained on the first three weeks and tested on the fourth achieve recognition accuracies of up to 0.91.

[1]  Janice R. Kuo,et al.  State affective instability in borderline personality disorder assessed by ambulatory monitoring , 2007, Psychological Medicine.

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Enzo Pasquale Scilingo,et al.  Recognizing Emotions Induced by Affective Sounds through Heart Rate Variability , 2015, IEEE Transactions on Affective Computing.

[4]  Tom Geller How do you feel?: your computer knows , 2014, CACM.

[5]  Geoff Holmes,et al.  Multiclass Alternating Decision Trees , 2002, ECML.

[6]  Michael Beigl,et al.  Preliminary investigations about interruptibility of smartphone users at specific place types , 2016, UbiComp Adjunct.

[7]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[8]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[9]  Alexander Zipf,et al.  Incorporating Land Use in a Spatiotemporal Trigger for Ecological Momentary Assessments , 2015 .

[10]  S. Mourato,et al.  Happiness is greater in natural environments , 2013 .

[11]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[12]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[13]  Anja Bachmann,et al.  Leveraging smartwatches for unobtrusive mobile ambulatory mood assessment , 2015, UbiComp/ISWC Adjunct.

[14]  A. Grob,et al.  Dimensional models of core affect: a quantitative comparison by means of structural equation modeling , 2000 .

[15]  Wendy S. Ark,et al.  The Emotion Mouse , 1999, HCI.

[16]  David Fitzpatrick,et al.  Physiological Changes Associated with Emotion , 2001 .

[17]  P. Ekman Are there basic emotions? , 1992, Psychological review.

[18]  Luca Citi,et al.  Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics , 2014, Scientific Reports.

[19]  Sazali Yaacob,et al.  FCM clustering of emotional stress using ECG features , 2013, 2013 International Conference on Communication and Signal Processing.

[20]  P. Wilhelm,et al.  Assessing Mood in Daily Life Structural Validity, Sensitivity to Change, and Reliability of a Short-Scale to Measure Three Basic Dimensions of Mood , 2007 .

[21]  Anja Bachmann,et al.  How to use smartphones for less obtrusive ambulatory mood assessment and mood recognition , 2015, UbiComp/ISWC Adjunct.

[22]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys.

[23]  J. Russell A circumplex model of affect. , 1980 .