Comparing ESM Timings for Emotional Estimation Model with Fine Temporal Granularity

Towards wellbeing-awareness in computing, researches for estimating users' emotions using smartphone sensor data have been actively conducted as smartphones are getting more and more ubiquitous. Most studies have constructed emotion estimation models based on machine learning with contextual data from the smartphones and user's self-reporting ground truth label often collected via Experience Sampling Method (ESM). However, snice our emotion changes frequently in our daily lives, trying to collect the ground truth of such volatile emotions leads a storm of ESMs which could be burden to the users. In order to find better ESM methods, we propose and compare 3 ESMs, namely Randomized ESM that executes in randomly timings, Trigger ESM that executes when the user's behavior changes, and Unlocking ESM that sets up ESM on the unlocking screen. We constructed various emotional estimation models with four types of time granularity (1 day, 1/3 day, 3 hours, 1 hour) in four weeks experience with eight persons. As for the response rate, Unlocking ESM was the highest. In addition, it was clear that Unlocking ESM had the highest estimation accuracy in most cases.

[1]  Denzil Ferreira,et al.  AWARE: Mobile Context Instrumentation Framework , 2015, Front. ICT.

[2]  Alexander Travis Adams,et al.  EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions , 2016, UbiComp.

[3]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  Mirco Musolesi,et al.  MyTraces , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[6]  Daniel J. Wigdor,et al.  Slide to X: unlocking the potential of smartphone unlocking , 2014, CHI.

[7]  Amit P. Sheth,et al.  Harnessing Twitter "Big Data" for Automatic Emotion Identification , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[8]  Jorge Gonçalves,et al.  Projective testing of diurnal collective emotion , 2014, UbiComp.

[9]  Peter D. Turney,et al.  Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon , 2010, HLT-NAACL 2010.

[10]  Takanori Ichikawa,et al.  Attention and engagement-awareness in the wild: A large-scale study with adaptive notifications , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[11]  Martijn H. Vastenburg,et al.  Mood measurement with Pick-A-Mood: review of current methods and design of a pictorial self-report scale , 2016 .

[12]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys.

[13]  Anind K. Dey,et al.  ProactiveTasks: the short of mobile device use sessions , 2014, MobileHCI '14.