Toward a System for Longitudinal Emotion Sensing

The ability to sense acoustic emotion from a smartphoneis advantageous for two main reasons. First, smartphonesensing is unobtrusive compared to wearing a microphone, and second, a smartphone is nearly always with the user. When sensing emotion over a long period of time, these two reasons become increasingly more important. We demonstrate the challenges of building a system for longitudinal emotion sensing on a smartphone, as well as our design approach to these challenges. Current emotion sensing systems perform all sensing and computation on the phone, but this design can lead to significant battery life constraints. We show that in terms of energy consumption, offloading feature and classification computation to a remote server is the most feasible design choice without excessive battery draining, and discuss how we address the privacy, energy, and storage concerns of such an approach.

[1]  Inseok Hwang,et al.  SocioPhone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion , 2013, MobiSys '13.

[2]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[3]  Jun Li,et al.  Crowd++: unsupervised speaker count with smartphones , 2013, UbiComp.

[4]  Cecilia Mascolo,et al.  DSP.Ear: leveraging co-processor support for continuous audio sensing on smartphones , 2014, SenSys.

[5]  Aaron Striegel,et al.  Evaluating the Raw Potential for Device-to-Device Caching via Co-location , 2014, FNC/MobiSPC.

[6]  Cecilia Mascolo,et al.  SociableSense: exploring the trade-offs of adaptive sampling and computation offloading for social sensing , 2011, MobiCom.

[7]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[8]  Christian Poellabauer,et al.  Lessons learned from the netsense smartphone study , 2013, HotPlanet '13.

[9]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[10]  Guanling Chen,et al.  AppJoy: personalized mobile application discovery , 2011, MobiSys '11.

[11]  Alec Wolman,et al.  MAUI: making smartphones last longer with code offload , 2010, MobiSys '10.

[12]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[13]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.