MoodScope: building a mood sensor from smartphone usage patterns

We report a first-of-its-kind smartphone software system, MoodScope, which infers the mood of its user based on how the smartphone is used. Compared to smartphone sensors that measure acceleration, light, and other physical properties, MoodScope is a "sensor" that measures the mental state of the user and provides mood as an important input to context-aware computing. We run a formative statistical mood study with smartphone-logged data collected from 32 participants over two months. Through the study, we find that by analyzing communication history and application usage patterns, we can statistically infer a user's daily mood average with an initial accuracy of 66%, which gradu-ally improves to an accuracy of 93% after a two-month personal-ized training period. Motivated by these results, we build a service, MoodScope, which analyzes usage history to act as a sensor of the user's mood. We provide a MoodScope API for developers to use our system to create mood-enabled applications. We further create and deploy a mood-sharing social application.

[1]  M. Hynes,et al.  AFFECT , 2015, The Atlas of AI.

[2]  Javier Hernandez,et al.  Mood meter: counting smiles in the wild , 2012, UbiComp.

[3]  Hosub Lee,et al.  Towards unobtrusive emotion recognition for affective social communication , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[4]  Ye Xu,et al.  Enabling large-scale human activity inference on smartphones using community similarity networks (csn) , 2011, UbiComp '11.

[5]  Jie Liu,et al.  SpeakerSense: Energy Efficient Unobtrusive Speaker Identification on Mobile Phones , 2011, Pervasive.

[6]  Daniel Gatica-Perez,et al.  Who's Who with Big-Five: Analyzing and Classifying Personality Traits with Smartphones , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[7]  Yunxin Liu,et al.  Can Your Smartphone Infer Your Mood ? , 2011 .

[8]  Clayton Shepard,et al.  LiveLab: measuring wireless networks and smartphone users in the field , 2011, SIGMETRICS Perform. Evaluation Rev..

[9]  Nuria Oliver,et al.  A study of mobile mood awareness and communication through MobiMood , 2010, NordiCHI.

[10]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.

[11]  Vitaly Shmatikov,et al.  Myths and fallacies of "Personally Identifiable Information" , 2010, Commun. ACM.

[12]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[13]  M. Yik,et al.  Studying Affect Among the Chinese: The Circular Way , 2009, Journal of personality assessment.

[14]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  L. Zhu,et al.  Towards Mood Based Mobile Services and Applications , 2007, EuroSSC.

[16]  M. Bartlett,et al.  Machine Analysis of Facial Expressions , 2007 .

[17]  Lie Lu,et al.  Automatic mood detection and tracking of music audio signals , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  Jeffrey F. Cohn,et al.  Foundations of human computing: facial expression and emotion , 2006, ICMI '06.

[19]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[20]  P. Terry,et al.  Distinctions between emotion and mood , 2005 .

[21]  Björn W. Schuller,et al.  Meta-classifiers in acoustic and linguistic feature fusion-based affect recognition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[22]  Shrikanth S. Narayanan,et al.  Toward detecting emotions in spoken dialogs , 2005, IEEE Transactions on Speech and Audio Processing.

[23]  J. Henry,et al.  The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. , 2004, The British journal of clinical psychology.

[24]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[25]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[26]  Jeff T. Larsen,et al.  Can people feel happy and sad at the same time? , 2001, Journal of personality and social psychology.

[27]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Rosalind W. Picard.  Affective Computing , 1997 .

[29]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[30]  L. L. Shaw,et al.  Differentiating affect, mood, and emotion: Toward functionally based conceptual distinctions. , 1992 .

[31]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[32]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[33]  D. Watson,et al.  Mood and the mundane: relations between daily life events and self-reported mood. , 1988, Journal of personality and social psychology.

[34]  G. Bower,et al.  The Influence of Mood on Perceptions of Social Interactions , 1984 .

[35]  J. Russell.  A circumplex model of affect. , 1980 .

[36]  P. Ekman.  Universals and cultural differences in facial expressions of emotion. , 1972 .