Individuals’ Stress Assessment Using Human-Smartphone Interaction Analysis

The increasing presence of stress in people’ lives has motivated much research efforts focusing on continuous stress assessment methods of individuals, leveraging smartphones and wearable devices. These methods have several drawbacks, i.e., they use invasive external devices, thus increasing entry costs and reducing user acceptance, or they use some of privacy-related information. This paper presents an approach for stress assessment that leverages data extracted from smartphone sensors, and that is not invasive concerning privacy. Two different approaches are presented. One, based on smartphone gestures analysis, e.g., ‘tap’, ‘scroll’, ‘swipe’ and ‘text writing’, and evaluated in laboratory settings with 13 participants (F-measure 79-85 percent within-subject model, 70-80 percent global model); the second one based on smartphone usage analysis and tested in-the-wild with 25 participants (F-measure 77-88 percent within-subject model, 63-83 percent global model). Results show how these two methods enable an accurate stress assessment without being too intrusive, thus increasing ecological validity of the data and user acceptance.

[1]  P. Sleight,et al.  Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. , 2000, Journal of the American College of Cardiology.

[2]  George Fink,et al.  Stress: Definition and History , 2009 .

[3]  Katarzyna Wac,et al.  Getting closer: an empirical investigation of the proximity of user to their smart phones , 2011, UbiComp '11.

[4]  Katarzyna Wac,et al.  iSensestress: Assessing stress through human-smartphone interaction analysis , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[5]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[6]  Robert Li Kam Wa MoodScope: Building a Mood Sensor from Smartphone Usage Patterns , 2012 .

[7]  Emmanuel Dellandréa,et al.  Associating Textual Features with Visual Ones to Improve Affective Image Classification , 2011, ACII.

[8]  Akane Sano,et al.  Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones , 2015, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[9]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[10]  Jennifer Healey,et al.  Recording Affect in the Field: Towards Methods and Metrics for Improving Ground Truth Labels , 2011, ACII.

[11]  Katarzyna Wac,et al.  Mqol: experiences of the 'mobile communications and computing for quality of life' living lab , 2015, 2015 17th International Conference on E-health Networking, Application & Services (HealthCom).

[12]  Emil Jovanov,et al.  Stress monitoring using a distributed wireless intelligent sensor system. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[13]  Georgios N. Yannakakis,et al.  Don’t Classify Ratings of Affect; Rank Them! , 2014, IEEE Transactions on Affective Computing.

[14]  R A Bryant,et al.  Acute Stress Disorder Scale: a self-report measure of acute stress disorder. , 2000, Psychological assessment.

[15]  Yunxin Liu,et al.  Can Your Smartphone Infer Your Mood ? , 2011 .

[16]  Rafael A. Calvo,et al.  Hybrid Fusion Approach for Detecting Affects from Multichannel Physiology , 2011, ACII.

[17]  T. Pickering,et al.  Mental stress as a causal factor in the development of hypertension and cardiovascular disease , 2001, Current hypertension reports.

[18]  E. D. de Geus,et al.  Effects of work stress on ambulatory blood pressure, heart rate, and heart rate variability. , 2000, Hypertension.

[19]  K. Scherer,et al.  The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance , 2011, Behavior research methods.

[20]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[21]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[22]  A. Lymberis,et al.  Smart wearable systems for personalised health management: current R&D and future challenges , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[23]  Mary Czerwinski,et al.  Under pressure: sensing stress of computer users , 2014, CHI.

[24]  Gonzalo Bailador,et al.  A Stress-Detection System Based on Physiological Signals and Fuzzy Logic , 2011, IEEE Transactions on Industrial Electronics.

[25]  Gerhard Tröster,et al.  Monitoring of mental workload levels during an everyday life office-work scenario , 2013, Personal and Ubiquitous Computing.

[26]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[27]  Myeong Gi Jeong,et al.  Ultra Short Term Analysis of Heart Rate Variability for Monitoring Mental Stress in Mobile Settings , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  David Sun,et al.  MouStress: detecting stress from mouse motion , 2014, CHI.

[29]  S. Dickerson,et al.  Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. , 2004, Psychological bulletin.

[30]  A. Baum,et al.  Health psychology: mapping biobehavioral contributions to health and illness. , 1999, Annual review of psychology.

[31]  F. H. Wilhelm,et al.  Ambulatory assessment of clinical anxiety , 1996 .

[32]  R Likert,et al.  A TECHNIQUE FOR THE MEASUREMENT OF ATTITUDE SCALES , 1932 .

[33]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[34]  D. Mahoney,et al.  Acceptance of Wearable Technology by People With Alzheimer’s Disease: Issues and Accommodations , 2010, American journal of Alzheimer's disease and other dementias.

[35]  David Sun,et al.  Sensor-less sensing for affective computing and stress management technology , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[36]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[37]  Luciano Gamberini,et al.  Measuring User Acceptance of Wearable Symbiotic Devices: Validation Study Across Application Scenarios , 2014, Symbiotic.

[38]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[39]  S. L. la Fleur,et al.  Chronic stress and obesity: A new view of “comfort food” , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[40]  P. Landsbergis,et al.  Job strain and cardiovascular disease. , 1994, Annual review of public health.

[41]  W. Roth,et al.  Taking the laboratory to the skies: ambulatory assessment of self-report, autonomic, and respiratory responses in flying phobia. , 1998, Psychophysiology.