Measuring the Effects of Stress on Mobile Interaction

Research shows that environmental factors such as ambient noise and cold ambience can render users situationally impaired, adversely affecting interaction with mobile devices. However, an internal factor which is known to negatively impact cognitive abilities -- stress -- has not been systematically investigated in terms of its impact on mobile interaction. In this paper, we report a study where we use the Trier Social Stress Test to induce stress on participants, and investigate its effect on three aspects of mobile interaction: target acquisition, visual search, and text entry. We find that stress reduces completion time and accuracy during target acquisition tasks, as well as completion time during visual search tasks. Finally, we are able to directly contrast the magnitude of these effects to previously published effects of environmentally-caused impairments. Our work contributes to the growing body of literature on situational impairments.

[1]  T. Robbins,et al.  The effects of chronic administration of hydrocortisone on cognitive function in normal male volunteers , 1999, Psychopharmacology.

[2]  Indika Karunaratne,et al.  Surveillance of human-computer interactions: A way forward to detection of users' Psychological Distress , 2011, 2011 IEEE Colloquium on Humanities, Science and Engineering.

[3]  M. A. Rowe,et al.  Guide for Analysing Electrodermal Activity & Skin Conductance Responses for Psychological Experiments , 2013 .

[4]  Francisco J. García-Peñalvo,et al.  Situational impairments to mobile interaction in cold environments , 2016, Ubiquitous Computing.

[5]  Mary Czerwinski,et al.  Under pressure: sensing stress of computer users , 2014, CHI.

[6]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.

[7]  Jorge Gonçalves,et al.  Challenges of situational impairments during interaction with mobile devices , 2017, OZCHI.

[8]  Ravi Kuber,et al.  All situational impairments are not created equal: A classification system for situational impairment events and the unique nature of severely constraining situational impairments , 2017 .

[9]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[10]  John T. Cacioppo,et al.  Heart Rate Variability: Stress and Psychiatric Conditions , 2007 .

[11]  Jacob O. Wobbrock,et al.  WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry , 2012, CHI.

[12]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[13]  Mark H. Chignell,et al.  Mobile text entry: relationship between walking speed and text input task difficulty , 2005, Mobile HCI.

[14]  Jorge Gonçalves,et al.  Effect of Distinct Ambient Noise Types on Mobile Interaction , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Daniel McDuff,et al.  COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera , 2016, CHI.

[16]  D. Rempel,et al.  Influence of time pressure and verbal provocation on physiological and psychological reactions during work with a computer mouse , 2002, European Journal of Applied Physiology.

[17]  Jorge Gonçalves,et al.  A Systematic Assessment of Smartphone Usage Gaps , 2016, CHI.

[18]  M. Sayette,et al.  Does Drinking Reduce Stress? , 1999, Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism.

[19]  福田 博一 State-Trait Anxiety Inventoryによるペインクリニック外来患者の不安の評価 , 1994 .

[20]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[21]  P. Tearle,et al.  Work-related stress , 2021, Understanding and Supporting Professional Carers.

[22]  Enrico Rukzio,et al.  Investigating selection and reading performance on a mobile phone while walking , 2010, Mobile HCI.

[23]  J. Lagopoulos Electrodermal activity , 2007, Acta Neuropsychiatrica.

[24]  M. Staal Stress, Cognition, and Human Performance: A Literature Review and Conceptual Framework , 2013 .

[25]  Jacob O. Wobbrock,et al.  The Future of Mobile Device Research in HCI , 2006 .

[26]  Paul Lukowicz,et al.  Can smartphones detect stress-related changes in the behaviour of individuals? , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[27]  D I MARQUART,et al.  The pattern of punishment and its relation to abnormal fixation in adult human subjects. , 1948, The Journal of general psychology.

[28]  Jorge Gonçalves,et al.  CHI 1994-2013: mapping two decades of intellectual progress through co-word analysis , 2014, CHI.

[29]  Niels Henze,et al.  100,000,000 taps: analysis and improvement of touch performance in the large , 2011, Mobile HCI.

[30]  Michael S. Wogalter,et al.  Reading comprehension in the presence of unattended speech and music , 1988 .

[31]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[32]  J DEESE,et al.  The effects of psychological stress upon performance. , 1952, Psychological bulletin.

[33]  O. Wolf,et al.  Impaired Memory Retrieval after Psychosocial Stress in Healthy Young Men , 2005, The Journal of Neuroscience.

[34]  R. Hauger,et al.  Working memory is more sensitive than declarative memory to the acute effects of corticosteroids: a dose-response study in humans. , 1999, Behavioral neuroscience.

[35]  B. McEwen,et al.  Stress-induced declarative memory impairment in healthy elderly subjects: relationship to cortisol reactivity. , 1997, The Journal of clinical endocrinology and metabolism.

[36]  E A Higgins,et al.  The effects of body thermal state on manual performance. AM-68-13. , 1968, AM [reports]. United States. Office of Aviation Medicine.

[37]  Stephen A. Brewster,et al.  Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices , 2014, CHI.

[38]  Mark A Yeshnik The Variability of German Winter Temperature in Relation to Human Performance and Its Implications for Tactical Military Operations , 1988 .

[39]  John J. B. Allen,et al.  The effects of experimentally induced stress on false recognition , 2002, Memory.

[40]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[41]  I.L.D. Houtman,et al.  Work-related stress , 2019, Understanding and Supporting Professional Carers.

[42]  Jorge Gonçalves,et al.  Sensing Cold-Induced Situational Impairments in Mobile Interaction Using Battery Temperature , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[43]  Javier Hernandez,et al.  Affective keys: towards unobtrusive stress sensing of smartphone users , 2018, MobileHCI Adjunct.

[44]  Jorge Gonçalves,et al.  Revisitation analysis of smartphone app use , 2015, UbiComp.

[45]  Luca Chittaro,et al.  Stress Detection Using Physiological Sensors , 2015, Computer.

[46]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[47]  Jorge Gonçalves,et al.  Identity crisis of ubicomp?: mapping 15 years of the field's development and paradigm change , 2014, UbiComp.

[48]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[49]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[50]  C. Spielberger State‐Trait Anxiety Inventory , 2010 .

[51]  O. Wolkowitz,et al.  Cognitive effects of corticosteroids. , 1990, The American journal of psychiatry.

[52]  Ruud van den Bos,et al.  Stress and decision-making in humans: Performance is related to cortisol reactivity, albeit differently in men and women , 2009, Psychoneuroendocrinology.

[53]  J. Newcomer,et al.  Decreased memory performance in healthy humans induced by stress-level cortisol treatment. , 1999, Archives of general psychiatry.

[54]  Fred McKinney,et al.  Certain Emotional Factors in Learning and Efficiency , 1933 .

[55]  Davide Carneiro,et al.  Keystrokes and Clicks: Measuring Stress on E-learning Students , 2013, SOCO 2013.

[56]  Brian P. Bailey,et al.  The Effects of Interruptions on Task Performance, Annoyance, and Anxiety in the User Interface , 2001, INTERACT.

[57]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[58]  A. Smith,et al.  The serial sevens subtraction test. , 1967, Archives of neurology.

[59]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.

[60]  David Sun,et al.  MouStress: detecting stress from mouse motion , 2014, CHI.

[61]  T. Kamarck,et al.  A global measure of perceived stress. , 1983, Journal of health and social behavior.

[62]  Harald Merckelbach,et al.  ACUTE STRESS ENHANCES MEMORY FOR EMOTIONAL WORDS, BUT IMPAIRS MEMORY FOR NEUTRAL WORDS , 2004, The International journal of neuroscience.

[63]  David R. Flatla,et al.  It's not just the light: understanding the factors causing situational visual impairments during mobile interaction , 2018, NordiCHI.

[64]  W Wippich,et al.  Stress- and treatment-induced elevations of cortisol levels associated with impaired declarative memory in healthy adults. , 1996, Life sciences.

[65]  F McKINNEY,et al.  Experimental frustration in a group test situation. , 1951, Journal of abnormal psychology.

[66]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[67]  E VERVILLE,et al.  The effect of emotional and motivational sets on the perception of incomplete pictures. , 1946, The Journal of genetic psychology.

[68]  Jorge Gonçalves,et al.  Tapping Task Performance on Smartphones in Cold Temperature , 2016, Interact. Comput..

[69]  Margaret E. Morris,et al.  Mobile Heart Health: Project Highlight , 2009, IEEE Pervasive Computing.

[70]  E A Higgins,et al.  Effects of body thermal state on manual performance. , 1968, Aerospace medicine.