BoostMeUp: Improving Cognitive Performance in the Moment by Unobtrusively Regulating Emotions with a Smartwatch

A person's emotional state can strongly influence their ability to achieve optimal task performance. Aiming to help individuals manage their feelings, different emotion regulation technologies have been proposed. However, despite the well-known influence that emotions have on task performance, no study to date has shown if an emotion regulation technology can also enhance user's cognitive performance in the moment. In this paper, we present BoostMeUp, a smartwatch intervention designed to improve user's cognitive performance by regulating their emotions unobtrusively. Based on studies that show that people tend to associate external signals that resemble heart rates as their own, the intervention provides personalized haptic feedback simulating a different heart rate. Users can focus on their tasks and the intervention acts upon them in parallel, without requiring any additional action. The intervention was evaluated in an experiment with 72 participants, in which they had to do math tests under high pressure. Participants who were exposed to slow haptic feedback during the tests decreased their anxiety, increased their heart rate variability and performed better in the math tests, while fast haptic feedback led to the opposite effects. These results indicate that the BoostMeUp intervention can lead to positive cognitive, physiological and behavioral changes.

[1]  N Birbaumer,et al.  Anxiety induced by false heart rate feedback in patients with panic disorder. , 1988, Behaviour research and therapy.

[2]  S. Elkins,et al.  Test anxiety. , 1989, Plastic surgical nursing : official journal of the American Society of Plastic and Reconstructive Surgical Nurses.

[3]  M. Tsakiris,et al.  The calming effect of a new wearable device during the anticipation of public speech , 2017, Scientific Reports.

[4]  Shalini Vohra,et al.  Emotion regulation and trader expertise: Heart rate variability on the trading floor , 2012 .

[5]  Mark Matthews,et al.  Real-Time Representation Versus Response Elicitation in Biosensor Data , 2015, CHI.

[6]  Bongshin Lee,et al.  TimeAware: Leveraging Framing Effects to Enhance Personal Productivity , 2016, CHI.

[7]  Sian L. Beilock,et al.  More on the fragility of performance: choking under pressure in mathematical problem solving. , 2004, Journal of experimental psychology. General.

[8]  Spencer J. Salend,et al.  Teaching Students Not to Sweat the Test , 2012 .

[9]  J. Theeuwes Exogenous and endogenous control of attention: The effect of visual onsets and offsets , 1991, Perception & psychophysics.

[10]  Alexander Travis Adams,et al.  Mindless computing: designing technologies to subtly influence behavior , 2015, UbiComp.

[11]  Sian L. Beilock,et al.  Choke or thrive? The relation between salivary cortisol and math performance depends on individual differences in working memory and math-anxiety. , 2011, Emotion.

[12]  Andrew P. Smith,et al.  Effects of caffeine on mood and performance: a study of realistic consumption , 2002, Psychopharmacology.

[13]  Matthew Chan,et al.  CalmMeNow: exploratory research and design of stress mitigating mobile interventions , 2011, CHI Extended Abstracts.

[14]  M. Ashcraft,et al.  The relationships among working memory, math anxiety, and performance. , 2001, Journal of experimental psychology. General.

[15]  Mika P. Tarvainen,et al.  Kubios HRV - Heart rate variability analysis software , 2014, Comput. Methods Programs Biomed..

[16]  Richard E. Mayer,et al.  The Psychology of Abilities, Competencies, and Expertise: What Causes Individual Differences in Cognitive Performance? , 2003 .

[17]  Walter Bender,et al.  Next-Generation Personal Memory Aids , 2004 .

[18]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[19]  Rosalind W. Picard,et al.  BrightBeat: Effortlessly Influencing Breathing for Cultivating Calmness and Focus , 2017, CHI Extended Abstracts.

[20]  R. Baumeister Choking under pressure: self-consciousness and paradoxical effects of incentives on skillful performance. , 1984, Journal of personality and social psychology.

[21]  Elizabeth L. Murnane,et al.  Development and Evaluation of a Smartphone-Based Measure of Social Rhythms for Bipolar Disorder , 2016, Assessment.

[22]  C. Moulin,et al.  Benefits of SenseCam review on neuropsychological test performance. , 2013, American journal of preventive medicine.

[23]  Pattie Maes,et al.  Motif: a wearable sonic cueing device for memory support and cognitive intervention , 2017, SEMWEB.

[24]  O. Pollatos,et al.  On the relationship between interoceptive awareness, emotional experience, and brain processes. , 2005, Brain research. Cognitive brain research.

[25]  Alison Wood Brooks,et al.  Get excited: reappraising pre-performance anxiety as excitement. , 2014, Journal of experimental psychology. General.

[26]  Daniel Västfjäll,et al.  Self-Representation in Mediated Environments: The Experience of Emotions Modulated by Auditory-Vibrotactile Heartbeat , 2008, Cyberpsychology Behav. Soc. Netw..

[27]  Alex Pentland,et al.  The memory glasses: subliminal vs. overt memory support with imperfect information , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[28]  D H Whalen,et al.  The effects of breath sounds on the perception of synthetic speech. , 1995, The Journal of the Acoustical Society of America.

[29]  Rossana Castaldo,et al.  Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis , 2015, Biomed. Signal Process. Control..

[30]  Masood Sadiq Butt,et al.  Coffee and its Consumption: Benefits and Risks , 2011, Critical reviews in food science and nutrition.

[31]  Steve Whittaker,et al.  On Being Told How We Feel , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[32]  D. Bai,et al.  Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature , 2018, Psychiatry investigation.

[33]  Jeffrey Heer,et al.  Peripheral paced respiration: influencing user physiology during information work , 2011, UIST.

[34]  A. Diamond,et al.  Conclusions about interventions, programs, and approaches for improving executive functions that appear justified and those that, despite much hype, do not , 2015, Developmental Cognitive Neuroscience.

[35]  Hugo D. Critchley,et al.  Interoceptive Ability Predicts Survival on a London Trading Floor , 2016, Scientific Reports.

[36]  Allan Wigfield,et al.  Math anxiety in elementary and secondary school students. , 1988 .

[37]  Judith Amores,et al.  PsychicVR: Increasing mindfulness by using Virtual Reality and Brain Computer Interfaces , 2016, CHI Extended Abstracts.

[38]  Nancy L. Kocovski,et al.  State and trait anxiety revisited. , 2001, Journal of anxiety disorders.

[39]  Mary Czerwinski,et al.  MoodWings: a wearable biofeedback device for real-time stress intervention , 2013, PETRA '13.

[40]  Alexander Travis Adams,et al.  EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions , 2016, UbiComp.

[41]  M. Eysenck,et al.  Anxiety and Performance: The Processing Efficiency Theory , 1992 .

[42]  M. Eysenck,et al.  Anxiety and cognitive performance: attentional control theory. , 2007, Emotion.

[43]  Mary Czerwinski,et al.  Pocket Skills: A Conversational Mobile Web App To Support Dialectical Behavioral Therapy , 2018, CHI.

[44]  Rebecca C Rossom,et al.  IntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety , 2017, Journal of medical Internet research.

[45]  N. Bianchi-Berthouze,et al.  Principles for Designing Body-Centered Auditory Feedback , 2017 .

[46]  Inmaculada Plaza,et al.  Mindfulness-Based Mobile Applications: Literature Review and Analysis of Current Features , 2013, JMIR mHealth and uHealth.

[47]  Daniel McDuff,et al.  AffectAura: an intelligent system for emotional memory , 2012, CHI.

[48]  Alice T. Sawyer,et al.  How to handle anxiety: The effects of reappraisal, acceptance, and suppression strategies on anxious arousal. , 2009, Behaviour research and therapy.

[49]  Bernhard E. Riecke,et al.  Interactively mediating experiences of mindfulness meditation , 2014, Int. J. Hum. Comput. Stud..

[50]  Sian L. Beilock,et al.  Math Performance in Stressful Situations , 2008 .

[51]  Rhodri Cusack,et al.  Listening to Your Heart , 2010, Psychological science.

[52]  Álvaro Alesanco Iglesias,et al.  Validation of the Apple Watch for Heart Rate Variability Measurements during Relax and Mental Stress in Healthy Subjects , 2018, Sensors.

[53]  R. Bogacz,et al.  The neural basis of the speed–accuracy tradeoff , 2010, Trends in Neurosciences.

[54]  Gavin Andrews,et al.  CBT for depression: a pilot RCT comparing mobile phone vs. computer , 2013, BMC Psychiatry.

[55]  福田 博一 State-Trait Anxiety Inventoryによるペインクリニック外来患者の不安の評価 , 1994 .

[56]  Mariano Alcañiz Raya,et al.  Affective Interactions Using Virtual Reality: The Link between Presence and Emotions , 2007, Cyberpsychology Behav. Soc. Netw..

[57]  S. Valins Cognitive effects of false heart-rate feedback. , 1966, Journal of personality and social psychology.

[58]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[59]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[60]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Emotion Facilitates Perception and Potentiates the Perceptual Benefits of Attention , 2022 .

[61]  Beate M Herbert,et al.  Heart rate response after emotional picture presentation is modulated by interoceptive awareness. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[62]  Scott E. Hudson,et al.  The Effectiveness of Haptic Cues as an Assistive Technology for Human Memory , 2009, Pervasive.

[63]  Wendy Ju,et al.  Just Breathe , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[64]  John Torous,et al.  The digital placebo effect: mobile mental health meets clinical psychiatry. , 2016, The lancet. Psychiatry.

[65]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[66]  Dong Pyo Jang,et al.  The Effect of Virtual Reality Cognitive Training for Attention Enhancement , 2002, Cyberpsychology Behav. Soc. Netw..

[67]  Mary Czerwinski,et al.  Regulating Feelings During Interpersonal Conflicts by Changing Voice Self-perception , 2018, CHI.

[68]  Sian L. Beilock,et al.  When High-Powered People Fail , 2005, Psychological science.

[69]  L. Morris,et al.  Cognitive and Emotional Components of Test Anxiety: A Distinction and Some Initial Data , 1967, Psychological reports.

[70]  R. Baumeister,et al.  A review of paradoxical performance effects: Choking under pressure in sports and mental tests , 1986 .

[71]  R. Sternberg,et al.  The psychology of abilities, competencies, and expertise. , 2003 .

[72]  Caroline Guardino,et al.  Changing Behaviors by Changing the Classroom Environment , 2010 .

[73]  M. Eysenck,et al.  Anxiety, Processing Efficiency, and Cognitive Performance New Developments from Attentional Control Theory , 2009 .

[74]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.

[75]  Marci S. DeCaro,et al.  Choking under pressure: multiple routes to skill failure. , 2011, Journal of experimental psychology. General.

[76]  H. Critchley,et al.  Neural systems supporting interoceptive awareness , 2004, Nature Neuroscience.

[77]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[78]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[79]  G C Phillips,et al.  Effects of the presentation of false heart-rate feedback on the performance of two common heartbeat-detection tasks. , 1999, Psychophysiology.

[80]  James A. Landay,et al.  Breath Booster!: Exploring In-Car, Fast-Paced Breathing Interventions to Enhance Driver Arousal State , 2018, PervasiveHealth.

[81]  David M. Frohlich,et al.  Timespace in the workplace: dealing with interruptions , 1995, CHI 95 Conference Companion.

[82]  Joshua R Steinerman,et al.  Minding the Aging Brain: Technology-Enabled Cognitive Training for Healthy Elders , 2010, Current neurology and neuroscience reports.

[83]  Artie Konrad,et al.  Change of Heart: Emotion Tracking to Promote Behavior Change , 2015, CHI.

[84]  Pattie Maes,et al.  NeverMind: Using Augmented Reality for Memorization , 2016, UIST.

[85]  Mary Czerwinski,et al.  How blocking distractions affects workplace focus and productivity , 2017, UbiComp/ISWC Adjunct.

[86]  Katherine Isbister,et al.  HapLand: A Scalable Robust Emotion Regulation Haptic System Testbed , 2017, CHI Extended Abstracts.

[87]  J. Gross Emotion regulation: affective, cognitive, and social consequences. , 2002, Psychophysiology.

[88]  Pattie Maes,et al.  AttentivU: Evaluating the Feasibility of Biofeedback Glasses to Monitor and Improve Attention , 2018, UbiComp/ISWC Adjunct.

[89]  W Revelle,et al.  Effects of anxiety on analogical reasoning: a test of three theoretical models. , 1985, Journal of personality and social psychology.

[90]  Kathleen D. Vohs,et al.  Encyclopedia of social psychology , 2007 .

[91]  Klaus Gramann,et al.  On the embodiment of emotion regulation: interoceptive awareness facilitates reappraisal. , 2013, Social cognitive and affective neuroscience.