Cognitive rhythms: unobtrusive and continuous sensing of alertness using a mobile phone

Throughout the day, our alertness levels change and our cognitive performance fluctuates. The creation of technology that can adapt to such variations requires reliable measurement with ecological validity. Our study is the first to collect alertness data in the wild using the clinically validated Psychomotor Vigilance Test. With 20 participants over 40 days, we find that alertness can oscillate approximately 30% depending on time and body clock type and that Daylight Savings Time, hours slept, and stimulant intake can influence alertness as well. Based on these findings, we develop novel methods for unobtrusively and continuously assessing alertness. In estimating response time, our model achieves a root-mean-square error of 80.64 milliseconds, which is significantly lower than the 500ms threshold used as a standard indicator of impaired cognitive ability. Finally, we discuss how such real-time detection of alertness is a key first step towards developing systems that are sensitive to our biological variations.

[1]  A. Wirz-Justice,et al.  Life between Clocks: Daily Temporal Patterns of Human Chronotypes , 2003, Journal of biological rhythms.

[2]  D. Dinges,et al.  Sleep Deprivation and Vigilant Attention , 2008, Annals of the New York Academy of Sciences.

[3]  D. Dinges,et al.  Circadian Rhythms in Sleepiness, Alertness, and Performance , 2009 .

[4]  J. Toby Mordkoff,et al.  Chronotype and time-of-day influences on the alerting, orienting, and executive components of attention , 2008, Experimental Brain Research.

[5]  B. Oken,et al.  Nicotine effects on alertness and spatial attention in non-smokers. , 2002, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[6]  Tanzeem Choudhury,et al.  Towards circadian computing: "early to bed and early to rise" makes some of us unhealthy and sleep deprived , 2014, UbiComp.

[7]  Christopher M. Barnes,et al.  Changing to daylight saving time cuts into sleep and increases workplace injuries. , 2009, The Journal of applied psychology.

[8]  Matthew J. Kotchen,et al.  Does Daylight Saving Time Save Energy? Evidence from a Natural Experiment in Indiana , 2008, Review of Economics and Statistics.

[9]  C. Schmidt,et al.  A time to think: Circadian rhythms in human cognition , 2007, Cognitive neuropsychology.

[10]  Brandy M. Roane,et al.  Circadian Phase Preference in College Students: Relationships With Psychological Functioning and Academics , 2011, Chronobiology international.

[11]  J. Dorrian,et al.  The ability to self‐monitor performance when fatigued , 2000, Journal of sleep research.

[12]  Martin Pielot,et al.  When attention is not scarce - detecting boredom from mobile phone usage , 2015, UbiComp.

[13]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[14]  D. Dinges,et al.  Validity and Sensitivity of a Brief Psychomotor Vigilance Test (PVT-B) to Total and Partial Sleep Deprivation. , 2011, Acta astronautica.

[15]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[16]  Neeraj Sood,et al.  The Short and Long Run Effects of Daylight Saving Time on Fatal Automobile Crashes , 2007 .

[17]  Hans P. A. Van Dongen,et al.  Chapter 35 – Circadian Rhythms in Sleepiness, Alertness, and Performance , 2005 .

[18]  Walter C. Buboltz,et al.  Sleep Habits and Patterns of College Students: A Preliminary Study , 2001, Journal of American college health : J of ACH.

[19]  Jouko Lönnqvist,et al.  Transitions into and out of daylight saving time compromise sleep and the rest-activity cycles , 2008, BMC Physiology.

[20]  D. Dinges,et al.  A meta-analysis of the impact of short-term sleep deprivation on cognitive variables. , 2010, Psychological bulletin.

[21]  M. Basner,et al.  Fitness for Duty: A 3-Minute Version of the Psychomotor Vigilance Test Predicts Fatigue-Related Declines in Luggage-Screening Performance , 2011, Journal of occupational and environmental medicine.

[22]  Paul Johns,et al.  Bored mondays and focused afternoons: the rhythm of attention and online activity in the workplace , 2014, CHI.

[23]  David P White,et al.  A prospective study of sleep duration and mortality risk in women. , 2004, Sleep.

[24]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[25]  Dan Cosley,et al.  Mobile manifestations of alertness: connecting biological rhythms with patterns of smartphone app use , 2016, MobileHCI.

[26]  D. Dinges.  An overview of sleepiness and accidents , 1995, Journal of sleep research.

[27]  Martin Pielot,et al.  Boredom-computer interaction: boredom proneness and the use of smartphone , 2015, UbiComp.

[28]  Jeff Sagarin,et al.  Detrimental effects of daylight-saving time on SAT scores. , 2011 .

[29]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[30]  L. A. Reyner,et al.  ‘Post-lunch’ sleepiness during prolonged, monotonous driving — Effects of meal size , 2012, Physiology & Behavior.

[31]  C. Vetter,et al.  The Influence of Internal Time, Time Awake, and Sleep Duration on Cognitive Performance in Shiftworkers , 2012, Chronobiology international.

[32]  Mark L Unruh,et al.  Ecological momentary assessment of fatigue, sleepiness, and exhaustion in ESKD , 2014, BMC Nephrology.

[33]  S. Wessely,et al.  Development of a fatigue scale. , 1993, Journal of psychosomatic research.

[34]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[35]  Lynn Hasher,et al.  It's About Time: Circadian Rhythms, Memory, and Aging. , 2005 .

[36]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation , 2006 .

[37]  D. Dinges,et al.  Circadian rhythms, sleep deprivation, and human performance. , 2013, Progress in molecular biology and translational science.

[38]  D. Dawson,et al.  Quantifying the performance impairment associated with fatigue , 1999, Journal of sleep research.

[39]  J. Dorrian,et al.  The sensitivity of a palm-based psychomotor vigilance task to severe sleep loss , 2008, Behavior research methods.

[40]  Rey Hernández-Julián,et al.  Course Scheduling and Academic Performance , 2007 .

[41]  David F. Dinges,et al.  Microcomputer analyses of performance on a portable, simple visual RT task during sustained operations , 1985 .

[42]  Till Roenneberg,et al.  The Human Circadian Clock's Seasonal Adjustment Is Disrupted by Daylight Saving Time , 2007, Current Biology.

[43]  T H Monk,et al.  CIRCADIAN RHYTHMS OF PERFORMANCE: NEW TRENDS , 2000, Chronobiology international.

[44]  Christopher M. Barnes,et al.  Lost sleep and cyberloafing: Evidence from the laboratory and a daylight saving time quasi-experiment. , 2012, The Journal of applied psychology.

[45]  Gary Aston-Jones,et al.  Brain structures and receptors involved in alertness. , 2005, Sleep medicine.

[46]  WestonJason,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002 .

[47]  Sunny Consolvo,et al.  2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops Pvt -touch: Adapting a Reaction Time Test for Touchscreen Devices , 2022 .

[48]  Christian Guilleminault,et al.  Fatigue, sleep restriction, and performance in automobile drivers: a controlled study in a natural environment. , 2003, Sleep.

[49]  P. Pramstaller,et al.  A marker for the end of adolescence , 2004, Current Biology.

[50]  J. Baranski,et al.  On the ability to self‐monitor cognitive performance during sleep deprivation: a calibration study , 1994, Journal of sleep research.

[51]  Konrad Tollmar,et al.  Health Mashups: Presenting Statistical Patterns between Wellbeing Data and Context in Natural Language to Promote Behavior Change , 2013, TCHI.

[52]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation: An Unmet Public Health Problem , 2006 .

[53]  N. Kleitman,et al.  THE EFFECT OF BODY TEMPERATURE ON REACTION TIME , 1938 .

[54]  N. Digdon,et al.  College Students Who Have an Eveningness Preference Report Lower Self‐Control and Greater Procrastination , 2008, Chronobiology international.

[55]  Jorge Gonçalves,et al.  Contextual experience sampling of mobile application micro-usage , 2014, MobileHCI '14.

[56]  J. Dorrian,et al.  The validity of psychomotor vigilance tasks of less than 10-minute duration , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[57]  J. Horne,et al.  A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. , 1976, International journal of chronobiology.

[58]  Daniel J Buysse,et al.  Circadian determinants of the postlunch dip in performance. , 1996, Chronobiology international.

[59]  I Hindmarch,et al.  The effects of alcohol and other drugs on psychomotor performance and cognitive function. , 1991, Alcohol and alcoholism.

[60]  John Zimmerman,et al.  Toss 'n' turn: smartphone as sleep and sleep quality detector , 2014, CHI.

[61]  S. Lockley,et al.  Synchronizing education to adolescent biology: ‘let teens sleep, start school later’ , 2015 .

[62]  T. Balkin,et al.  Performance and alertness effects of caffeine, dextroamphetamine, and modafinil during sleep deprivation , 2005, Journal of sleep research.

[63]  David F Neri,et al.  Fatigue countermeasures in aviation. , 2009, Aviation, space, and environmental medicine.

[64]  Timothy H. Monk,et al.  A visual analogue scale technique to measure global vigor and affect , 1989, Psychiatry Research.

[65]  Tanzeem Choudhury,et al.  Social (media) jet lag: how usage of social technology can modulate and reflect circadian rhythms , 2015, UbiComp.

[66]  P. J. Huber.  Robust Estimation of a Location Parameter , 1964 .