Augmented Reality as a Countermeasure for Sleep Deprivation

Sleep deprivation is known to have serious deleterious effects on executive functioning and job performance. Augmented reality has an ability to place pertinent information at the fore, guiding visual focus and reducing instructional complexity. This paper presents a study to explore how spatial augmented reality instructions impact procedural task performance on sleep deprived users. The user study was conducted to examine performance on a procedural task at six time points over the course of a night of total sleep deprivation. Tasks were provided either by spatial augmented reality-based projections or on an adjacent monitor. The results indicate that participant errors significantly increased with the monitor condition when sleep deprived. The augmented reality condition exhibited a positive influence with participant errors and completion time having no significant increase when sleep deprived. The results of our study show that spatial augmented reality is an effective sleep deprivation countermeasure under laboratory conditions.

[1]  D. Dinges,et al.  Behavioral and physiological consequences of sleep restriction. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[2]  A. Muzet,et al.  Implementation of napping In industry and the problem of sleep inertia , 1995, Journal of sleep research.

[3]  Charles Woodward,et al.  Integration of Design and Assembly Using Augmented Reality , 2008, IPAS.

[4]  P. O’Brien,et al.  Exposure to bright light and darkness to treat physiologic maladaptation to night work , 1991 .

[5]  Terence M. McMenamin.  A Time to Work: Recent Trends in Shift Work and Flexible Schedules , 2007 .

[6]  A. Williamson,et al.  Moderate sleep deprivation produces impairments in cognitive and motor performance equivalent to legally prescribed levels of alcohol intoxication , 2000, Occupational and environmental medicine.

[7]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[8]  Erik Olofsen,et al.  Mixed-model regression analysis and dealing with interindividual differences. , 2004, Methods in enzymology.

[9]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[10]  J. Horne,et al.  The impact of sleep deprivation on decision making: a review. , 2000, Journal of experimental psychology. Applied.

[11]  S. Folkard,et al.  Shift work, safety and productivity. , 2003, Occupational medicine.

[12]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[13]  R. Ulrich,et al.  Acoustics and psychosocial environment in intensive coronary care , 2005, Occupational and Environmental Medicine.

[14]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[15]  Mark A. Livingston,et al.  User interface design for military AR applications , 2011, Virtual Reality.

[16]  J. Romijn,et al.  A single night of partial sleep deprivation induces insulin resistance in multiple metabolic pathways in healthy subjects. , 2010, The Journal of clinical endocrinology and metabolism.

[17]  Robert V Rege,et al.  Effect of sleep deprivation on the performance of simulated laparoscopic surgical skill. , 2003, American journal of surgery.

[18]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[19]  P. Tucker.  The impact of rest breaks upon accident risk, fatigue and performance: A review , 2003 .

[20]  Michael F. Zäh,et al.  Interactive laser-projection for programming industrial robots , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[21]  M. Minzenberg,et al.  Modafinil: A Review of Neurochemical Actions and Effects on Cognition , 2008, Neuropsychopharmacology.

[22]  A. Darzi,et al.  Effect of sleep deprivation on surgeons' dexterity on laparoscopy simulator , 1998, The Lancet.

[23]  D. Dinges,et al.  Psychomotor Vigilance Performance: Neurocognitive Assay Sensitive to Sleep Loss , 2004 .

[24]  Gary A. Ballinger,et al.  Using Generalized Estimating Equations for Longitudinal Data Analysis , 2004 .

[25]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[26]  Gudrun Klinker,et al.  Using laser projectors for augmented reality , 2008, VRST '08.

[27]  Kiyoshi Kiyokawa,et al.  Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[28]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[29]  K D Nielsen,et al.  Sleepiness does not modulate experimental joint pain in healthy volunteers. , 1997, Scandinavian journal of rheumatology.

[30]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[31]  D. Saville.  Multiple Comparison Procedures: The Practical Solution , 1990 .

[32]  Bruce H. Thomas,et al.  Improving procedural task performance with Augmented Reality annotations , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[33]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[34]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[35]  J A Horne,et al.  One night of sleep loss impairs innovative thinking and flexible decision making. , 1999, Organizational behavior and human decision processes.

[36]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[37]  Drew Dawson,et al.  Managing fatigue: it's about sleep. , 2005, Sleep medicine reviews.

[38]  A. Rogers,et al.  Sleep, stress and compensatory behaviors in Australian nurses and midwives. , 2011, Revista de saude publica.

[39]  D. Dinges,et al.  Neurocognitive Consequences of Sleep Deprivation , 2005, Seminars in neurology.

[40]  D. Dinges,et al.  The cumulative cost of additional wakefulness: dose-response effects on neurobehavioral functions and sleep physiology from chronic sleep restriction and total sleep deprivation. , 2003, Sleep.

[41]  T. Perneger.  What's wrong with Bonferroni adjustments , 1998, BMJ.

[42]  A. Wagstaff,et al.  Shift and night work and long working hours--a systematic review of safety implications. , 2011, Scandinavian journal of work, environment & health.

[43]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[44]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[45]  P. Schlattmann,et al.  Modafinil and methylphenidate for neuroenhancement in healthy individuals: A systematic review. , 2010, Pharmacological research.

[46]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[47]  R. Stickgold,et al.  Sleep, memory, and plasticity. , 2006, Annual review of psychology.

[48]  G. P. Herbison,et al.  The impact of a nap opportunity during the night shift on the performance and alertness of 12‐h shift workers , 2002, Journal of sleep research.

[49]  Ross T. Smith,et al.  Adapting ray tracing to Spatial Augmented Reality , 2013, ISMAR.

[50]  Chris Baber,et al.  User evaluation of augmented reality systems , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[51]  Ronald R Grunstein,et al.  A systematic review of the neurobehavioural and physiological effects of shiftwork systems. , 2007, Sleep medicine reviews.