Wearable Sleep Technology in Clinical and Research Settings

ABSTRACT The accurate assessment of sleep is critical to better understand and evaluate its role in health and disease. The boom in wearable technology is part of the digital health revolution and is producing many novel, highly sophisticated and relatively inexpensive consumer devices collecting data from multiple sensors and claiming to extract information about users’ behaviors, including sleep. These devices are now able to capture different biosignals for determining, for example, HR and its variability, skin conductance, and temperature, in addition to activity. They perform 24/7, generating overwhelmingly large data sets (big data), with the potential of offering an unprecedented window on users’ health. Unfortunately, little guidance exists within and outside the scientific sleep community for their use, leading to confusion and controversy about their validity and application. The current state-of-the-art review aims to highlight use, validation and utility of consumer wearable sleep-trackers in clinical practice and research. Guidelines for a standardized assessment of device performance is deemed necessary, and several critical factors (proprietary algorithms, device malfunction, firmware updates) need to be considered before using these devices in clinical and sleep research protocols. Ultimately, wearable sleep technology holds promise for advancing understanding of sleep health; however, a careful path forward needs to be navigated, understanding the benefits and pitfalls of this technology as applied in sleep research and clinical sleep medicine.

[1]  D. Plante,et al.  Ability of the Fitbit Alta HR to quantify and classify sleep in patients with suspected central disorders of hypersomnolence: A comparison against polysomnography , 2018, Journal of sleep research.

[2]  A. Sadeh The role and validity of actigraphy in sleep medicine: an update. , 2011, Sleep medicine reviews.

[3]  Sang-Ahm Lee,et al.  Comparison of three actigraphic algorithms used to evaluate sleep in patients with obstructive sleep apnea , 2013, Sleep and Breathing.

[4]  Peter C. Searson,et al.  Wearable Devices for Precision Medicine and Health State Monitoring , 2019, IEEE Transactions on Biomedical Engineering.

[5]  K. Avis,et al.  Comparison of a Commercial Accelerometer with Polysomnography and Actigraphy in Children and Adolescents. , 2015, Sleep.

[6]  S. Redline,et al.  Actigraphy-based sleep estimation in adolescents and adults: a comparison with polysomnography using two scoring algorithms , 2018, Nature and science of sleep.

[7]  K. Savik,et al.  Effect of Inhaled Lavender and Sleep Hygiene on Self-Reported Sleep Issues: A Randomized Controlled Trial. , 2015, Journal of alternative and complementary medicine.

[8]  Tracking The Changing Landscape Of Corporate Wellness Companies. , 2017, Health affairs.

[9]  Matthew P. Buman,et al.  Direct comparison of two actigraphy devices with polysomnographically recorded naps in healthy young adults , 2013, Chronobiology international.

[10]  Luciano Stegagno,et al.  Polysomnographic validation of a wireless dry headband technology for sleep monitoring in healthy young adults , 2013, Physiology & Behavior.

[11]  C. Guilleminault,et al.  Comparison of actigraphic, polysomnographic, and subjective assessment of sleep parameters in sleep-disordered patients. , 2001, Sleep medicine.

[12]  P. F. Anderson,et al.  Sleep Tracking, Wearable Technology, and Opportunities for Research and Clinical Care. , 2016, Chest.

[13]  Sabine Van Huffel,et al.  An Evaluation of Cardiorespiratory and Movement Features With Respect to Sleep-Stage Classification , 2014, IEEE Journal of Biomedical and Health Informatics.

[14]  S. Abbott,et al.  Orthosomnia: Are Some Patients Taking the Quantified Self Too Far? , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[15]  Michael L. Prairie,et al.  Utility of the Fitbit Flex to evaluate sleep in major depressive disorder: A comparison against polysomnography and wrist-worn actigraphy. , 2017, Journal of affective disorders.

[16]  Chin Moi Chow,et al.  The validity of Actiwatch2 and SenseWear armband compared against polysomnography at different ambient temperature conditions , 2015, Sleep science.

[17]  Lieveke Ameye,et al.  Reliability of commercially available sleep and activity trackers with manual switch-to-sleep mode activation in free-living healthy individuals , 2017, Int. J. Medical Informatics.

[18]  J. Salmon,et al.  How many days of monitoring are needed to reliably assess SenseWear Armband outcomes in primary school-aged children? , 2016, Journal of science and medicine in sport.

[19]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[20]  Michael L. Prairie,et al.  Ability of the Multisensory Jawbone UP3 to Quantify and Classify Sleep in Patients With Suspected Central Disorders of Hypersomnolence: A Comparison Against Polysomnography and Actigraphy. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[21]  L. Meltzer,et al.  Comparison of actigraphy immobility rules with polysomnographic sleep onset latency in children and adolescents , 2015, Sleep and Breathing.

[22]  C. Sargent,et al.  How well does a commercially available wearable device measure sleep in young athletes? , 2018, Chronobiology international.

[23]  Matt T Bianchi,et al.  Sleep devices: wearables and nearables, informational and interventional, consumer and clinical. , 2017, Metabolism: clinical and experimental.

[24]  C. Marcus,et al.  Validation of Actigraphy in Middle Childhood. , 2016, Sleep.

[25]  H. Nagaraja,et al.  How accurately does wrist actigraphy identify the states of sleep and wakefulness? , 2001, Sleep.

[26]  A. Goldstone,et al.  A validation study of Fitbit Charge 2™ compared with polysomnography in adults , 2018, Chronobiology international.

[27]  J. Winkelman,et al.  Cognitive Behavioral Therapy Using a Mobile Application Synchronizable With Wearable Devices for Insomnia Treatment: A Pilot Study. , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[28]  Jan Van den Bulck Sleep apps and the quantified self: blessing or curse? , 2015 .

[29]  J. Pépin,et al.  Ambulatory monitoring in the diagnosis and management of obstructive sleep apnoea syndrome , 2013, European Respiratory Review.

[30]  Amy L. Cochran,et al.  A global quantification of “normal” sleep schedules using smartphone data , 2016, Science Advances.

[31]  Luciano Molinari,et al.  Agreement rates between actigraphy, diary, and questionnaire for children's sleep patterns. , 2008, Archives of pediatrics & adolescent medicine.

[32]  B. Feige,et al.  Electrodermal activity patterns in sleep stages and their utility for sleep versus wake classification , 2019, Journal of sleep research.

[33]  H. Montgomery-Downs,et al.  Movement toward a novel activity monitoring device , 2012, Sleep and Breathing.

[34]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[35]  L. Meltzer,et al.  Direct comparison of two new actigraphs and polysomnography in children and adolescents. , 2012, Sleep.

[36]  John Ludbrook,et al.  Confidence in Altman–Bland plots: A critical review of the method of differences , 2010, Clinical and experimental pharmacology & physiology.

[37]  S. Drummond,et al.  Pilot Validation of Ambulatory Activity Monitors for Sleep Measurement in Huntington's Disease Gene Carriers. , 2017, Journal of Huntington's disease.

[38]  Marimuthu Palaniswami,et al.  Comparison of pulse rate variability with heart rate variability during obstructive sleep apnea. , 2011, Medical engineering & physics.

[39]  Niclas Palmius,et al.  SleepAp: An automated obstructive sleep apnoea screening application for smartphones , 2013, Computing in Cardiology 2013.

[40]  G. Jean-Louis,et al.  Sleep estimation from wrist movement quantified by different actigraphic modalities , 2001, Journal of Neuroscience Methods.

[41]  Aimée Goldstone,et al.  Actigraphy in the digital health revolution: still asleep? , 2018, Sleep.

[42]  R. Bucks,et al.  Cardiac autonomic activity during sleep in high-altitude resident children compared with lowland residents , 2018, Sleep.

[43]  Sirinthip Roomkham,et al.  Promises and Challenges in the Use of Consumer-Grade Devices for Sleep Monitoring , 2018, IEEE Reviews in Biomedical Engineering.

[44]  Ilene M Rosen,et al.  Consumer Sleep Technology: An American Academy of Sleep Medicine Position Statement. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[45]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[46]  D. Hurley,et al.  Objective measurements of sleep for non‐laboratory settings as alternatives to polysomnography – a systematic review , 2011, Journal of Sleep Research.

[47]  G. Jean-Louis,et al.  Sleep detection with an accelerometer actigraph: comparisons with polysomnography , 2001, Physiology & Behavior.

[48]  M. Grandner Sleep, Health, and Society. , 2017, Sleep medicine clinics.

[49]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[50]  John R. Shambroom,et al.  Validation of an automated wireless system to monitor sleep in healthy adults , 2012, Journal of sleep research.

[51]  Ian M Colrain,et al.  Validation of Sleep-Tracking Technology Compared with Polysomnography in Adolescents. , 2015, Sleep.

[52]  Xi Long,et al.  Sleep stage classification with ECG and respiratory effort , 2015, Physiological measurement.

[53]  I. Colrain,et al.  Dynamic coupling between the central and autonomic nervous systems during sleep: A review , 2018, Neuroscience & Biobehavioral Reviews.

[54]  Sara Mariani,et al.  Validity of a commercial wearable sleep tracker in adult insomnia disorder patients and good sleepers. , 2017, Journal of psychosomatic research.

[55]  Z Beattie,et al.  Estimation of sleep stages in a healthy adult population from optical plethysmography and accelerometer signals , 2017, Physiological measurement.

[56]  P. Hanly,et al.  Staging Sleep in Polysomnograms: Analysis of Inter-Scorer Variability. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[57]  Jess P. Shatkin,et al.  Fitbit Flex: an unreliable device for longitudinal sleep measures in a non-clinical population , 2016, Sleep and Breathing.

[58]  I. Colrain,et al.  The Sleep of the Ring: Comparison of the ŌURA Sleep Tracker Against Polysomnography , 2019, Behavioral sleep medicine.

[59]  A. Chesson,et al.  Practice parameters for the use of actigraphy in the assessment of sleep and sleep disorders: an update for 2007. , 2007, Sleep.

[60]  J. Solet,et al.  Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. , 2013, Sleep.

[61]  S. Quan,et al.  AASM Scoring Manual Updates for 2017 (Version 2.4). , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[62]  Kang K. L. Liu,et al.  Network Physiology: How Organ Systems Dynamically Interact , 2015, PloS one.

[63]  J. Rowley,et al.  Clinical Use of a Home Sleep Apnea Test: An American Academy of Sleep Medicine Position Statement. , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[64]  Rebecca M. C. Spencer,et al.  Reliability of Sleep Measures from Four Personal Health Monitoring Devices Compared to Research-Based Actigraphy and Polysomnography , 2016, Sensors.

[65]  Virginia Pensabene,et al.  Assessment of the Fitbit Charge 2 for monitoring heart rate , 2018, PloS one.

[66]  Luciane L. de Souza,et al.  Further validation of actigraphy for sleep studies. , 2003, Sleep.

[67]  M. Rondanelli,et al.  The Effect of Melatonin, Magnesium, and Zinc on Primary Insomnia in Long‐Term Care Facility Residents in Italy: A Double‐Blind, Placebo‐Controlled Clinical Trial , 2011, Journal of the American Geriatrics Society.

[68]  A. Pesonen,et al.  The Validity of a New Consumer-Targeted Wrist Device in Sleep Measurement: An Overnight Comparison Against Polysomnography in Children and Adolescents. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[69]  Validating actigraphy as a measure of sleep for preschool children. , 2013, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[70]  Elizabeth A. McDevitt,et al.  Validation of an Automated Wireless System for Sleep Monitoring During Daytime Naps , 2015, Behavioral sleep medicine.

[71]  Ronald M. Aarts,et al.  Validation of Photoplethysmography-Based Sleep Staging Compared With Polysomnography in Healthy Middle-Aged Adults , 2017, Sleep.

[72]  M. Lentz,et al.  Polysomnography and actigraphy concordance in juvenile idiopathic arthritis, asthma and healthy children , 2012, Journal of sleep research.

[73]  L. Quinn,et al.  Validity of Actigraphy in Measurement of Sleep in Young Adults With Type 1 Diabetes. , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[74]  Roberto Sassi,et al.  Performance comparison between wrist and chest actigraphy in combination with heart rate variability for sleep classification , 2017, Comput. Biol. Medicine.

[75]  Emily G Lattie,et al.  Feeling validated yet? A scoping review of the use of consumer-targeted wearable and mobile technology to measure and improve sleep. , 2017, Sleep medicine reviews.

[76]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[77]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[78]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[79]  Jessilyn Dunn,et al.  Wearables and the medical revolution. , 2018, Personalized medicine.

[80]  Massimiliano de Zambotti,et al.  Evaluation of a consumer fitness-tracking device to assess sleep in adults , 2015, Chronobiology international.

[81]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[82]  Stanislas Chambon,et al.  Performance of an Ambulatory Dry-EEG Device for Auditory Closed-Loop Stimulation of Sleep Slow Oscillations in the Home Environment , 2018, Front. Hum. Neurosci..

[83]  Christopher P Lorenz,et al.  Sleep apps: what role do they play in clinical medicine? , 2017, Current opinion in pulmonary medicine.

[84]  Kazuhiko Fukuda,et al.  Proposed supplements and amendments to ‘A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects’, the Rechtschaffen & Kales (1968) standard , 2001, Psychiatry and clinical neurosciences.

[85]  J. N. van den Anker,et al.  How reliable are commercially available trackers in detecting daytime sleep , 2018, British journal of clinical pharmacology.

[86]  Christos Papavassiliou,et al.  Hearables: Multimodal physiological in-ear sensing , 2016, Scientific Reports.

[87]  Brandy M. Roane,et al.  Estimating sleep from multisensory armband measurements: validity and reliability in teens , 2015, Journal of sleep research.

[88]  Margot J Davey,et al.  Comparison of Commercial Wrist-Based and Smartphone Accelerometers, Actigraphy, and PSG in a Clinical Cohort of Children and Adolescents. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[89]  David T. Martin,et al.  The Effects of the Removal of Electronic Devices for 48 Hours on Sleep in Elite Judo Athletes , 2017, Journal of strength and conditioning research.

[90]  J. Carrier,et al.  Wake detection capacity of actigraphy during sleep. , 2007, Sleep.

[91]  S. Kachnowski,et al.  The Impact of Wearable Device Enabled Health Initiative on Physical Activity and Sleep , 2016, Cureus.

[92]  Job G. Godino,et al.  Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents , 2016, Physiology & Behavior.