Reliability of Sleep Measures from Four Personal Health Monitoring Devices Compared to Research-Based Actigraphy and Polysomnography

Polysomnography (PSG) is the “gold standard” for monitoring sleep. Alternatives to PSG are of interest for clinical, research, and personal use. Wrist-worn actigraph devices have been utilized in research settings for measures of sleep for over two decades. Whether sleep measures from commercially available devices are similarly valid is unknown. We sought to determine the validity of five wearable devices: Basis Health Tracker, Misfit Shine, Fitbit Flex, Withings Pulse O2, and a research-based actigraph, Actiwatch Spectrum. We used Wilcoxon Signed Rank tests to assess differences between devices relative to PSG and correlational analysis to assess the strength of the relationship. Data loss was greatest for Fitbit and Misfit. For all devices, we found no difference and strong correlation of total sleep time with PSG. Sleep efficiency differed from PSG for Withings, Misfit, Fitbit, and Basis, while Actiwatch mean values did not differ from that of PSG. Only mean values of sleep efficiency (time asleep/time in bed) from Actiwatch correlated with PSG, yet this correlation was weak. Light sleep time differed from PSG (nREM1 + nREM2) for all devices. Measures of Deep sleep time did not differ from PSG (SWS + REM) for Basis. These results reveal the current strengths and limitations in sleep estimates produced by personal health monitoring devices and point to a need for future development.

[1]  Athena Demertzi,et al.  Actigraphy assessments of circadian sleep-wake cycles in the Vegetative and Minimally Conscious States , 2013, BMC Medicine.

[2]  C. Guilleminault,et al.  Meta-analysis of quantitative sleep parameters from childhood to old age in healthy individuals: developing normative sleep values across the human lifespan. , 2004, Sleep.

[3]  Thomas Penzel,et al.  Actigraphy combined with EEG compared to polysomnography in sleep apnea patients. , 2015, Physiological measurement.

[4]  C. Diclemente,et al.  The role of feedback in the process of health behavior change. , 2001, American journal of health behavior.

[5]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[6]  Mark A Tully,et al.  The validation of Fibit Zip™ physical activity monitor as a measure of free-living physical activity , 2014, BMC Research Notes.

[7]  Marijn C. W. Kroes,et al.  Light sleep versus slow wave sleep in memory consolidation: a question of global versus local processes? , 2014, Trends in Neurosciences.

[8]  D. Asch,et al.  Wearable devices as facilitators, not drivers, of health behavior change. , 2015, JAMA.

[9]  A. Chesson,et al.  Practice parameters for the use of actigraphy in the assessment of sleep and sleep disorders: an update for 2007. , 2007, Sleep.

[10]  J. Solet,et al.  Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. , 2013, Sleep.

[11]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[12]  H. Montgomery-Downs,et al.  Movement toward a novel activity monitoring device , 2012, Sleep and Breathing.

[13]  Sean A. Munson,et al.  Exploring goal-setting, rewards, self-monitoring, and sharing to motivate physical activity , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[14]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[15]  Kathryn A. Lee,et al.  Methodological challenges when using actigraphy in research. , 2008, Journal of pain and symptom management.

[16]  Gregory D. Roach,et al.  Alternatives to polysomnography (PSG): A validation of wrist actigraphy and a partial-PSG system , 2014, Behavior Research Methods.

[17]  Jess P. Shatkin,et al.  Fitbit Flex: an unreliable device for longitudinal sleep measures in a non-clinical population , 2016, Sleep and Breathing.

[18]  Wolfgang Klimesch,et al.  Heartbeat-related EEG amplitude and phase modulations from wakefulness to deep sleep: Interactions with sleep spindles and slow oscillations. , 2015, Psychophysiology.

[19]  Tim Olds,et al.  The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[20]  S. Blair,et al.  The effect of exercise training on obstructive sleep apnea and sleep quality: a randomized controlled trial. , 2011, Sleep.

[21]  John R. Shambroom,et al.  Validation of an automated wireless system to monitor sleep in healthy adults , 2012, Journal of sleep research.

[22]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[23]  Matthew P Buman,et al.  Twenty-four Hours of Sleep, Sedentary Behavior, and Physical Activity with Nine Wearable Devices. , 2016, Medicine and science in sports and exercise.

[24]  Matthew P. Buman,et al.  Direct comparison of two actigraphy devices with polysomnographically recorded naps in healthy young adults , 2013, Chronobiology international.

[25]  A. Sadeh.  The role and validity of actigraphy in sleep medicine: an update. , 2011, Sleep medicine reviews.