Comparison and agreement between device-estimated and self-reported sleep periods in adults

Abstract Objectives Discriminating sleep period from accelerometer data remains a challenge despite many studies have adapted 24-h measurement protocols. We aimed to compare and examine the agreement among device-estimated and self-reported bedtime, wake-up time, and sleep periods in a sample of adults. Materials and methods Participants (108 adults, 61 females) with an average age of 33.1 (SD 0.4) were asked to wear two wearable devices (Polar Active and Ōura ring) simultaneously and record their bedtime and wake up time using a sleep diary. Sleep periods from Polar Active were detected using an in-lab algorithm, which is openly available. Sleep periods from Ōura ring were generated by commercial Ōura system. Scatter plots, Bland–Altman plots, and intraclass correlation coefficients (ICCs) were used to evaluate the agreement between the methods. Results Intraclass correlation coefficient values were above 0.81 for bedtimes and wake-up times between the three methods. In the estimation of sleep period, ICCs ranged from 0.67 (Polar Active vs. sleep diary) to 0.76 (Polar Active vs. Ōura ring). Average difference between Polar Active and Ōura ring was −1.8 min for bedtimes and −2.6 min for wake-up times. Corresponding values between Polar Active and sleep diary were −5.4 and −18.9 min, and between Ōura ring and sleep diary −3.6 min and −16.2 min, respectively. Conclusion Results showed a high agreement between Polar Active activity monitor and Ōura ring for sleep period estimation. There was a moderate agreement between self-report and the two devices in estimating bedtime and wake-up time. These findings suggest that potentially wearable devices can be interchangeably used to detect sleep period, but their accuracy remains limited. Key Messages Estimation of sleep period from different devices could be comparable. Difference between sleep periods from monitors and sleep diary are under 20 min. Device-based estimation of sleep period is encouraged in population-based studies.

[1]  Ren-Jay Shei,et al.  Wearable activity trackers–advanced technology or advanced marketing? , 2022, European Journal of Applied Physiology.

[2]  V. Kiviniemi,et al.  Human NREM Sleep Promotes Brain-Wide Vasomotor and Respiratory Pulsations , 2022, The Journal of Neuroscience.

[3]  Ignacio Perez-Pozuelo,et al.  Past, Present, and Future of Multisensory Wearable Technology to Monitor Sleep and Circadian Rhythms , 2021, Frontiers in Digital Health.

[4]  Maisa Niemelä,et al.  Machine-learning models for activity class prediction: A comparative study of feature selection and classification algorithms. , 2021, Gait & posture.

[5]  S. Chastin,et al.  GRANADA consensus on analytical approaches to assess associations with accelerometer-determined physical behaviours (physical activity, sedentary behaviour and sleep) in epidemiological studies , 2021, British Journal of Sports Medicine.

[6]  Matthew R. Lujan,et al.  Sleep Tracking Technology in Scientific Research: Looking to the Future. , 2021, Sleep.

[7]  Ronald E. Gangnon,et al.  Accuracy of Wearable Trackers for Measuring Moderate- to Vigorous-Intensity Physical Activity: A Systematic Review and Meta-Analysis , 2020, Journal for the Measurement of Physical Behaviour.

[8]  Ryan B. Featherstone,et al.  Sleep timing, sleep consistency, and health in adults: a systematic review. , 2020, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[9]  N. Dutt,et al.  Sleep Tracking of a Commercially Available Smart Ring and Smartwatch Against Medical-Grade Actigraphy in Everyday Settings: Instrument Validation Study , 2020, JMIR mHealth and uHealth.

[10]  S. Redline,et al.  Self-reported sleep duration and timing: A methodological review of event definitions, context, and timeframe of related questions , 2020, medRxiv.

[11]  M. Kangas,et al.  Compositional Associations of Sleep and Activities within the 24-h Cycle with Cardiometabolic Health Markers in Adults , 2020, Medicine and science in sports and exercise.

[12]  John P. Buckley,et al.  A comparison of self-reported and device measured sedentary behaviour in adults: a systematic review and meta-analysis , 2020, International Journal of Behavioral Nutrition and Physical Activity.

[13]  S. Mavoa,et al.  Assessing Physical Activity and Sedentary Behavior under Free-Living Conditions: Comparison of Active Style Pro HJA-350IT and ActiGraphTM GT3X+ , 2019, International journal of environmental research and public health.

[14]  Heikki Kyröläinen,et al.  Training-induced changes in daily energy expenditure: Methodological evaluation using wrist-worn accelerometer, heart rate monitor, and doubly labeled water technique , 2019, PloS one.

[15]  A. Goldstone,et al.  Wearable Sleep Technology in Clinical and Research Settings. , 2019, Medicine and science in sports and exercise.

[16]  S. Redline,et al.  Concordance between Self-Reported and Actigraphy-Assessed Sleep Duration among African-American Adults: Findings from the Jackson Heart Sleep Study. , 2019, Sleep.

[17]  M. Buman,et al.  The 24-Hour Activity Cycle: A New Paradigm for Physical Activity , 2019, Medicine and science in sports and exercise.

[18]  I. Colrain,et al.  The Sleep of the Ring: Comparison of the ŌURA Sleep Tracker Against Polysomnography , 2019, Behavioral sleep medicine.

[19]  Maarit Kangas,et al.  Calibration and validation of accelerometer-based activity monitors: A systematic review of machine-learning approaches. , 2019, Gait & posture.

[20]  Karel Hron,et al.  Compositional data analysis for physical activity, sedentary time and sleep research , 2018, Statistical methods in medical research.

[21]  Joseph Cheung,et al.  Use of Actigraphy for the Evaluation of Sleep Disorders and Circadian Rhythm Sleep-Wake Disorders: An American Academy of Sleep Medicine Systematic Review, Meta-Analysis, and GRADE Assessment. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[22]  A. Bauman,et al.  Health outcomes associated with reallocations of time between sleep, sedentary behaviour, and physical activity: a systematic scoping review of isotemporal substitution studies , 2018, International Journal of Behavioral Nutrition and Physical Activity.

[23]  Ilene M Rosen,et al.  Consumer Sleep Technology: An American Academy of Sleep Medicine Position Statement. , 2018, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[24]  E. Tomasi,et al.  Calibration of raw accelerometer data to measure physical activity: A systematic review. , 2018, Gait & posture.

[25]  M. Bucan,et al.  Estimating sleep parameters using an accelerometer without sleep diary , 2018, bioRxiv.

[26]  Aiden R. Doherty,et al.  Automated detection of sleep-boundary times using wrist-worn accelerometry , 2017, bioRxiv.

[27]  C. Crainiceanu,et al.  Epidemiology of objectively measured bedtime and chronotype in US adolescents and adults: NHANES 2003–2006 , 2017, Chronobiology international.

[28]  S. Keinänen-Kiukaanniemi,et al.  Measuring Physical Activity in Free-Living Conditions—Comparison of Three Accelerometry-Based Methods , 2017, Front. Physiol..

[29]  P. F. Anderson,et al.  Sleep Tracking, Wearable Technology, and Opportunities for Research and Clinical Care. , 2016, Chest.

[30]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[31]  Jianwen Cai,et al.  Comparison of Self-Reported Sleep Duration With Actigraphy: Results From the Hispanic Community Health Study/Study of Latinos Sueño Ancillary Study. , 2016, American journal of epidemiology.

[32]  P. Dagnelie,et al.  Identifying waking time in 24-h accelerometry data in adults using an automated algorithm , 2016, Journal of sports sciences.

[33]  Orfeu M Buxton,et al.  Practical considerations in using accelerometers to assess physical activity, sedentary behavior, and sleep. , 2015, Sleep health.

[34]  Dawn A. Skelton,et al.  Combined Effects of Time Spent in Physical Activity, Sedentary Behaviors and Sleep on Obesity and Cardio-Metabolic Health Markers: A Novel Compositional Data Analysis Approach , 2015, PloS one.

[35]  Philipp Scholl,et al.  Towards Benchmarked Sleep Detection with Wrist-Worn Sensing Units , 2014, 2014 IEEE International Conference on Healthcare Informatics.

[36]  P. Virtanen,et al.  Effects of habitual physical activity on response to endurance training , 2012, Journal of sports sciences.

[37]  Paul J Rathouz,et al.  Self-Reported and Measured Sleep Duration: How Similar Are They? , 2008, Epidemiology.

[38]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[39]  A. Czeisler Charles,et al.  Glossary of Standardized Terminology for SleepBiological Rhythm Research , 1980 .

[40]  A. D. Lees Biological Rhythm Research , 1965, Nature.

[41]  T. Barreira,et al.  Validity of a Novel Algorithm to Detect Bedtime, Wake Time, and Sleep Time in Adults , 2022, Journal for the Measurement of Physical Behaviour.

[42]  Guideline on the Use of Actigraphy for the Evaluation of Sleep Disorders and Circadian Rhythm Sleep-Wake Disorders , 2018 .

[43]  Christopher D. Chambers,et al.  Redefine statistical significance , 2017, Nature Human Behaviour.

[44]  E. V. van Someren,et al.  Sleep estimates using microelectromechanical systems (MEMS). , 2013, Sleep.