Contactless Camera-Based Sleep Staging: The HealthBed Study

Polysomnography (PSG) remains the gold standard for sleep monitoring but is obtrusive in nature. Advances in camera sensor technology and data analysis techniques enable contactless monitoring of heart rate variability (HRV). In turn, this may allow remote assessment of sleep stages, as different HRV metrics indirectly reflect the expression of sleep stages. We evaluated a camera-based remote photoplethysmography (PPG) setup to perform automated classification of sleep stages in near darkness. Based on the contactless measurement of pulse rate variability, we use a previously developed HRV-based algorithm for 3 and 4-class sleep stage classification. Performance was evaluated on data of 46 healthy participants obtained from simultaneous overnight recording of PSG and camera-based remote PPG. To validate the results and for benchmarking purposes, the same algorithm was used to classify sleep stages based on the corresponding ECG data. Compared to manually scored PSG, the remote PPG-based algorithm achieved moderate agreement on both 3 class (Wake–N1/N2/N3–REM) and 4 class (Wake–N1/N2–N3–REM) classification, with average κ of 0.58 and 0.49 and accuracy of 81% and 68%, respectively. This is in range with other performance metrics reported on sensing technologies for wearable sleep staging, showing the potential of video-based non-contact sleep staging.

[1]  Joana M. Warnecke,et al.  Continuous Monitoring of Vital Signs Using Cameras: A Systematic Review , 2022, Sensors.

[2]  Albertus C. den Brinker,et al.  Modified Camera Setups for Day-and-Night Pulse-rate Monitoring , 2021, 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[3]  Ronald M. Aarts,et al.  A deep transfer learning approach for wearable sleep stage classification with photoplethysmography , 2021, npj Digital Medicine.

[4]  Sander Stuijk,et al.  Automatic Separation of Respiratory Flow from Motion in Thermal Videos for Infant Apnea Detection , 2021, Sensors.

[5]  M. Winter,et al.  The accuracy of heartbeat detection using photoplethysmography technology in cardiac patients. , 2021, Journal of electrocardiology.

[6]  S. Pillen,et al.  It is All in the Wrist: Wearable Sleep Staging in a Clinical Population versus Reference Polysomnography , 2021, Nature and science of sleep.

[7]  Syed Anas Imtiaz,et al.  A Systematic Review of Sensing Technologies for Wearable Sleep Staging , 2021, Sensors.

[8]  S. Overeem,et al.  Camera-Based Vital Signs Monitoring During Sleep – A Proof of Concept Study , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Thomas Penzel,et al.  3D Camera and Pulse Oximeter for Respiratory Events Detection , 2020, IEEE Journal of Biomedical and Health Informatics.

[10]  J P van Dijk,et al.  Direct application of an ECG-based sleep staging algorithm on reflective photoplethysmography data decreases performance , 2020, BMC Research Notes.

[11]  Oleg Antropov,et al.  Vital Sign Monitoring Using FMCW Radar in Various Sleeping Scenarios , 2020, Sensors.

[12]  Takao Onoye,et al.  Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging , 2020, Sensors.

[13]  S. Viskin,et al.  Continuous heart rhythm monitoring using mobile photoplethysmography in ambulatory patients. , 2020, Journal of electrocardiology.

[14]  P. Anderer,et al.  Automatic sleep staging using heart rate variability, body movements, and recurrent neural networks in a sleep disordered population. , 2020, Sleep.

[15]  Desta Fekedulegn,et al.  Actigraphy-Based Assessment of Sleep Parameters. , 2020, Annals of work exposures and health.

[16]  Ronald M. Aarts,et al.  Sleep stage classification from heart-rate variability using long short-term memory neural networks , 2019, Scientific Reports.

[17]  A. Goldstone,et al.  Wearable Sleep Technology in Clinical and Research Settings. , 2019, Medicine and science in sports and exercise.

[18]  Yuko Ohno,et al.  Sleep stage estimation method using a camera for home use , 2019, Biomedical engineering letters.

[19]  Adrian Hilton,et al.  Sleep Posture Classification using a Convolutional Neural Network , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Gerard de Haan,et al.  Fully-Automatic Camera-Based Pulse-Oximetry During Sleep , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  C. Oliver,et al.  Sleep duration and sleep quality in people with and without intellectual disability: A meta-analysis. , 2017, Sleep medicine reviews.

[22]  Ronald M. Aarts,et al.  Validation of Photoplethysmography-Based Sleep Staging Compared With Polysomnography in Healthy Middle-Aged Adults , 2017, Sleep.

[23]  Bradley V Vaughn,et al.  AASM Scoring Manual Version 2.2 Updates: New Chapters for Scoring Infant Sleep Staging and Home Sleep Apnea Testing. , 2015, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[24]  Sander Stuijk,et al.  Motion Robust Remote-PPG in Infrared , 2015, IEEE Transactions on Biomedical Engineering.

[25]  Xi Long,et al.  A novel low-complexity post-processing algorithm for precise QRS localization , 2014, SpringerPlus.

[26]  J. Solet,et al.  Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. , 2013, Sleep.

[27]  Olivier Mairesse,et al.  Is a one-night stay in the lab really enough to conclude? First-night effect and night-to-night variability in polysomnographic recordings among different clinical population samples , 2012, Psychiatry Research.

[28]  Martin Wolf,et al.  An Efficient Algorithm for Automatic Peak Detection in Noisy Periodic and Quasi-Periodic Signals , 2012, Algorithms.

[29]  Daniel Austin,et al.  Unobtrusive classification of sleep and wakefulness using load cells under the bed , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Yachuan Pu,et al.  Heart rate variability, sleep and sleep disorders. , 2012, Sleep medicine reviews.

[31]  D. Falie,et al.  Sleep monitoring and sleep apnea event detection using a 3D camera , 2010, 2010 8th International Conference on Communications.

[32]  Xiaorong Gao,et al.  THE RELATIONSHIP OF HRV TO SLEEP EEG AND SLEEP RHYTHM , 2005, The International journal of neuroscience.

[33]  A. Varri,et al.  The SIESTA project polygraphic and clinical database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[34]  O. E. Herrmann,et al.  ECG baseline wander reduction using linear phase filters. , 1986, Computers and biomedical research, an international journal.