Helena: Real-time Contact-free Monitoring of Sleep Activities and Events around the Bed

In this paper, we introduce a novel real-time and contact-free sensor system, Helena, that can be mounted on a bed frame to continuously monitor sleep activities (entry/exit of bed, movement, and posture changes), vital signs (heart rate and respiration rate), and falls from bed in a real-time and pervasive computing manner. The smart sensor senses bed vibrations generated by body movements to characterize sleep activities and vital signs based on advanced signal processing and machine learning methods. The device can provide information about sleep patterns, generate real-time results, and support continuous sleep assessment and health tracking. The novel method for detecting falls from bed has not been attempted before and represents a life-changing for high-risk communities, such as seniors. Comprehensive tests and validations were conducted to evaluate system performances using FDA approved and wearable devices. Our system has an accuracy of 99.5% detecting on-bed (entries), 99.73% detecting off-bed (exits), 97.92% detecting movements on the bed, 92.08% detecting posture changes, and 97% detecting falls from bed. The system estimation of heart rate (HR) ranged ±2.41 beats-per-minute compared to Apple Watch Series 4, while the respiration rate (RR) ranged ±0.89 respiration-per-minute compared to an FDA oximeter and a metronome.

[1]  Shwetak N. Patel,et al.  WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  A. Johansson Neural network for photoplethysmographic respiratory rate monitoring , 2003, Medical and Biological Engineering and Computing.

[3]  Raghunath S. Holambe,et al.  Nonlinear Measurement and Modeling Using Teager Energy Operator , 2012 .

[4]  Xiangyang Li,et al.  Indoor Person Identification and Fall Detection through Non-intrusive Floor Seismic Sensing , 2019, 2019 IEEE International Conference on Smart Computing (SMARTCOMP).

[5]  Joseph Finkelstein,et al.  Consumer Sleep Tracking Devices: A Critical Review , 2015, MIE.

[6]  Susheel P. Patil,et al.  Portable Sleep Monitoring for Diagnosing Sleep Apnea in Hospitalized Patients With Heart Failure , 2018, Chest.

[7]  Christine E. Krohn,et al.  Geophone ground coupling , 1984 .

[8]  Jian Liu,et al.  Motion Scale: A Body Motion Monitoring System Using Bed-Mounted Wireless Load Cells , 2016, 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[9]  Wen-Zhan Song,et al.  Automatic arrival identification system for real-time microseismic event location , 2017 .

[10]  Emil Jovanov Preliminary analysis of the use of smartwatches for longitudinal health monitoring , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  B. Feige,et al.  Cerebral correlates of heart rate variations during a spontaneous panic attack in the fMRI scanner , 2009, Neurocase.

[12]  Kuo-Lun Hsiao,et al.  What drives smartwatch adoption intention? Comparing Apple and non-Apple watches , 2017, Libr. Hi Tech.

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Jose Clemente,et al.  Smart Seismic Sensing for Indoor Fall Detection, Location, and Notification , 2020, IEEE Journal of Biomedical and Health Informatics.

[15]  Renjie Huang,et al.  Design and Deployment of Sensor Network for Real-Time High-Fidelity Volcano Monitoring , 2010, IEEE Transactions on Parallel and Distributed Systems.

[16]  Pei Zhang,et al.  Monitoring a Person's Heart Rate and Respiratory Rate on a Shared Bed Using Geophones , 2017, SenSys.

[17]  Anand Sivasubramaniam,et al.  HB-Phone: A Bed-Mounted Geophone-Based Heartbeat Monitoring System , 2017, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[18]  Goutham Kamath,et al.  Real-time In-situ Seismic Imaging: Overview and Case Study , 2015 .

[19]  Kaigang Li,et al.  Heart rate measures from the Apple Watch, Fitbit Charge HR 2, and electrocardiogram across different exercise intensities , 2019, Journal of sports sciences.

[20]  Hae Young Noh,et al.  FootprintID , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[21]  Vivian Christensen,et al.  Technology Assessment: Early Sense for Monitoring Vital Signs in Hospitalized Patients , 2016 .

[22]  Hae Young Noh,et al.  Indoor Person Identification through Footstep Induced Structural Vibration , 2015, HotMobile.

[23]  Jose Clemente,et al.  ASIS: Autonomous Seismic Imaging System With In Situ Data Analytics and Renewable Energy , 2020, IEEE Systems Journal.

[24]  Wen-Zhan Song,et al.  NON-INTRUSIVE AND NON-CONTACT SLEEP MONITORING WITH SEISMOMETER , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[25]  J. Schwartz,et al.  Abstract MP11: Fitbit: An Accurate and Reliable Device for Wireless Physical Activity Tracking , 2015 .

[26]  Fangyu Li,et al.  Smart Home Monitoring System via Footstep-Induced Vibrations , 2020, IEEE Systems Journal.