Smart Sleep Monitoring System via Passively Sensing Human Vibration Signals

In this paper, a bed-mounted vibration sensor-based system is proposed to monitor vital parameters during sleep, including heartbeat rate (HR) and respiratory rate (RR), body movements and sleep postures. Our system enables smart healthcare that monitors daily sleep in a ubiquitous and non-invasive manner. Besides, the system is contact-free, as no external wearable devices and physical contacts are required. Furthermore, the vibration-based approach also avoids the privacy violation caused by the usage of surveillance cameras. To effectively monitor sleep status, a robust stable signal mode decomposition based HR and RR estimation method is developed for the complicated and noisy vibration signals. Besides, algorithms for body movement and sleep posture identification are also proposed based on vibration signal features. A prototype system is demonstrated with system details, showing great potentials in monitoring sleep status in a real-time user-friendly manner. Experimental results of short term and long term experiments with different participants and beds show that our system achieves satisfying accuracy compared with dedicated commercial devices.

[1]  Anand Sivasubramaniam,et al.  HB-Phone: A Bed-Mounted Geophone-Based Heartbeat Monitoring System , 2017, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[2]  Yunyoung Nam,et al.  Sleep Monitoring Based on a Tri-Axial Accelerometer and a Pressure Sensor , 2016, Sensors.

[3]  Shwetak N. Patel,et al.  Seismo: Blood Pressure Monitoring using Built-in Smartphone Accelerometer and Camera , 2018, CHI.

[4]  Li-Chun Wang,et al.  Stream data analysis of body sensors for sleep posture monitoring: An automatic labelling approach , 2017, 2017 26th Wireless and Optical Communication Conference (WOCC).

[5]  Ajit Pratap Kundan,et al.  Grafana , 2021, Monitoring Cloud-Native Applications.

[6]  Hisato Kobayashi,et al.  Development of an unobtrusive vital signs detection system using conductive fiber sensors , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Yoshiharu Yonezawa,et al.  A system for monitoring cardiac vibration, respiration, and body movement in bed using an infrared , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[8]  Wen-Zhan Song,et al.  NON-INTRUSIVE AND NON-CONTACT SLEEP MONITORING WITH SEISMOMETER , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[9]  Jose Clemente,et al.  Smart Seismic Sensing for Indoor Fall Detection, Location, and Notification , 2020, IEEE Journal of Biomedical and Health Informatics.

[10]  Fangyu Li,et al.  Helena: Real-time Contact-free Monitoring of Sleep Activities and Events around the Bed , 2020, 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[11]  Pei Zhang,et al.  Monitoring a Person's Heart Rate and Respiratory Rate on a Shared Bed Using Geophones , 2017, SenSys.

[12]  Fangyu Li,et al.  Waveform Inversion-Assisted Distributed Reverse Time Migration for Microseismic Location , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Kouhyar Tavakolian,et al.  Ballistocardiography and Seismocardiography: A Review of Recent Advances , 2015, IEEE Journal of Biomedical and Health Informatics.

[14]  F. Rizzo,et al.  Wearable seismocardiography: Towards a beat-by-beat assessment of cardiac mechanics in ambulant subjects , 2013, Autonomic Neuroscience.

[15]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[16]  Steffen Leonhardt,et al.  Multi-channel optical sensor-array for measuring ballistocardiograms and respiratory activity in bed , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Patrick Flandrin,et al.  A complete ensemble empirical mode decomposition with adaptive noise , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Paolo Barsocchi,et al.  The Meaning of Sleep Quality: A Survey of Available Technologies , 2019, IEEE Access.

[19]  Gregory T. A. Kovacs,et al.  Novel methods for estimating the ballistocardiogram signal using a simultaneously acquired electrocardiogram , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Wen-Zhan Song,et al.  Dynamic Time-frequency Feature Extraction for Brain Activity Recognition , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[22]  A.M. Adami,et al.  Detection and Classification of Movements in Bed using Load Cells , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[23]  Jose Clemente,et al.  ASIS: Autonomous Seismic Imaging System With In Situ Data Analytics and Renewable Energy , 2020, IEEE Systems Journal.

[24]  E. Zimlichman,et al.  Contactless respiratory and heart rate monitoring: validation of an innovative tool , 2010, Journal of medical engineering & technology.

[25]  Ara Darzi,et al.  A lightweight sensing platform for monitoring sleep quality and posture: a simulated validation study , 2018, European Journal of Medical Research.

[26]  Yoshiharu Yonezawa,et al.  A sensor for monitoring pulse rate, respiration rhythm, and body movement in bed , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Jian Liu,et al.  Motion Scale: A Body Motion Monitoring System Using Bed-Mounted Wireless Load Cells , 2016, 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[28]  Shwetak N. Patel,et al.  WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[29]  Daqing Zhang,et al.  Unobtrusive Sleep Posture Detection for Elder-Care in Smart Home , 2010, ICOST.

[30]  Fangyu Li,et al.  Smart Home Monitoring System via Footstep-Induced Vibrations , 2020, IEEE Systems Journal.

[31]  Zhiguo Cao,et al.  Real-Time Detection of Fall From Bed Using a Single Depth Camera , 2019, IEEE Transactions on Automation Science and Engineering.

[32]  Jürgen Kosel,et al.  Wearable Flexible Sensors: A Review , 2017, IEEE Sensors Journal.

[33]  D. Mant,et al.  Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: a systematic review of observational studies , 2011, The Lancet.

[34]  Jose Clemente,et al.  Demo: Contactless Device for Monitoring On-Bed Activities and Vital Signs , 2019, 2019 IEEE International Conference on Smart Computing (SMARTCOMP).

[35]  Wen-Zhan Song,et al.  Automatic arrival identification system for real-time microseismic event location , 2017 .

[36]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[37]  Lei Yang,et al.  A Human ECG Identification System Based on Ensemble Empirical Mode Decomposition , 2013, Sensors.

[38]  Marimuthu Palaniswami,et al.  Ensemble Empirical Mode Decomposition With Principal Component Analysis: A Novel Approach for Extracting Respiratory Rate and Heart Rate From Photoplethysmographic Signal , 2018, IEEE Journal of Biomedical and Health Informatics.