SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB

Recognizing the movements during sleep is crucial for the monitoring of patients with sleep disorders. However, the utilization of Ultra-Wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of the off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View Learning, entitled SleepPoseNet or SPN, with time series data augmentation aims to classify four standard SPTs. SPN exhibits an ability to capture both time and frequency features, including the movement and direction of sleeping positions. The data recorded from 38 volunteers displayed that SPN with a mean accuracy of 73.7 ±0.8 % significantly outperformed the mean accuracy of 59.9 ±0.7 % obtained from deep convolution neural network (DCNN) in recent state-of-the-art work on human activity recognition using UWB. Apart from UWB system, SPN with the data augmentation can ultimately be adopted to learn and classify time series data in various applications.

[1]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Sung Ho Cho,et al.  Movement analysis during sleep using an IR-UWB radar sensor , 2016, 2016 IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC).

[3]  Clodagh M Ryan,et al.  Sleep Apnea and Stroke. , 2015, The Canadian journal of cardiology.

[4]  Liming Chen,et al.  Computational Sleep Behavior Analysis: A Survey , 2019, IEEE Access.

[5]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[6]  Yu Hu,et al.  Body-Earth Mover’s Distance: A Matching-Based Approach for Sleep Posture Recognition , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[7]  Xiaohua Zhu,et al.  Noncontact Sleep Stage Estimation Using a CW Doppler Radar , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[8]  Po-Lei Lee,et al.  Detection of Breathing and Heart Rates in UWB Radar Sensor Data Using FVPIEF-Based Two-Layer EEMD , 2019, IEEE Sensors Journal.

[9]  Ekapol Chuangsuwanich,et al.  Universal Joint Feature Extraction for P300 EEG Classification Using Multi-Task Autoencoder , 2018, IEEE Access.

[10]  Ming Yang,et al.  A Survey of Multi-View Representation Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[11]  G. Buela-Casal,et al.  Workplace accidents, absenteeism and productivity in patients with sleep apnea. , 2015, Archivos de bronconeumologia.

[12]  Xiaohua Zhu,et al.  Non-Contact Human Motion Recognition Based on UWB Radar , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[13]  Jiguang Sun,et al.  Through-Wall Detection of the Moving Paths and Vital Signs of Human Beings , 2019, IEEE Geoscience and Remote Sensing Letters.

[14]  Youngwook Kim,et al.  Application of ultra-wide band radar for classification of human activities , 2012 .

[15]  Zhi Liu,et al.  Contactless Body Movement Recognition During Sleep via WiFi Signals , 2020, IEEE Internet of Things Journal.

[16]  Mary Ann Weitnauer,et al.  Detection of motion and posture change using an IR-UWB radar , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Heye Zhang,et al.  Quantitative Assessment for Self-Tracking of Acute Stress Based on Triangulation Principle in a Wearable Sensor System , 2019, IEEE Journal of Biomedical and Health Informatics.

[18]  Shwetak N. Patel,et al.  DoppleSleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar , 2015, UbiComp.

[19]  Amardeep Singh,et al.  Self-Identification Respiratory Disorder Based on Continuous Wave Radar Sensor System , 2019, IEEE Access.

[20]  Wei Chen,et al.  MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-Signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning , 2020, IEEE Journal of Biomedical and Health Informatics.

[21]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[22]  Eiji Oki,et al.  ECG Monitoring System Integrated With IR-UWB Radar Based on CNN , 2016, IEEE Access.

[23]  Xiangyu Wang,et al.  Design and Implementation of a Noncontact Sleep Monitoring System Using Infrared Cameras and Motion Sensor , 2018, IEEE Transactions on Instrumentation and Measurement.

[24]  Majid Sarrafzadeh,et al.  A dense pressure sensitive bedsheet design for unobtrusive sleep posture monitoring , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[25]  Xinming Huang,et al.  Respiration and Heartbeat Rates Measurement Based on Autocorrelation Using IR-UWB Radar , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[26]  Wenyao Xu,et al.  SleepSense: A Noncontact and Cost-Effective Sleep Monitoring System , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[27]  Miad Faezipour,et al.  Bed posture classification for pressure ulcer prevention , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Jiguang Sun,et al.  Through-Wall Detection of Human Being's Movement by UWB Radar , 2012, IEEE Geoscience and Remote Sensing Letters.

[29]  Xiaohua Zhu,et al.  Non-Contact Human Activity Classification using DCNN based on UWB Radar , 2019, 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC).

[30]  Xiaohua Zhu,et al.  A Noncontact Breathing Disorder Recognition System Using 2.4-GHz Digital-IF Doppler Radar , 2019, IEEE Journal of Biomedical and Health Informatics.

[31]  Moe Z. Win,et al.  The ultra-wide bandwidth indoor channel: from statistical model to simulations , 2002, IEEE J. Sel. Areas Commun..

[32]  Seán F. McLoone,et al.  Noncontact Pressure-Based Sleep/Wake Discrimination , 2017, IEEE Transactions on Biomedical Engineering.

[33]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[34]  Yuan-Ting Zhang,et al.  Heartbeats Based Biometric Random Binary Sequences Generation to Secure Wireless Body Sensor Networks , 2018, IEEE Transactions on Biomedical Engineering.

[35]  Craig Valli,et al.  Finger-to-Heart (F2H): Authentication for Wireless Implantable Medical Devices , 2019, IEEE Journal of Biomedical and Health Informatics.

[36]  G. Mancardi,et al.  Risk of Occupational Accidents in Workers with Obstructive Sleep Apnea: Systematic Review and Meta-analysis. , 2016, Sleep.

[37]  Guohong Cao,et al.  SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[38]  Youngwook Kim,et al.  Application of Linear Predictive Coding for Human Activity Classification Based on Micro-Doppler Signatures , 2014, IEEE Geoscience and Remote Sensing Letters.

[39]  A.E. Fathy,et al.  Accurate UWB indoor localization system utilizing time difference of arrival approach , 2006, 2006 IEEE Radio and Wireless Symposium.

[40]  Xiaohua Zhu,et al.  Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Theerawit Wilaiprasitporn,et al.  Improving Heart Rate Estimation on Consumer Grade Wrist-Worn Device Using Post-Calibration Approach , 2019, IEEE Sensors Journal.

[42]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.

[43]  Youngwook Kim,et al.  Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network , 2016, IEEE Access.

[44]  Tor Sverre Lande,et al.  Vital Sign Monitoring Through the Back Using an UWB Impulse Radar With Body Coupled Antennas , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[45]  Theerawit Wilaiprasitporn,et al.  Affective EEG-Based Person Identification Using the Deep Learning Approach , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[46]  Yan Li,et al.  Evaluation of pulse oximeter derived photoplethysmographic signals for obstructive sleep apnea diagnosis , 2017, Medicine.

[47]  Susan Redline,et al.  Sleep Apnea and Cardiovascular Disease: Lessons From Recent Trials and Need for Team Science. , 2017, Circulation.

[48]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[49]  R.J. Fontana,et al.  Recent system applications of short-pulse ultra-wideband (UWB) technology , 2004, IEEE Transactions on Microwave Theory and Techniques.

[50]  Jun-Young Park,et al.  A Novel Non-contact Heart Rate Monitor Using Impulse-Radio Ultra-Wideband (IR-UWB) Radar Technology , 2018, Scientific Reports.