SleepPoseNet: Multi-View Multi-Task Learning for Sleep Postural Transition Recognition Using UWB

Recognizing the movements during sleep is crucial for monitoring of patients with sleep disorders. However, the utilization of the deep learning approaches ultra-wideband (UWB)-based indoor applications for the classification of human sleeping postures has not been explored widely. This study investigates the performance of the off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View Multi-Task Learning, entitled SleepPoseNet or SPN, with time series data augmentation aims to classify four standard SPTs. SPN exhibits an ability to capture both time and frequency features, including the movement and direction of sleeping positions. Three cost functions for multi-views, multi-tasks, and classification are proposed to optimize SPN. The data recorded from 26 volunteers displayed that SPN with mean accuracy of $79.7 \pm 0.5 \%$ significantly outperformed the mean accuracy of $73.5 \pm 0.7 \%$ obtained from deep convolution neural network (DCNN) in a recent state-of-the-art work on human activity recognition using UWB. Apart from UWB system, SPN with the data augmentation can ultimately be adopted to learn and classify time series data in various applications. \end{abstract}

[1]  Xiangyu Wang,et al.  Design and Implementation of a Noncontact Sleep Monitoring System Using Infrared Cameras and Motion Sensor , 2018, IEEE Transactions on Instrumentation and Measurement.

[2]  Ekapol Chuangsuwanich,et al.  Universal Joint Feature Extraction for P300 EEG Classification Using Multi-Task Autoencoder , 2018, IEEE Access.

[3]  Yuan-Ting Zhang,et al.  Heartbeats Based Biometric Random Binary Sequences Generation to Secure Wireless Body Sensor Networks , 2018, IEEE Transactions on Biomedical Engineering.

[4]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.

[5]  Xiaohua Zhu,et al.  Non-Contact Human Motion Recognition Based on UWB Radar , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[6]  Jiguang Sun,et al.  Through-Wall Detection of Human Being's Movement by UWB Radar , 2012, IEEE Geoscience and Remote Sensing Letters.

[7]  Youngwook Kim,et al.  Application of ultra-wide band radar for classification of human activities , 2012 .

[8]  Liming Chen,et al.  Computational Sleep Behavior Analysis: A Survey , 2019, IEEE Access.

[9]  Jun-Young Park,et al.  A Novel Non-contact Heart Rate Monitor Using Impulse-Radio Ultra-Wideband (IR-UWB) Radar Technology , 2018, Scientific Reports.

[10]  Xiaohua Zhu,et al.  Noncontact Sleep Stage Estimation Using a CW Doppler Radar , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[11]  Majid Sarrafzadeh,et al.  A dense pressure sensitive bedsheet design for unobtrusive sleep posture monitoring , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[12]  Clodagh M Ryan,et al.  Sleep Apnea and Stroke. , 2015, The Canadian journal of cardiology.

[13]  Theerawit Wilaiprasitporn,et al.  MetaSleepLearner: Fast Adaptation of Bio-signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning , 2020, ArXiv.

[14]  Guohong Cao,et al.  SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Theerawit Wilaiprasitporn,et al.  Affective EEG-Based Person Identification Using the Deep Learning Approach , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[16]  Po-Lei Lee,et al.  Detection of Breathing and Heart Rates in UWB Radar Sensor Data Using FVPIEF-Based Two-Layer EEMD , 2019, IEEE Sensors Journal.

[17]  G. Mancardi,et al.  Risk of Occupational Accidents in Workers with Obstructive Sleep Apnea: Systematic Review and Meta-analysis. , 2016, Sleep.

[18]  Yan Li,et al.  Evaluation of pulse oximeter derived photoplethysmographic signals for obstructive sleep apnea diagnosis , 2017, Medicine.

[19]  Susan Redline,et al.  Sleep Apnea and Cardiovascular Disease: Lessons From Recent Trials and Need for Team Science. , 2017, Circulation.

[20]  Xinming Huang,et al.  Respiration and Heartbeat Rates Measurement Based on Autocorrelation Using IR-UWB Radar , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  Craig Valli,et al.  Finger-to-Heart (F2H): Authentication for Wireless Implantable Medical Devices , 2019, IEEE Journal of Biomedical and Health Informatics.

[22]  Yu Hu,et al.  Body-Earth Mover’s Distance: A Matching-Based Approach for Sleep Posture Recognition , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[23]  Sung Ho Cho,et al.  Movement analysis during sleep using an IR-UWB radar sensor , 2016, 2016 IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC).

[24]  Xiaohua Zhu,et al.  Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Zhi Liu,et al.  Contactless Body Movement Recognition During Sleep via WiFi Signals , 2020, IEEE Internet of Things Journal.

[26]  G. Buela-Casal,et al.  Workplace accidents, absenteeism and productivity in patients with sleep apnea. , 2015, Archivos de bronconeumologia.

[27]  Tor Sverre Lande,et al.  Vital Sign Monitoring Through the Back Using an UWB Impulse Radar With Body Coupled Antennas , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[28]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  R.J. Fontana,et al.  Recent system applications of short-pulse ultra-wideband (UWB) technology , 2004, IEEE Transactions on Microwave Theory and Techniques.

[30]  Heye Zhang,et al.  Quantitative Assessment for Self-Tracking of Acute Stress Based on Triangulation Principle in a Wearable Sensor System , 2019, IEEE Journal of Biomedical and Health Informatics.

[31]  Xiaohua Zhu,et al.  Non-Contact Human Activity Classification using DCNN based on UWB Radar , 2019, 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC).

[32]  Youngwook Kim,et al.  Application of Linear Predictive Coding for Human Activity Classification Based on Micro-Doppler Signatures , 2014, IEEE Geoscience and Remote Sensing Letters.

[33]  Seán F. McLoone,et al.  Noncontact Pressure-Based Sleep/Wake Discrimination , 2017, IEEE Transactions on Biomedical Engineering.

[34]  Jiguang Sun,et al.  Through-Wall Detection of the Moving Paths and Vital Signs of Human Beings , 2019, IEEE Geoscience and Remote Sensing Letters.

[35]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[36]  Shwetak N. Patel,et al.  DoppleSleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar , 2015, UbiComp.

[37]  Wenyao Xu,et al.  SleepSense: A Noncontact and Cost-Effective Sleep Monitoring System , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[38]  Theerawit Wilaiprasitporn,et al.  Improving Heart Rate Estimation on Consumer Grade Wrist-Worn Device Using Post-Calibration Approach , 2019, IEEE Sensors Journal.

[39]  Miad Faezipour,et al.  Bed posture classification for pressure ulcer prevention , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Youngwook Kim,et al.  Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[41]  Eiji Oki,et al.  ECG Monitoring System Integrated With IR-UWB Radar Based on CNN , 2016, IEEE Access.

[42]  A.E. Fathy,et al.  Accurate UWB indoor localization system utilizing time difference of arrival approach , 2006, 2006 IEEE Radio and Wireless Symposium.

[43]  Amardeep Singh,et al.  Self-Identification Respiratory Disorder Based on Continuous Wave Radar Sensor System , 2019, IEEE Access.

[44]  Moe Z. Win,et al.  The ultra-wide bandwidth indoor channel: from statistical model to simulations , 2002, IEEE J. Sel. Areas Commun..

[45]  Xiaohua Zhu,et al.  A Noncontact Breathing Disorder Recognition System Using 2.4-GHz Digital-IF Doppler Radar , 2019, IEEE Journal of Biomedical and Health Informatics.

[46]  Mary Ann Weitnauer,et al.  Detection of motion and posture change using an IR-UWB radar , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).