Sleep monitoring via depth video compression & analysis

Quality of sleep greatly affects a person's physiological well-being. Traditional sleep monitoring systems are expensive in cost and intrusive enough that they disturb natural sleep of clinical patients. In this paper, we propose an inexpensive non-intrusive sleep monitoring system using recorded depth video only. In particular, we propose a two-part solution composed of depth video compression and analysis. For acquisition and compression, we first propose an alternating-frame video recording scheme, so that different 8 of the 11 bits in MS Kinect captured depth images are extracted at different instants for efficient encoding using H.264 video codec. At decoder, the uncoded 3 bits in each frame can be recovered accurately via a block-based search procedure. For analysis, we estimate parameters of our proposed dual-ellipse model in each depth image. Sleep events are then detected via a support vector machine trained on statistics of estimated ellipse model parameters over time. Experimental results show first that our depth video compression scheme outperforms a competing scheme that records only the eight most significant bits in PSNR in mid- to high-bitrate regions. Further, we show also that our monitoring can detect critical sleep events such as hypopnoea using our trained SVM with very high success rate.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Oscar C. Au,et al.  Depth map compression using multi-resolution graph-based transform for depth-image-based rendering , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  Erry,et al.  Prospective study of the association between sleep-disordered breathing and hypertension. , 2000, The New England journal of medicine.

[5]  PROCEssIng magazInE IEEE Signal Processing Magazine , 2004 .

[6]  Ram Nevatia,et al.  Body Part Detection for Human Pose Estimation and Tracking , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[7]  D. Falie,et al.  Respiratory motion visualization and the sleep apnea diagnosis with the time of flight (ToF) camera , 2008 .

[8]  Paul L. Rosin Analysing Error of Fit Functions for Ellipses , 1996, BMVC.

[9]  Toshiaki Fujii,et al.  Free-Viewpoint TV , 2011, IEEE Signal Processing Magazine.

[10]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[11]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[12]  Aljoscha Smolic,et al.  Coding and intermediate view synthesis of multiview video plus depth , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[13]  Atul Malhotra,et al.  Obstructive sleep apnoea , 2002, The Lancet.

[14]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[15]  Oscar C. Au,et al.  Rate-distortion optimized 3D reconstruction from noise-corrupted multiview depth videos , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Ming-Sui Lee,et al.  Breath and Position Monitoring during Sleeping with a Depth Camera , 2012, HEALTHINF.

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..