Toward study of features associated with natural sleep posture using a depth sensor

Estimating the sleeping posture of a person under natural resting environment is a very complex problem. In this study, a new non-invasive framework is proposed for exploring features defining sleep postures of a person. Three dimensional depth scans as well as the cross-sectional scans of the static sleeping body are developed using the measured depth data. These features can then be used in order to estimate the changes in patterns associated with the head, limbs and torso position in depth images. Scans of the sleeping postures are taken at various cross sectional directions. 1D and 2D Fast Fourier Transformation are explored in order to provide complementary feature of the scans. We also generate grids on the horizontal sleeping plane. In the depth image, each grid has a quadrangle configuration which can further be divided into two triangular meshes. We calculated a surface normal vector to each of the mesh. Given a 2D scan strip perpendicular for the sleeping plane, variations of the normal along such scan strips can be used as other local features. These selected features can be further integrated as a part of natural sleep posture estimation methods.

[1]  Luc Van Gool,et al.  Real Time Head Pose Estimation from Consumer Depth Cameras , 2011, DAGM-Symposium.

[2]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  David A. Forsyth,et al.  Finding and tracking people from the bottom up , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Reinhard Koch,et al.  Nonlinear Body Pose Estimation from Depth Images , 2005, DAGM-Symposium.

[5]  Gene Cheung,et al.  Graph-based depth video denoising and event detection for sleep monitoring , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[6]  Jitendra Malik,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Ming-Sui Lee,et al.  Multiparameter Sleep Monitoring Using a Depth Camera , 2012, BIOSTEC.

[8]  Abhishek Kar,et al.  Skeletal Tracking using Microsoft Kinect , 2011 .

[9]  Jitendra Malik,et al.  Poselets: Body part detectors trained using 3D human pose annotations , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Daniel P. Huttenlocher,et al.  Efficient matching of pictorial structures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Jake K. Aggarwal,et al.  Human detection using depth information by Kinect , 2011, CVPR 2011 WORKSHOPS.

[12]  David A. Forsyth,et al.  Probabilistic Methods for Finding People , 2001, International Journal of Computer Vision.

[13]  Stephen J. McKenna,et al.  Human Pose Estimation Using Learnt Probabilistic Region Similarities and Partial Configurations , 2004, ECCV.

[14]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[15]  Matthew L. Lamb,et al.  Christianity Within the Political Dialectics of Community and Empire , 1983 .

[16]  Andrew Hunter,et al.  A robust pose matching algorithm for covered body analysis for sleep apnea , 2008, 2008 8th IEEE International Conference on BioInformatics and BioEngineering.

[17]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[18]  D. Falie,et al.  Respiratory motion visualization and the sleep apnea diagnosis with the time of flight (ToF) camera , 2008 .