Skin colour segmentation based 2D and 3D human pose modelling using Discrete Wavelet Transform

Tracking of human body and their pose models from a video data is important in the indoor surveillance applications. The objective of this paper is to develop a human pose modelling in two-dimensional and three dimensional views using wavelet based skin colour segmentation for the monocular videos. The approximation information of the Discrete Wavelet Transform (DWT) is used for segmenting the human body from the video frame and to find the skin features. The human pose modelling is proposed by detecting thirteen features from the upper body as well as in the lower body. Here, twelve human poses are considered for the analysis. In this paper, the hardware system is implemented for monitoring the human poses by sending the SMS message. Also, the efficiencies of 2D modelling and 3D modelling for the pre-defined poses are evaluated.

[1]  Ling Li,et al.  Motion Recovery Based on Feature Extraction from 2D Images , 2004, ICCVG.

[2]  William T. Freeman,et al.  Bayesian Reconstruction of 3D Human Motion from Single-Camera Video , 1999, NIPS.

[3]  Naoufel Werghi.  A discriminative 3D wavelet-based descriptors: Application to the recognition of human body postures , 2005, Pattern Recognit. Lett..

[4]  Tetsuya Takiguchi,et al.  3D Human Posture Estimation Using HOG Features of Monocular Images , 2009 .

[5]  Jun-Wei Hsieh,et al.  Video-Based Human Movement Analysis and Its Application to Surveillance Systems , 2008, IEEE Transactions on Multimedia.

[6]  Marc Pollefeys,et al.  A Factorization-Based Approach for Articulated Nonrigid Shape, Motion and Kinematic Chain Recovery From Video , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Pascal Fua,et al.  LEAST SQUARES MATCHING TRACKING ALGORITHM FOR HUMAN BODY MODELING , 2003 .

[8]  Masahide Kaneko,et al.  Skin-Color-Based Image Segmentation and Its Application in Face Detection , 2002, MVA.

[9]  Radu Horaud,et al.  Human Motion Tracking by Registering an Articulated Surface to 3D Points and Normals , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  A. Chekima,et al.  Wavelet-based skin segmentation for detecting occluded arms in human body pose modelling system , 2007, 2007 International Conference on Intelligent and Advanced Systems.

[11]  Jake K. Aggarwal,et al.  Human motion: modeling and recognition of actions and interactions , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[12]  Andrew Zisserman,et al.  Progressive search space reduction for human pose estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Rong-Chun Zhao,et al.  Automatic Video Object Segmentation Using Wavelet Transform and Moving Edge Detection , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[15]  S. Sclaroff,et al.  Tracking Human Body Pose on a Learned Smooth Space , 2005 .

[16]  Bodo Rosenhahn,et al.  Automatic Human Model Generation , 2005, CAIP.

[17]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[18]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Fang-Hsuan Cheng,et al.  Real time multiple objects tracking and identification based on discrete wavelet transform , 2006, Pattern Recognit..

[20]  Sangho Park,et al.  Human motion: modeling and recognition of actions and interactions , 2004 .

[21]  Ioannis A. Kakadiaris,et al.  Model-Based Estimation of 3D Human Motion , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Carlo S. Regazzoni,et al.  Human body modelling for people localization and tracking from real image sequences , 1995 .

[23]  Larry S. Davis,et al.  Context and observation driven latent variable model for human pose estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Javier Varona,et al.  Automatic Human Body Modeling for Vision-Based Motion Capture , 2012 .

[25]  Carlos Orrite-Uruñuela,et al.  2D silhouette and 3D skeletal models for human detection and tracking , 2004, ICPR 2004.

[26]  Tetsuya Takiguchi,et al.  3D human posture estimation using the HOG features from monocular image , 2008, 2008 19th International Conference on Pattern Recognition.

[27]  Mun Wai Lee,et al.  A model-based approach for estimating human 3D poses in static images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Naoufel Werghi,et al.  Wavelet moments for recognizing human body posture from 3D scans , 2002, Object recognition supported by user interaction for service robots.

[29]  Xiao-Ping Zhang,et al.  Wavelet based automatic thresholding for image segmentation , 1997, Proceedings of International Conference on Image Processing.

[30]  S. Ipson,et al.  Face detection based neural networks using robust skin color segmentation , 2008, 2008 5th International Multi-Conference on Systems, Signals and Devices.

[31]  Wen Gao,et al.  An adaptive skin color detection algorithm with confusing backgrounds elimination , 2005, IEEE International Conference on Image Processing 2005.