Vision-based 3D head pose tracking using fuzzy classifier-based face segmentation and silhouette volume intersection

This electronic document is a “live” template and already defines the components of your paper [title, text, heads, etc.] in its style sheet. **CRITICAL: Do Not Use Symbols, Special Characters, or Math in Paper Title or Abstract. This paper proposes a three-dimensional (3D) head pose tracking method using fuzzy classifier-based face segmentation and silhouette volume intersection techniques. The fuzzy classifier consists of clustering-based antecedent parameter learning and linear support vector machine-based consequent parameter learning. A stereo webcam is used to capture two images at the same time. The fuzzy classifier is applied to segment two-dimensional (2D) human face skin pixels in the Cb and Cr color space and in each of the two captured images. Based on the 2D segmented regions, the silhouette volume intersection method is used to find the regions of the face in 3D space. The average 3D coordinate of the face region is computed and is used to estimate the orientation of the face in real-time. This paper sets up a real-time 3D virtual head pose following system to verify the effectiveness of the proposed approach.

[1]  Mohan M. Trivedi,et al.  Articulated body posture estimation from multi-camera voxel data , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Chia-Feng Juang,et al.  A Fuzzy System Constructed by Rule Generation and Iterative Linear SVR for Antecedent and Consequent Parameter Optimization , 2012, IEEE Transactions on Fuzzy Systems.

[4]  Raphaël Féraud,et al.  A Fast and Accurate Face Detector Based on Neural Networks , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mohan M. Trivedi,et al.  Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness , 2010, IEEE Transactions on Intelligent Transportation Systems.

[6]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[7]  Chengjun Liu,et al.  Face detection using discriminating feature analysis and Support Vector Machine , 2006, Pattern Recognit..

[8]  Ioannis Pitas,et al.  3-D Head Pose Estimation in Monocular Video Sequences Using Deformable Surfaces and Radial Basis Functions , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[10]  Chia-Feng Juang,et al.  Radar Pulse Compression for Point Target and Distributed Target Using Neural Network , 2007, J. Inf. Sci. Eng..

[11]  Chia-Feng Juang,et al.  Block Histogram-Based Neural Fuzzy Approach to the Segmentation of Skin Colors , 2007, J. Inf. Sci. Eng..

[12]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[13]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[14]  Takeshi Ohashi,et al.  Motion generator approach to translating human motion from video to animation , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[15]  Kajiro Watanabe,et al.  Kinematical analysis and measurement of sports form , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Transactions on Fuzzy Systems.

[17]  Chia-Feng Juang,et al.  Object detection by color histogram-based fuzzy classifier with support vector learning , 2009, Neurocomputing.

[18]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.