Real time head tracking and face and eyes detection

This paper presents a novel algorithm to detect face and eyes in a reliable manner with a stereo camera. With the combination of stereo tracking method for object detection and tracking and structure-based method and example-based learning approach for face detection a real time and robust system is built. Human head detection is implemented with a stereo vision system, where a layered scenery is obtained from the depth image. With head-shoulder contour model applied to the disparity image, a fast head detection algorithm is developed. On the head detected, which also tells the rough scale of it, a hybrid face detection algorithm is proposed for face pattern detection and eyes location. By applying the face structure model and facial components model, face candidates in images are obtained for the later validating of face pattern. The support vector machine (SVM) is adopted here to select the good samples that form a classification boundary to classify face and non-face patterns.

[1]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[2]  Robert Mariani,et al.  Face detection and precise eyes location , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  James L. Crowley,et al.  Vision for man machine interaction , 1995 .

[4]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[7]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Alex Waibel,et al.  Tracking Eyes and Monitoring Eye Gaze , 1997 .

[10]  Qian Chen,et al.  Face detection by fuzzy pattern matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Chung-Lin Huang,et al.  Human facial feature extraction for face interpretation and recognition , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[12]  Takeo Kanade,et al.  Human Face Detection in Visual Scenes , 1995, NIPS.

[13]  Roberto Cipolla,et al.  Feature-based human face detection , 1997, Image Vis. Comput..

[14]  Yan Guo,et al.  Real-time stereo tracking of multiple moving heads , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[15]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[16]  Michael Bruenig,et al.  Locating human faces in color images with complex background , 1999 .

[17]  Chin-Chuan Han,et al.  Fast face detection via morphology-based pre-processing , 2000, Pattern Recognit..

[18]  Robert C. Bolles,et al.  Background modeling for segmentation of video-rate stereo sequences , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  Venu Govindaraju,et al.  A computational model for face location , 1990, [1990] Proceedings Third International Conference on Computer Vision.