Robust Face Detection and Tracking for Real-Life Applications

In this paper, we propose a new face detection and tracking algorithm for real-life telecommunication applications, such as video conferencing, cellular phone and PDA. We combine template-based face detection and tracking method with color information to track a face regardless of various lighting conditions and complex backgrounds as well as the race. Based on our experiments, we generate robust face templates from wavelet-transformed lowpass and two highpass subimages at the second level low-resolution. However, since template matching is generally sensitive to the change of illumination conditions, we propose a new type of preprocessing method. Tracking method is applied to reduce the computation time and predict precise face candidate region even though the movement is not uniform. Facial components are also detected using k-means clustering and their geometrical properties. Finally, from the relative distance of two eyes, we verify the real face and estimate the size of facial ellipse. To validate face detection and tracking performance of our algorithm, we test our method using six different video categories of QCIF size which are recorded in dynamic environments.

[1]  Uday B. Desai,et al.  Finding faces in color images using wavelet transform , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[2]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[3]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[5]  Michael T. Orchard,et al.  Fast face detection using subspace discriminant wavelet features , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Venu Govindaraju,et al.  A computational model for face location , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[7]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[8]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[10]  G. Sommer,et al.  Affine real-time face tracking using a wavelet network , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[11]  Saad Ahmed Sirohey,et al.  Human Face Segmentation and Identification , 1998 .

[12]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Huitao Luo,et al.  Algorithms for video object detection and segmentation with application to content-based multimedia systems , 2000 .

[14]  M. F. Augusteijn,et al.  Identification of human faces through texture-based feature recognition and neural network technology , 1993, IEEE International Conference on Neural Networks.

[15]  Gang Xu,et al.  Rits Eye: a software-based system for real-time face detection and tracking using pan-tilt-zoom controllable camera , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[16]  Kin-Man Lam,et al.  An efficient approach for facial feature detection , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[17]  Zhu Liu,et al.  Face detection and tracking in video using dynamic programming , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[18]  J. F. Vega-Riveros,et al.  Review of motion analysis techniques , 1989 .

[19]  M. Ibrahim Sezan,et al.  A robust real-time face tracking algorithm , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[20]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Russell M. Mersereau,et al.  Model-based face tracking for dense motion field estimation , 2001, Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR 2001). Analysis and Understanding of Time Varying Imagery.

[22]  Harry Wechsler,et al.  Face recognition using binary image metrics , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[23]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Alexander H. Waibel,et al.  A real-time face tracker , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[25]  Weimin Huang,et al.  A robust approach to face and eyes detection from images with cluttered background , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[26]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  David C. Gibbon,et al.  Multi-modal system for locating heads and faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[28]  Roberto Cipolla,et al.  Detection of human faces under scale, orientation and viewpoint variations , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[29]  Alex Pentland,et al.  LAFTER: a real-time face and lips tracker with facial expression recognition , 2000, Pattern Recognit..

[30]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..