Tracking a Detected Face with Dynamic Programming

In this paper we consider the problem of tracking of moving human face in front of a video camera in real-time for a Model-based coding (MBC) application. The 3D head tracking in a MBC system could be implemented sequentially as 2D location tracking, coarse 3D orientation estimation and accurate 3D motion estimation. This work focuses on the 2D location tracking of one subject face object through continuously using a face detector. The face detection scheme is based on a boosted cascade of simple Haar-like feature classifiers. Although such detector demonstrated rapid processing speed, high detection rate can only be achieved for rather strictly near front faces. This introduces the "loss of tracking" problem in 2D tracking when the face rotate a big angle. This paper suggests an easy accessory solution to overcomes the pose problem by using Dynamic Programming (DP). The Haar-like facial features are spatially arranging into a 1D deformable face graph and the DP matching is used to handle the "loss of track" problem. DP match the deformed version of the face graph extracted from a rotated face with the reference one took online when "loss of tracking" happen. Since the deformable face graph covers big pose variation, the developed technique is robust in tracking rotated faces. Embedding Haar-like facial features into a deformable face graph is the key feature of our tracking scheme. A real time tracking system based on this technique has been set up and tested. Encouraging results have been got and are reported.

[1]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[3]  Shaogang Gong,et al.  Tracking Facial Feature Points with Gabor Wavelets and Shape Models , 1997, AVBPA.

[4]  Kentaro Toyama,et al.  Prolegomena for Robust Face Tracking , 1998 .

[5]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..

[6]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[7]  Cordelia Schmid,et al.  Face Detection and Tracking in a Video by Propagating Detection Probabilities , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Tomaso A. Poggio,et al.  Example-Based Object Detection in Images by Components , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Yali Amit,et al.  Graphical Templates for Model Registration , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  William H. Press,et al.  Numerical recipes in C , 2002 .

[14]  J. Omura,et al.  On the Viterbi decoding algorithm , 1969, IEEE Trans. Inf. Theory.

[15]  Christoph von der Malsburg,et al.  Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[16]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.