Real-time facial features tracker with motion estimation and feedback

Real-time automatic face tracking is a great challenge in computer vision and computer graphics. We develop a system to automatically track the face by integrating auto-generation of features of first frame, feature correspondence and Kalman filter based on face attribution and motion estimation. First, facial features of the first frame are acquired automatically by face detachment and Plessey corner detector according to FDP in MPEG-4 based on anatomical knowledge and general 3D model. Feature correspondence is obtained by maximizing the cross-correlation and Kalman filter. Automatic face detection makes full use of the knowledge of 3D general model and face attribute, and face tracking is more efficient by using motion estimation. Experimental results show the high prospect of this algorithm.

[1]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[2]  Aaron F. Bobick,et al.  Closed-world tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[4]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Jörgen Ahlberg Using the active appearance algorithm for face and facial feature tracking , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[6]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[7]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  A. Pentland,et al.  Real time tracking and modeling of faces: an EKF-based analysis by synthesis approach , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.