Automated face tracking with self correction capability

Face Tracking is one of the most challenging topics in computer vision. Various face tracking methods have been proposed. However most of them have not ability to correct error and divergence in face tracking process. In this paper we propose a new method for face tracking using face detection and object tracking simultaneously to utilize their advantages at once. For minimizing error and divergence from target, we propose a feedback system based on Local Binary Pattern (LBP) and several rules to provide this opportunity that detection and tracking systems can cooperate with each other, so that ability of one system cover disability of another one. We demonstrate the performance and effectiveness of the proposed method on a number of challenging videos. These test video sequences show that proposed method is robust to pose variations, illumination changes and occlusions. Quantitatively, proposed method achieves the average root mean square error at 6.78 on the well-known Dudek video sequence. Experimental results show reliability of the proposed method.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Mohammad T. Manzuri Shalmani,et al.  A Real-Time Color-Independent Method for Multiple Faces Tracking , 2007, 6th IEEE International Conference on Cognitive Informatics.

[4]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[6]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[7]  L. Darrell Whitley,et al.  Adaptive Appearance Model and Condensation Algorithm for Robust Face Tracking , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[8]  Svetha Venkatesh,et al.  Combining multiple tracking algorithms for improved general performance , 2001, Pattern Recognit..

[9]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[10]  Myung Jin Chung,et al.  Robust multi-view face tracking , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Jong-Hwan Kim,et al.  Fast and Robust Face Detection Using Evolutionary Pruning , 2008, IEEE Transactions on Evolutionary Computation.

[12]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Arturo de la Escalera,et al.  Driver Drowsiness Warning System Using Visual Information for Both Diurnal and Nocturnal Illumination Conditions , 2010, EURASIP J. Adv. Signal Process..