An integrated robust approach for fast face tracking in noisy real-world videos with visual constraints

Face detection and tracking algorithms are used in computer vision applications due to the fact that they provide reliable and fast results. This paper describes a model for face tracking in video sequences using Open Source Computer Vision (OpenCV) software library. To increase the face tracking accuracy, we propose a real time face tracking algorithm based on integration of Continuously Adaptive Mean Shift (CAMShift) and kalman filter. First, haar cascade detects face in the video sequence; once the face is detected then other parts like eyes, nose and mouth are detected. After successful face region detection, key-points are extracted using Speeded Up Robust Features (SURF) framework and CAMShift algorithm applied. CAMShift algorithm calculates width, height and (x, y) coordinates of the face region and this information is provided to kalman filter. Kalman filter calculates new center and size of the bounding box. Based on the center information, face tracking takes place in further frames. The experimental results at the end of this paper clearly indicate that the proposed algorithm integrating CAMShift and kalman filter is better to each single approach. Using this algorithm, we can achieve faster speed in face tracking.

[1]  Abdelrasoul Jabar Alzubaidi,et al.  Extended Kalman Filter based Missile Tracking , 2014 .

[2]  Vladimir Pavlovic,et al.  Face tracking and recognition with visual constraints in real-world videos , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[4]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[5]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  H. S. Jayanna,et al.  Tracking multiple moving object based on combined color and centroid feature in video sequence , 2014, 2014 IEEE International Conference on Computational Intelligence and Computing Research.

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Y. P. Gowramma,et al.  A novel fused algorithm for human face tracking in video sequences , 2016, 2016 International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS).

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[11]  V. Vijayakumari,et al.  Face Recognition Techniques: A Survey , 2013, International Journal of Advanced Trends in Computer Science and Engineering.

[12]  A. Pentland,et al.  Real time tracking and modeling of faces: an EKF-based analysis by synthesis approach , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[13]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.