Real time facial features tracking using an active vision system

In this paper, an active vision system used for real time facial features tracking is presented, where a human head region is searched using a stereo camera. This region is divided such that a person's nose will be searched in a smaller spatial domain. The 2D coordinates of the nose are determined based on a Haar classifier and colour segmentation. Its 3D coordinates, computed via the constraints of the epipolar geometry, represent a reference signal used within a control system for controlling the stereo camera's pan and tilt. A method for determining the system's parameters and for designing a proper controller is further proposed. The controller is design such that it integrates the maximum time delay that can be inserted into the control system by the machine vision component. Finally, the overall architecture is tested in a real facial feature tracking application.

[1]  Tamim Asfour,et al.  Active multi-view object search on a humanoid head , 2009, 2009 IEEE International Conference on Robotics and Automation.

[2]  Jorge Dias,et al.  A hierarchical Bayesian framework for multimodal active perception , 2012, Adapt. Behav..

[3]  Shankar P. Bhattacharyya,et al.  PID Controllers for Time Delay Systems , 2004 .

[4]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[5]  Nikos Fakotakis,et al.  An unconstrained method for lip detection in color images , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Ehud Rivlin,et al.  Zoom tracking and its applications , 2001, Machine Vision and Applications.

[7]  Mekki Ksouri,et al.  PI Control for Second Order Delay System with Tuning Parameter Optimization , 2009 .

[8]  Gigel Macesanu,et al.  Robust camera pose and scene structure analysis for service robotics , 2011, Robotics Auton. Syst..

[9]  R. Vijayanandh,et al.  Human face detection using color spaces and region property measures , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[10]  Michael J. Swain,et al.  Promising directions in active vision , 1993, International Journal of Computer Vision.

[11]  Gigel Macesanu,et al.  Time-delay analysis of a robotic stereo active vision system , 2011, 15th International Conference on System Theory, Control and Computing.

[12]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Peter Corke,et al.  Visual Control of Robots: High-Performance Visual Servoing , 1996 .

[15]  Rajeev Sharma,et al.  Role of active vision in optimizing visual feedback for robot control , 1997, Block Island Workshop on Vision and Control.

[16]  Mongi A. Abidi,et al.  3D Target Scale Estimation and Target Feature Separation for Size Preserving Tracking in PTZ Video , 2008, International Journal of Computer Vision.

[17]  Makoto Sato,et al.  An active stereo vision system based on neural pathways of human binocular motor system , 2007 .