Real-Time Nose Detection and Tracking Based on AdaBoost and Optical Flow Algorithms

In this paper we present a fast and robust nose detection and tracking application which runs on a consumer-grade computer with video input from an inexpensive Universal Serial Bus camera. Nose detection is based on the AdaBoost algorithm with Haar-like features. A detailed study was developed to select the positive and negative training samples and the parameters of the detector. Pyramidal Lucas-Kanade optical flow tracking algorithm is applied to the nostrils from a previous nose detection in a frame of a video sequence. Tracking takes 2 ms and is robust to different face positions, backgrounds and illumination. The nose detection and tracking application can be used alone or integrated in a hand-free vision-based Human-Computer Interface.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[2]  Milos Stojmenovic.  Real Time Machine Learning Based Car Detection in Images With Fast Training , 2006, Machine Vision and Applications.

[3]  Julie A. Jacko.  HCI Intelligent multimodal interaction environments , 2007 .

[4]  Dmitry O. Gorodnichy,et al.  Nouse 'use your nose as a mouse' perceptual vision technology for hands-free games and interfaces , 2004, Image Vis. Comput..

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Tieniu Tan,et al.  Combining local features for robust nose location in 3D facial data , 2006, Pattern Recognit. Lett..

[7]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[9]  Hyung-Il Choi,et al.  Real Time Face Tracking with Pyramidal Lucas-Kanade Feature Tracker , 2007, ICCSA.

[10]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  Xiaoke Yang,et al.  Human-Computer Interaction System Based on Nose Tracking , 2007, HCI.

[13]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[14]  Marina L. Gavrilova,et al.  Computational Science and Its Applications - ICCSA 2007, International Conference, Kuala Lumpur, Malaysia, August 26-29, 2007. Proceedings, Part I , 2007, ICCSA.