On importance of nose for face tracking

Human nose, while being in many cases the only facial feature clearly visible during the head motion, seems to be very undervalued in face tracking technology. This paper shows theoretically and by experiments conducted with ordinary USB cameras that, by properly defining nose as an extremum of the 3D curvature of the nose surface, nose becomes the most robust feature which can be seen for almost any position of the head and which can be tracked very precisely, even with low resolution cameras.

[1]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[2]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.

[3]  Kiyoharu Aizawa,et al.  Detection and tracking of facial features , 1995, Other Conferences.

[4]  Frans Voorbraak.  Reasoning with Uncertainty in AI , 1995, Reasoning with Uncertainty in Robotics.

[5]  Roberto Cipolla,et al.  Finding initial estimates of human face location , 1995 .

[6]  Roberto Cipolla,et al.  Fast visual tracking by temporal consensus , 1996, Image Vis. Comput..

[7]  Dmitry O. Gorodnichy,et al.  Adaptive Logic Networks for Facial Feature Detection , 1997, ICIAP.

[8]  Dmitry O. Gorodnichy,et al.  Static and Dynamic Attractors of Auto-associative Neural Networks , 1997, ICIAP.

[9]  Ming Xu,et al.  Detecting head pose from stereo image sequence for active face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  D. Burr,et al.  Large receptive fields for optic flow detection in humans , 1998, Vision Research.

[11]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[12]  Alexander H. Waibel,et al.  Real-Time Face and Facial Feature Tracking and Applications , 1998, AVSP.

[13]  Kentaro Toyama,et al.  “Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking , 1998 .

[14]  W. W. Armstrong,et al.  Single Camera Stereo for Mobile Robot World Exploration , 1999 .

[15]  Rama Chellappa,et al.  Robust Face Recognition Using Symmetric Shape-from-Shading , 1999 .

[16]  Brendan J. Frey,et al.  Detection and tracking of faces and facial features , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[17]  Eun-Jung Holden,et al.  A 3D Head Tracker for an Automatic Lipreading System , 2000 .

[18]  Rama Chellappa,et al.  Illumination-insensitive face recognition using symmetric shape-from-shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Alexander Zelinsky,et al.  Real-time stereo tracking for head pose and gaze estimation , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[20]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[21]  Dmitry O. Gorodnichy.  Nouse ‘Use Your Nose as a Mouse’ – a New Technology for Hands-free Games and Interfaces , 2002 .

[22]  Dmitry O. Gorodnichy,et al.  Affordable 3D Face Tracking Using Projective Vision , 2002 .

[23]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Azriel Rosenfeld,et al.  Robust regression methods for computer vision: A review , 1991, International Journal of Computer Vision.