Real-time face pose estimation

Abstract Methods were investigated for estimating the poses of human faces undergoing large rotations in depth. Dimensionality reduction using principal components analysis enabled pose changes to be visualised as manifolds in low-dimensional subspaces and provided a useful mechanism for investigating these changes. Appearance-based matching using Gabor wavelets was developed for real-time face tracking and pose estimation. A real-time Gabor wavelet projection was implemented using a Datacube MaxVideo 250 whilst an alternative system for real-time pose estimation used only standard PC hardware.

[1]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[2]  Roberto Cipolla,et al.  Fast visual tracking by temporal consensus , 1996, Image Vis. Comput..

[3]  S. Nayar,et al.  Early Visual Learning , 1996 .

[4]  Nikos K. Logothetis,et al.  Spatial Reference Frames for Object Recognition Tuning for Rotations in Depth , 1995 .

[5]  Tony Ezzat,et al.  Facial analysis and synthesis using image-based models , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  William T. Freeman,et al.  Example-based head tracking , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[8]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[9]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[10]  Alex Pentland,et al.  Motion regularization for model-based head tracking , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[12]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[14]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[16]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[17]  I. G. Priest.  THE OPTICAL SOCIETY OF AMERICA. , 1922, Science.

[18]  Shaogang Gong,et al.  Tracking Facial Feature Points with Gabor Wavelets and Shape Models , 1997, AVBPA.

[19]  Shaogang Gong,et al.  Tracking faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[20]  Tomaso Poggio,et al.  Image Representations for Visual Learning , 1996, Science.

[21]  Norbert Krüger,et al.  Face Recognition and Gender determination , 1995 .

[22]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[23]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[24]  Martin Bichsel.  Automatic interpolation and recognition of face images by morphing , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[25]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  David Beymer,et al.  Face recognition under varying pose , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Roberto Cipolla,et al.  Determining the gaze of faces in images , 1994, Image Vis. Comput..

[28]  Alex Pentland,et al.  Visually Controlled Graphics , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  David Machin,et al.  Real-time facial motion analysis for virtual teleconferencing , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[32]  Norbert Krüger,et al.  Estimation of Face Position and Pose with Labeled Graphs , 1996, BMVC.

[33]  Rolf P. Würtz,et al.  Multilayer dynamic link networks for establishing image point correspondences and visual object recognition , 1995 .

[34]  Alex Pentland,et al.  Task-Specific Gesture Analysis in Real-Time Using Interpolated Views , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Christoph von der Malsburg,et al.  Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.