Vectorizing Face Images by Interleaving Shape and Texture Computations

The correspondence problem in computer vision is basically a matching task between two or more sets of features. In this paper, we introduce a vectorized image representation, which is a feature-based representation where correspondence has been established with respect to a reference image. This representation has two components: (1) shape, or (x, y) feature locations, and (2) texture, defined as the image grey levels mapped onto the standard reference image. This paper explores an automatic technique for ``vectorizing'''' face images. Our face vectorizer alternates back and forth between computation steps for shape and texture, and a key idea is to structure the two computations so that each one uses the output of the other. A hierarchical coarse-to-fine implementation is discussed, and applications are presented to the problems of facial feature detection and registration of two arbitrary faces.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[3]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..

[5]  Demetri Terzopoulos,et al.  Analysis of facial images using physical and anatomical models , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[6]  George Wolberg,et al.  Digital image warping , 1990 .

[7]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[8]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Demetri Terzopoulos,et al.  Modelling and animating faces using scanned data , 1991, Comput. Animat. Virtual Worlds.

[10]  Ian Craw,et al.  Parameterising Images for Recognition and Reconstruction , 1991 .

[11]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[12]  W. J. Welsh,et al.  Classification of facial features for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yehezkel Yeshurun,et al.  Robust detection of facial features by generalized symmetry , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[15]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[16]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[17]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[18]  Ian Craw,et al.  Face Recognition by Computer , 1992, BMVC.

[19]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[20]  Tomaso Poggio,et al.  A Novel Approach to Graphics , 1992 .

[21]  Yasuhito Suenaga,et al.  An accurate and robust face identification scheme , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[22]  Tomaso Poggio,et al.  Example Based Image Analysis and Synthesis , 1993 .

[23]  Timothy F. Cootes,et al.  Building and using flexible models using grey-level information , 1993, ICCV 1993.

[24]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[25]  K. Raghunath Rao,et al.  On the recognition of occluded shapes and generic faces using multiple-template expansion matching , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Lance Williams,et al.  Animating images with drawings , 1994, SIGGRAPH.

[27]  Alex Pentland,et al.  A vision system for observing and extracting facial action parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Timothy F. Cootes,et al.  Using grey-level models to improve active shape model search , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[29]  Michael Isard,et al.  3D position, attitude and shape input using video tracking of hands and lips , 1994, SIGGRAPH.

[30]  David C. Hogg,et al.  Learning Flexible Models from Image Sequences , 1994, ECCV.

[31]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Yehezkel Yeshurun,et al.  Normalization of face images using few anchors , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[33]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[34]  Tomaso A. Poggio,et al.  Model-based matching of line drawings by linear combinations of prototypes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[35]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[36]  Alex Pentland,et al.  Probabilistic visual learning for object detection , 1995, Proceedings of IEEE International Conference on Computer Vision.