Image-based Face Recognition: Issues and Methods 1

As one of the most successful applications of image analysis and understanding, face recognition has recently gained signiicant attention, especially during the past several years. There are at least two reasons for such a trend: the rst is the wide range of commercial and law enforcement applications and the second is the availability of feasible technologies after 35 years of research. Moreover, recent signiicant advances in multimedia processing has also helped to advance the applications of face recognition technology. Among the diverse contents of multimedia, face objects are particularly important. For example, a database software capable of searching for face objects or a particular face object is very useful. Another example is a security system that is able to automatically track human objects, and report their IDs. Though tracking and recognizing face objects is a routine task for humans, building such a system is still an active research. Among many proposed face recognition schemes, image based approaches are possibly the most promising ones. However, the 2D images/patterns of 3D face objects can dramatically change due to lighting and viewing variations. Hence, illumination and pose problems present signiicant obstacles for wide applications of this type of approaches. In this chapter, we rst review existing methods extensively. And then we propose using a generic 3D model to enhance existing systems. More speciically, we use the 3D model to synthesize the so-called prototype image from a given image acquired under diierent lighting and viewing conditions. The advantages of this approach are computational simplicity and system robustness which are essential for many real applications.

[1]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[2]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Rama Chellappa,et al.  Robust image based face recognition , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Rama Chellappa,et al.  A reliable descriptor for face objects in visual content , 2000, Signal Process. Image Commun..

[5]  Rama Chellappa,et al.  Illumination-insensitive face recognition using symmetric shape-from-shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Rama Chellappa,et al.  SFS based view synthesis for robust face recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[8]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[9]  Ronald-Bryan O. Alferez,et al.  Geometric and Illumination Invariants for Object Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  R. Chellappa,et al.  Subspace Linear Discriminant Analysis for Face Recognition , 1999 .

[11]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[12]  Hyeonjoon Moon,et al.  The FERET verification testing protocol for face recognition algorithms , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  Ronen Basri,et al.  Comparing images under variable illumination , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[14]  David J. Kriegman,et al.  Illumination cones for recognition under variable lighting: faces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Shimon Ullman,et al.  Recognizing novel 3-D objects under new illumination and viewing position using a small number of example views or even a single view , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[18]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Paul A. Griffin,et al.  Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images , 1996, Neural Computation.

[21]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[23]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[24]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[25]  Christoph von der Malsburg,et al.  Single-View Based Recognition of Faces Rotated in Depth , 1995 .

[26]  David Beymer,et al.  Face recognition under varying pose , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Peter W. Hallinan.  A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  L. B. Wolff,et al.  3-D Stereo Using Photometric Ratios , 1994, ECCV.

[31]  A. Shashua.  Geometry and Photometry in 3D Visual Recognition , 1992 .

[32]  Mubarak Shah,et al.  A fast linear shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Rama Chellappa,et al.  A feature based approach to face recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Gaile G. Gordon,et al.  Face recognition based on depth maps and surface curvature , 1991, Optics & Photonics.

[36]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..