Multi-modal (2-D and 3-D) face modeling and recognition using Attributed Relational Graph

In this paper we present a unified graph model, called Attributed Relational Graph (ARG), for multi-modal face modeling and recognition. Based on the ARG model, the 2-D and 3-D data are included in a single model. The developed ARG model consists of nodes, edges, and mutual relations. The nodes of the graph correspond to the landmark points that are extracted by an improved Active Shape Model (ASM) technique. Then, at each node of the graph, the responses of a set of log-Gabor filters to the facial image texture and shape information (depth values) are calculated; the filter responses are used to model the local structure of the face at each node of the graph. The edges of the graph are defined based on Delaunay triangulation and a set of mutual relations between the sides of the triangles are defined. The mutual relations boost the final performance of the system. The results of face matching using the 2-D and 3-D attributes and the mutual relations are fused at the score level. A rank-one identification rate of 99% is achieved by experimenting on the University of Miami face database.

[1]  Mohammad H. Mahoor,et al.  A multimodal approach for 3D face modeling and recognition using 3D deformable facial mask , 2009, Machine Vision and Applications.

[2]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[3]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[4]  Afzal Godil,et al.  Face recognition using 3D facial shape and color map information: comparison and combination , 2004, SPIE Defense + Commercial Sensing.

[5]  Mohammad H. Mahoor,et al.  Facial features extraction in color images using enhanced active shape model , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[6]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[7]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[8]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[9]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[10]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.

[11]  Arun Ross,et al.  Handbook of Multibiometrics (International Series on Biometrics) , 2006 .

[12]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[13]  Anil K. Jain,et al.  Matching 2.5D Scans for Face Recognition , 2004, ICBA.

[14]  Stan Z. Li,et al.  Matching: Invariant to translations, rotations and scale changes , 1992, Pattern Recognit..

[15]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[16]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[17]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[19]  Sang Uk Lee,et al.  Face recognition using face-ARG matching , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Abdulnasser A. Al-Ansari.  3D face mesh modeling with applications to 3D and 2D face recognition , 2007 .

[21]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..