Face recognition using 2D and disparity eigenface

Face recognition has been a popular research topic in computer vision. Numerous different face recognition techniques have been developed owing to the growing number of real world applications. This study presents a face recognition method based on the stereo matching and eigenface techniques under a stereovision system. The proposed method aims to improve the performance of the 2D eigenface system by adding 3D information. 3D information (called disparity face) was derived by taking two faces of a subject simultaneously in different positions, and then the two faces were further matched using a scanlined-based asynchronous Hopfield neural network. After deriving 2D and 3D faces, we applied principal component analysis (PCA) to both faces to extract effective features for recognition. An experiment was conducted acquiring the facial images of 100 individuals. Each subject provides three pairs of faces with different expressions for training and testing. At the finals, the performance of face recognition using 2D faces, disparity faces, and a combination of the two was evaluated and compared. The experimental results reveal that a 3-5% improvement in recognition rate is achieved by using the additional depth information.

[1]  J. Cartoux,et al.  Face authentification or recognition by profile extraction from range images , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[2]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Vytautas Perlibakas,et al.  Distance measures for PCA-based face recognition , 2004, Pattern Recognit. Lett..

[5]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Shihong Lao,et al.  3D template matching for pose invariant face recognition using 3D facial model built with isoluminance line based stereo vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[8]  Horst Bunke,et al.  Face recognition using range images , 1997, Proceedings. International Conference on Virtual Systems and MultiMedia VSMM '97 (Cat. No.97TB100182).

[9]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[10]  Evangelos E. Milios,et al.  Matching range images of human faces , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[11]  Gaile G. Gordon,et al.  Face recognition based on depth maps and surface curvature , 1991, Optics & Photonics.

[12]  Marc Acheroy,et al.  Face verification from 3D and grey level clues , 2001, Pattern Recognit. Lett..

[13]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[14]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[15]  I. Masuda,et al.  3D facial image analysis for human identification , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[16]  Marc Rioux,et al.  Face recognition with range images and intensity images , 1997 .

[17]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[18]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[19]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[20]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[21]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[22]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[23]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..

[24]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[25]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[26]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[27]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..