Using backpropagation neural network for face recognition with 2D + 3D hybrid information

Biometric measurements received an increasing interest for security applications in the last two decades. After the 911 terrorist attacks, face recognition has been an active research in this area. However, very few research group focus on face recognition from both 2D and 3D facial images. Almost all existing recognition systems rely on a single type of face information: 2D intensity (or color) image or 3D range data set [Wang, Y., Chua, C., & Ho, Y. (2002). Facial feature detection and face recognition from 3D and 3D images. Pattern Recognition Letters, 23, 1191-1202]. The objective of this study is to develop an effective face recognition system that extracts and combines 2D and 3D face features to improve the recognition performance. The proposed method derived the information of 3D face (disparity face) using a designed synchronous Hopfield neural network. Then, we retrieved 2D and 3D face features with principle component analysis (PCA) and local autocorrelation coefficient (LAC) respectively. Eventually, the information of features was learned and classified using backpropagation neural networks. An experiment was conducted with 100 subjects, and for each subject thirteen stereo face images were taken with different expressions. Among them, seven faces with expressions were used for training, and the rest of the expressions were used for testing. The experimental results show that the proposed method effectively improved the recognition rate by combining the 2D with 3D face information.

[1]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[2]  Evangelos E. Milios,et al.  Matching range images of human faces , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Marc Acheroy,et al.  Face verification from 3D and grey level clues , 2001, Pattern Recognit. Lett..

[4]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[6]  Eamonn J. Keogh,et al.  An Enhanced Representation of Time Series Which Allows Fast and Accurate Classification, Clustering and Relevance Feedback , 1998, KDD.

[7]  J. Cartoux,et al.  Face authentification or recognition by profile extraction from range images , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[8]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Horst Bunke,et al.  Face recognition using range images , 1997, Proceedings. International Conference on Virtual Systems and MultiMedia VSMM '97 (Cat. No.97TB100182).

[10]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[11]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[12]  Te-Hsiu Sun,et al.  IMPROVING STEREO MATCHING QUALITY WITH SCANLINE-BASED ASYNCHRONOUS HOPFIELD NEURAL NETWORKS , 2007 .

[13]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[14]  Takio Kurita,et al.  Scale invariant face detection method using higher-order local autocorrelation features extracted from log-polar image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  Gaile G. Gordon,et al.  Face recognition based on depth maps and surface curvature , 1991, Optics & Photonics.

[17]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Marc Rioux,et al.  Face recognition with range images and intensity images , 1997 .

[19]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[20]  Jean-Philippe Thiran,et al.  Pattern recognition using higher-order local autocorrelation coefficients , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[21]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..

[22]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[23]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[24]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[25]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[26]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Shihong Lao,et al.  3D template matching for pose invariant face recognition using 3D facial model built with isoluminance line based stereo vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[28]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[29]  Te-Hsiu Sun,et al.  Face recognition using 2D and disparity eigenface , 2007, Expert Syst. Appl..

[30]  I. Masuda,et al.  3D facial image analysis for human identification , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[31]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[32]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[33]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[34]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..

[35]  A. Samani,et al.  Automatic Face Recognition Using Stereo Images , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[36]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[37]  Kazuo Kyuma,et al.  Face Recognition System Using Local Autocorrelations and Multiscale Integration , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .