A complete and fully automated face verification system on mobile devices

Mobile devices have been widely used not only as a communication tool, but also a digital assistance to our daily life, which imposes high security concern on mobile devices. In this paper we present a natural and non-intrusive way to secure mobile devices, i.e. a complete and fully automated face verification system. It consists of three sub-systems: face detection, alignment and verification. The proposed subspace face/eye detector locates the eyes at a much higher precision than Adaboost face/eye detector. By utilizing attentional cascade strategy, the proposed face/eye detector achieves a comparable speed to Adaboost face/eye detector in this ''close-range'' application. The proposed approach that determines the class-specific threshold without sacrificing the training data for the validation data further boosts the performance. The proposed system is systematically evaluated on O2FN, AR and CAS-PEAL databases, and compared with many different approaches. Compared to the best competitive system, which is built upon Adaboost face/eye detector and ERE approach for face recognition, the proposed system reduces the overall equal error rate from 8.49% to 3.88% on the O2FN database, from 7.64% to 1.90% on the AR database and from 9.30% to 5.60% on the CAS-PEAL database. The proposed system is implemented on O2 XDA Flame and on average it takes 1.03s for the whole process, including face detection, eye detection and face verification.

[1]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yunhui Liu,et al.  An Efficient Face Normalization Algorithm Based on Eyes Detection , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Alex Pentland,et al.  Bayesian face recognition , 2000, Pattern Recognit..

[4]  Xudong Jiang,et al.  Linear Subspace Learning-Based Dimensionality Reduction , 2011, IEEE Signal Processing Magazine.

[5]  Anastasios Tefas,et al.  Class-Specific Kernel-Discriminant Analysis for Face Verification , 2007, IEEE Transactions on Information Forensics and Security.

[6]  Xudong Jiang,et al.  Asymmetric Principal Component and Discriminant Analyses for Pattern Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[8]  Raymond N. J. Veldhuis,et al.  Biometric Authentication System on Mobile Personal Devices , 2010, IEEE Transactions on Instrumentation and Measurement.

[9]  Xiaogang Wang,et al.  Dual-space linear discriminant analysis for face recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Matti Pietikäinen,et al.  Face and Eye Detection for Person Authentication in Mobile Phones , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[11]  Cong Geng,et al.  Face recognition based on the multi-scale local image structures , 2011, Pattern Recognit..

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tieniu Tan,et al.  Null Space Approach of Fisher Discriminant Analysis for Face Recognition , 2004, ECCV Workshop BioAW.

[14]  Chia-Wei Hsu,et al.  A Linear Feature Extraction for Multiclass Classification Problems Based on Class Mean and Covariance Discriminant Information , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Wen Gao,et al.  The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  Christian Schneider,et al.  Feature based Face Localization and Recognition on Mobile Devices , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[17]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[18]  Pong C. Yuen,et al.  Regularized discriminant analysis and its application to face recognition , 2003, Pattern Recognit..

[19]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[20]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[21]  Kwontaeg Choi,et al.  Realtime training on mobile devices for face recognition applications , 2011, Pattern Recognit..

[22]  Xudong Jiang,et al.  Fast eye localization based on pixel differences , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[23]  Pradeep K. Khosla,et al.  Real-time face verification system on a cell-phone using advanced correlation filters , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[24]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[25]  Kiyoung Moon,et al.  Real-Time Face Verification for Mobile Platforms , 2008, ISVC.

[26]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Jianfeng Ren,et al.  Eye detection based on rank order filter , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[28]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[29]  Xudong Jiang,et al.  Enhanced maximum likelihood face recognition , 2006 .

[30]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Dong Xu,et al.  Face Verification With Balanced Thresholds , 2007, IEEE Transactions on Image Processing.

[32]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Paolo Abeni,et al.  A Face Recognition System for Mobile Phones , 2006, ISSE.

[34]  Xilin Chen,et al.  Face as an index: Knowing who is who using a PDA , 2003, Int. J. Imaging Syst. Technol..

[35]  Daw-Tung Lin,et al.  Real-time eye detection using face-circle fitting and dark-pixel filtering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[36]  Qian Tao,et al.  Face verification for mobile personal devices , 2009 .

[37]  B. V. K. Vijaya Kumar,et al.  Face authentication from cell phone camera images with illumination and temporal variations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..