Face Recognition in Adverse Conditions: A Look at Achieved Advancements

In this chapter, the authors discuss the main outcomes from both the most recent literature and the research activities summarized in this book. Of course, a complete review is not possible. It is evident that each issue related to face recognition in adverse conditions can be considered as a research topic in itself and would deserve a detailed survey of its own. However, it is interesting to provide a compass to orient one in the presently achieved results in order to identify open problems and promising research lines. In particular, the final chapter provides more detailed considerations about possible future developments.

[1]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[2]  Harry Wechsler,et al.  A Saccadic Vision System for Landmark Detection and Face Recognition , 1998 .

[3]  Richa Singh,et al.  Effect of plastic surgery on face recognition: A preliminary study , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Chi-Ho Chan,et al.  On the Results of the First Mobile Biometry (MOBIO) Face and Speaker Verification Evaluation , 2010, ICPR Contests.

[5]  Fabien Moutarde,et al.  Person re-identification in multi-camera system by signature based on interest point descriptors collected on short video sequences , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[6]  Stan Z. Li,et al.  Generalized quotient image , 2004, CVPR 2004.

[7]  Michele Nappi,et al.  CABALA - Collaborative architectures based on biometric adaptable layers and activities , 2012, Pattern Recognit..

[8]  Josef Kittler,et al.  Quality-Based Score Normalization With Device Qualitative Information for Multimodal Biometric Fusion , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  Michele Nappi,et al.  A Self-tuning People Identification System from Split Face Components , 2009, PSIVT.

[10]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[11]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Wen Gao,et al.  Hierarchical Ensemble of Global and Local Classifiers for Face Recognition , 2009, IEEE Trans. Image Process..

[14]  Stan Z. Li,et al.  2D–3D face matching using CCA , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[15]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[16]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Zhi-Chun Mu,et al.  Multimodal recognition based on face and ear , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[18]  Yuan Qi,et al.  Fully automatic upper facial action recognition , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[19]  Trevor Darrell,et al.  Toward Large-Scale Face Recognition Using Social Network Context , 2010, Proceedings of the IEEE.

[20]  Rama Chellappa,et al.  Facial similarity across age, disguise, illumination and pose , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[21]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[23]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[24]  Federico Delfino,et al.  Planning and Management of Distributed Energy Resources and Loads in a Smart Microgrid , 2014, Int. J. Monit. Surveillance Technol. Res..

[25]  Qiang Ji,et al.  A Comparative Study of Local Matching Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[26]  Jing-Yu Yang,et al.  Illumination invariant extraction for face recognition using neighboring wavelet coefficients , 2012, Pattern Recognit..

[27]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[28]  Yingxu Wang,et al.  A novel fuzzy multimodal information fusion technology for human biometric traits identification , 2011, IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11).

[29]  Fan Yang,et al.  Implementation of an RBF neural network on embedded systems: real-time face tracking and identity verification , 2003, IEEE Trans. Neural Networks.

[30]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Tomaso A. Poggio,et al.  Face recognition: component-based versus global approaches , 2003, Comput. Vis. Image Underst..

[32]  Himanshu S. Bhatt,et al.  Plastic Surgery: A New Dimension to Face Recognition , 2010, IEEE Transactions on Information Forensics and Security.

[33]  Tieniu Tan,et al.  Depth vs. intensity: which is more important for face recognition? , 2004, ICPR 2004.

[34]  Andrea F. Abate,et al.  Fast 3D Face Alignment and Improved Recognition Through Pyramidal Normal map Metric , 2007, 2007 IEEE International Conference on Image Processing.

[35]  Phalguni Gupta,et al.  Multibiometrics Belief Fusion , 2009, 2009 Second International Conference on Machine Vision.

[36]  Chang-Tsun Li,et al.  Fixation and Saccade Based Face Recognition from Single Image per Person with Various Occlusions and Expressions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[37]  Michele Nappi,et al.  Demographics versus Biometric Automatic Interoperability , 2013, ICIAP.

[38]  Michael J. Jones,et al.  Fully automatic pose-invariant face recognition via 3D pose normalization , 2011, 2011 International Conference on Computer Vision.

[39]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[40]  Antonio Albiol,et al.  Face recognition using HOG-EBGM , 2008, Pattern Recognit. Lett..

[41]  Majid Nili Ahmadabadi,et al.  A Hierarchical Face Identification System Based on Facial Components , 2007, 2007 IEEE/ACS International Conference on Computer Systems and Applications.

[42]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[43]  Tieniu Tan,et al.  Affective Computing: A Review , 2005, ACII.

[44]  Rabab Kreidieh Ward,et al.  Wavelet-based illumination normalization for face recognition , 2005, IEEE International Conference on Image Processing 2005.

[45]  Peter Eisert,et al.  2D-3D Mixed Face Recognition Schemes , 2008 .

[46]  Jian Sun,et al.  An associate-predict model for face recognition , 2011, CVPR 2011.

[47]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[48]  Guodong Guo,et al.  Face recognition by support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[49]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[50]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[51]  Richa Singh,et al.  Recognizing face images with disguise variations , 2014 .

[52]  Jun Luo,et al.  Person-Specific SIFT Features for Face Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[53]  Peter D. Bricker,et al.  The role of audible and visible back-channel responses in interpersonal communication. , 1977 .

[54]  Sabah Jassim,et al.  Image-Quality-Based Adaptive Face Recognition , 2010, IEEE Transactions on Instrumentation and Measurement.

[55]  Fabrizio Smeraldi,et al.  Facial features detection by saccadic exploration of the Gabor decomposition and Support Vector Machines , 1999 .

[56]  Josef Kittler,et al.  A Unified Framework for Biometric Expert Fusion Incorporating Quality Measures , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Abdulmotaleb El-Saddik,et al.  Transparent non-intrusive multimodal biometric system for video conference using the fusion of face and ear recognition , 2011, 2011 Ninth Annual International Conference on Privacy, Security and Trust.

[58]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[59]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[60]  Nigel Shadbolt,et al.  Brain power , 2003, IEEE Intelligent Systems.

[61]  Jonathan M. Smith,et al.  Engineering Privacy in Public: Confounding Face Recognition , 2003, Privacy Enhancing Technologies.

[62]  Richa Singh,et al.  Face recognition with disguise and single gallery images , 2009, Image Vis. Comput..

[63]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[64]  Chi Fang,et al.  2D face fitting-assisted 3D face reconstruction for pose-robust face recognition , 2011, Soft Comput..

[65]  Antonio Rama,et al.  P/sup 2/CA: a new face recognition scheme combining 2D and 3D information , 2005, IEEE International Conference on Image Processing 2005.

[66]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[67]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Yehezkel Yeshurun,et al.  Preprocessing of Face Images: Detection of Features and Pose Normalization , 1998, Comput. Vis. Image Underst..

[69]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Michele Nappi,et al.  Entropy-based template analysis in face biometric identification systems , 2013, Signal Image Video Process..

[71]  Mohammad H. Mahoor,et al.  Multi-modal biometric modeling and recognition of the human face and ear , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[72]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, SIGGRAPH 2008.

[73]  Michele Nappi,et al.  Robust Face Recognition after Plastic Surgery Using Local Region Analysis , 2011, ICIAR.

[74]  Jake K. Aggarwal,et al.  Human motion analysis: a review , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[75]  Dorin Comaniciu,et al.  Robust detection and tracking of human faces with an active camera , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[76]  Arun Ross,et al.  Mitigating effects of plastic surgery: Fusing face and ocular biometrics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[77]  Jean-Luc Dugelay,et al.  Geometric invariants for 2D/3D face recognition , 2007, Pattern Recognit. Lett..

[78]  Karim Faez,et al.  Multimodal biometric system using face, ear and gait biometrics , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[79]  Arun Ross,et al.  Automatic facial makeup detection with application in face recognition , 2013, 2013 International Conference on Biometrics (ICB).

[80]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[81]  Tarak Gandhi,et al.  Person tracking and reidentification: Introducing Panoramic Appearance Map (PAM) for feature representation , 2006, Machine Vision and Applications.

[82]  Hanqing Lu,et al.  Face recognition using kernel scatter-difference-based discriminant analysis , 2006, IEEE Trans. Neural Networks.

[83]  M. Lee,et al.  The University of Southampton Multi-Biometric Tunnel and introducing a novel 3D gait dataset , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[84]  L. Akarun,et al.  A 3D Face Recognition System for Expression and Occlusion Invariance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[85]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Yasushi Makihara,et al.  Multi-view multi-modal person authentication from a single walking image sequence , 2013, 2013 International Conference on Biometrics (ICB).

[87]  Himanshu S. Bhatt,et al.  Recognizing Surgically Altered Face Images Using Multiobjective Evolutionary Algorithm , 2013, IEEE Transactions on Information Forensics and Security.

[88]  Chi Fang,et al.  Continuous Pose Normalization for Pose-Robust Face Recognition , 2012, IEEE Signal Processing Letters.

[89]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[90]  Christina M. Akrivopoulou.  Protecting the Genetic Self from Biometric Threats: Autonomy, Identity, and Genetic Privacy , 2015 .

[91]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[92]  Wen Gao,et al.  Illumination normalization for robust face recognition against varying lighting conditions , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[93]  Daniel González-Jiménez,et al.  Toward Pose-Invariant 2-D Face Recognition Through Point Distribution Models and Facial Symmetry , 2007, IEEE Transactions on Information Forensics and Security.

[94]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[95]  Luuk J. Spreeuwers,et al.  Robust 3D face recognition in the presence of realistic occlusions , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[96]  Rosalind W. Picard.  Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..

[97]  Wen Gao,et al.  Pose Invariant Face Recognition Under Arbitrary Illumination Based on 3D Face Reconstruction , 2005, AVBPA.

[98]  Nicolas Pinto,et al.  Beyond simple features: A large-scale feature search approach to unconstrained face recognition , 2011, Face and Gesture 2011.

[99]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[100]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[101]  S. Sridharan,et al.  Face recognition from 3D data using Iterative Closest Point algorithm and Gaussian mixture models , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[102]  Alex Pentland,et al.  Human Computing and Machine Understanding of Human Behavior: A Survey , 2007, Artifical Intelligence for Human Computing.

[103]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[104]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[105]  Dorin Comaniciu,et al.  Illumination normalization for face recognition and uneven background correction using total variation based image models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[106]  Zhichun Mu,et al.  Multimodal recognition using face profile and ear , 2006, 2006 1st International Symposium on Systems and Control in Aerospace and Astronautics.

[107]  Josef Kittler,et al.  Component-based LDA face description for image retrieval and MPEG-7 standardisation , 2005, Image Vis. Comput..

[108]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[109]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[110]  K. Etemad,et al.  Discriminant analysis for recognition of human face images , 1997 .

[111]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  Christos P. Loizou,et al.  Despeckle Filtering Toolbox for Medical Ultrasound Video , 2013, Int. J. Monit. Surveillance Technol. Res..

[113]  Yanxi Liu,et al.  Facial asymmetry quantification for expression invariant human identification , 2003, Comput. Vis. Image Underst..

[114]  Shihong Lao,et al.  Security Management for Mobile Devices by Face Recognition , 2006, 7th International Conference on Mobile Data Management (MDM'06).

[115]  P. Quintiliano,et al.  Face Recognition Based on Eigeneyes 1 , 2003 .

[116]  Stefano Tubaro,et al.  Mixed 2D-3D Information for Pose Estimation and Face Recognition , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[117]  Anil K. Jain,et al.  Face Recognition Performance: Role of Demographic Information , 2012, IEEE Transactions on Information Forensics and Security.

[118]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[119]  Genny Tortora,et al.  EGA — Ethnicity, gender and age, a pre-annotated face database , 2012, 2012 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS) Proceedings.