Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition

Single-Sample Face Recognition (SSFR) is a computer vision challenge. In this scenario, there is only one example from each individual on which to train the system, making it difficult to identify persons in unconstrained environments, mainly when dealing with changes in facial expression, posture, lighting, and occlusion. This paper discusses the relevance of an original method for SSFR, called Multi-Block Color-Binarized Statistical Image Features (MB-C-BSIF), which exploits several kinds of features, namely, local, regional, global, and textured-color characteristics. First, the MB-C-BSIF method decomposes a facial image into three channels (e.g., red, green, and blue), then it divides each channel into equal non-overlapping blocks to select the local facial characteristics that are consequently employed in the classification phase. Finally, the identity is determined by calculating the similarities among the characteristic vectors adopting a distance measurement of the K-nearest neighbors (K-NN) classifier. Extensive experiments on several subsets of the unconstrained Alex and Robert (AR) and Labeled Faces in the Wild (LFW) databases show that the MB-C-BSIF achieves superior and competitive results in unconstrained situations when compared to current state-of-the-art methods, especially when dealing with changes in facial expression, lighting, and occlusion. The average classification accuracies are 96.17% and 99% for the AR database with two specific protocols (i.e., Protocols I and II, respectively), and 38.01% for the challenging LFW database. These performances are clearly superior to those obtained by state-of-the-art methods. Furthermore, the proposed method uses algorithms based only on simple and elementary image processing operations that do not imply higher computational costs as in holistic, sparse or deep learning methods, making it ideal for real-time identification.

[1]  Binh P. Nguyen,et al.  Robust Biometric Recognition From Palm Depth Images for Gloved Hands , 2015, IEEE Transactions on Human-Machine Systems.

[2]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[3]  Djeddi Meriem,et al.  Discrete wavelet for multifractal texture classification: application to medical ultrasound imaging , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Wen Gao,et al.  Adaptive generic learning for face recognition from a single sample per person , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Jun Guo,et al.  Robust, accurate and efficient face recognition from a single training image: A uniform pursuit approach , 2010, Pattern Recognit..

[6]  Amir Benzaoui,et al.  A new framework for grayscale ear images recognition using generative adversarial networks under unconstrained conditions , 2020, Evol. Syst..

[7]  James V. Stone Independent component analysis: an introduction , 2002, Trends in Cognitive Sciences.

[8]  Vijayan K. Asari,et al.  An improved face recognition technique based on modular PCA approach , 2004, Pattern Recognit. Lett..

[9]  Vladimir Cherkassky,et al.  Vapnik-Chervonenkis (VC) learning theory and its applications , 1999 .

[10]  Abdelhani Boukrouche,et al.  Ear recognition using local color texture descriptors from one sample image per person , 2017, 2017 4th International Conference on Control, Decision and Information Technologies (CoDIT).

[11]  Abdelhani Boukrouche,et al.  System for automatic faces detection , 2012, 2012 3rd International Conference on Image Processing Theory, Tools and Applications (IPTA).

[12]  Changhui Hu,et al.  A new face recognition method based on image decomposition for single sample per person problem , 2015, Neurocomputing.

[13]  Tim Ring Humans vs machines: the future of facial recognition , 2016 .

[14]  Lei Zhang,et al.  Sparse Variation Dictionary Learning for Face Recognition with a Single Training Sample per Person , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Nacer K. M'Sirdi,et al.  Perception and characterization of materials using signal processing techniques , 2001, IEEE Trans. Instrum. Meas..

[16]  Nitin Kumar,et al.  Single Sample Face Recognition in the Last Decade: A Survey , 2019, Int. J. Pattern Recognit. Artif. Intell..

[17]  A. Martínez,et al.  The AR face databasae , 1998 .

[18]  Yongjie Chu,et al.  Multiple feature subspaces analysis for single sample per person face recognition , 2017, The Visual Computer.

[19]  Haifeng Hu,et al.  Local robust sparse representation for face recognition with single sample per person , 2018, IEEE/CAA Journal of Automatica Sinica.

[20]  Abdeldjalil Ouahabi,et al.  A review of wavelet denoising in medical imaging , 2013, 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA).

[21]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[22]  Zexuan Ji,et al.  Collaborative probabilistic labels for face recognition from single sample per person , 2017, Pattern Recognit..

[23]  Aikaterini Mitrokotsa,et al.  Privacy-Preserving Biometric Authentication: Challenges and Directions , 2017, Secur. Commun. Networks.

[24]  Nada Alay,et al.  Deep Learning Approach for Multimodal Biometric Recognition System Based on Fusion of Iris, Face, and Finger Vein Traits , 2020, Sensors.

[25]  Yiu-ming Cheung,et al.  Robust heterogeneous discriminative analysis for face recognition with single sample per person , 2019, Pattern Recognit..

[26]  Mourad Oussalah,et al.  Bone microarchitecture characterization based on fractal analysis in spatial frequency domain imaging , 2021, Int. J. Imaging Syst. Technol..

[27]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[28]  Vitaly Kober,et al.  Conformal Parameterization and Curvature Analysis for 3D Facial Recognition , 2015, 2015 International Conference on Computational Science and Computational Intelligence (CSCI).

[29]  Yan Zhang,et al.  Sample reconstruction with deep autoencoder for one sample per person face recognition , 2017, IET Comput. Vis..

[30]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[31]  Xiaojun Yu,et al.  Motor imagery BCI classification based on novel two‐dimensional modelling in empirical wavelet transform , 2020, Electronics Letters.

[32]  Giuliano Grossi,et al.  Robust Single-Sample Face Recognition by Sparsity-Driven Sub-Dictionary Learning Using Deep Features † , 2019, Sensors.

[33]  Meng Zhang,et al.  Dissimilarity-based nearest neighbor classifier for single-sample face recognition , 2020, The Visual Computer.

[34]  Abdelmalik Taleb-Ahmed,et al.  Past, Present, and Future of Face Recognition: A Review , 2020 .

[35]  Mohamed Atri,et al.  Face Recognition Systems: A Survey , 2020, Sensors.

[36]  Kon Max Wong,et al.  A fast method for real-time median filtering , 1980 .

[37]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Sheng Huang,et al.  Discriminative Probabilistic Latent Semantic Analysis with Application to Single Sample Face Recognition , 2018, Neural Processing Letters.

[39]  Thomas Vetter,et al.  Synthesis of Novel Views from a Single Face Image , 1998, International Journal of Computer Vision.

[40]  Abdenour Hadid,et al.  Ear biometric recognition using local texture descriptors , 2014, J. Electronic Imaging.

[41]  Lei Zhang,et al.  Local Generic Representation for Face Recognition with Single Sample per Person , 2014, ACCV.

[42]  Abdeldjalil Ouahabi,et al.  Multifractal analysis for texture characterization: A new approach based on DWT , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[43]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[44]  Hongqing Fang,et al.  Feature Selections Using Minimal Redundancy Maximal Relevance Algorithm for Human Activity Recognition in Smart Home Environments , 2020 .

[45]  Zhaohui Yuan,et al.  Motor Imagery EEG Signals Classification Based on Mode Amplitude and Frequency Components Using Empirical Wavelet Transform , 2019, IEEE Access.

[46]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[47]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[48]  Daoqiang Zhang,et al.  Enhanced (PC)2 A for face recognition with one training image per person , 2004, Pattern Recognit. Lett..

[49]  Motameni Homayun,et al.  A supervised multimanifold method with locality preserving for face recognition using single sample per person , 2017 .

[50]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[52]  Ahmed Sharaf Eldin,et al.  A Survey on Behavioral Biometric Authentication on Smartphones , 2017, J. Inf. Secur. Appl..

[53]  Xiao-Yuan Jing,et al.  Generic Training Set based Multimanifold Discriminant Learning for Single Sample Face Recognition , 2018, KSII Trans. Internet Inf. Syst..

[54]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[55]  Abdelmalik Taleb-Ahmed,et al.  OLIMP: A Heterogeneous Multimodal Dataset for Advanced Environment Perception , 2020, Electronics.

[56]  Abdelmalik Taleb-Ahmed,et al.  Deep learning for real-time semantic segmentation: Application in ultrasound imaging , 2021, Pattern Recognit. Lett..

[57]  Yichuan Wang,et al.  Binarized features with discriminant manifold filters for robust single-sample face recognition , 2018, Signal Process. Image Commun..

[58]  Joseph Thompson,et al.  Assessing the Impact of Corneal Refraction and Iris Tissue Non-Planarity on Iris Recognition , 2019, IEEE Transactions on Information Forensics and Security.

[59]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..

[60]  Stefano Tornincasa,et al.  3D geometry-based automatic landmark localization in presence of facial occlusions , 2017, Multimedia Tools and Applications.

[61]  Zoubeida Messali,et al.  Nonparametric Denoising Methods Based on Contourlet Transform with Sharp Frequency Localization: Application to Low Exposure Time Electron Microscopy Images , 2015, Entropy.

[62]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[63]  Zhi-Hua Zhou,et al.  Making FLDA applicable to face recognition with one sample per person , 2004, Pattern Recognit..

[64]  David Zhang,et al.  Face recognition using FLDA with single training image per person , 2008, Appl. Math. Comput..

[65]  Zhouwang Yang,et al.  Additive Parameter for Deep Face Recognition , 2020 .

[66]  Daoqiang Zhang,et al.  A new face recognition method based on SVD perturbation for single example image per person , 2005, Appl. Math. Comput..

[67]  Fan Wang,et al.  Deep Convolutional Neural Network Used in Single Sample per Person Face Recognition , 2018, Comput. Intell. Neurosci..

[68]  Junying Zeng,et al.  Single sample per person face recognition based on deep convolutional neural network , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[69]  Ming Zhu,et al.  Single sample per person face recognition with KPCANet and a weighted voting scheme , 2017, Signal Image Video Process..

[70]  Hyunseok Choi,et al.  Robust control point estimation with an out-of-focus camera calibration pattern , 2021, Pattern Recognit. Lett..

[71]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Feipeng Da,et al.  Block dictionary learning-driven convolutional neural networks for fewshot face recognition , 2020, The Visual Computer.

[73]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[74]  Davide Maltoni,et al.  On the Feasibility of Creating Double-Identity Fingerprints , 2017, IEEE Transactions on Information Forensics and Security.

[75]  Zhaohui Yuan,et al.  Exploiting dimensionality reduction and neural network techniques for the development of expert brain-computer interfaces , 2021, Expert Syst. Appl..

[76]  Xiaojun Yu,et al.  Exploiting Multiple Optimizers with Transfer Learning Techniques for the Identification of COVID-19 Patients , 2020, Journal of healthcare engineering.

[77]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Swami Sankaranarayanan,et al.  Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms , 2018, Proceedings of the National Academy of Sciences.

[79]  Aleix M. Martinez,et al.  The AR face database , 1998 .