Proposing a sparse representational based face verification system to run in a shortage of memory

Studying face verification has seen tremendous growth over the past years. During the last decade, with the improvement of system processors and memories, deep learning was growth widely and the applications of Convolutional Neural Network (CNN) affected all image processing tasks. But, needing much space to save several parameters of learned model is still a big challenge to use them on simple devices, e.g. cell phones. In this paper, to address the problem of face verification in a shortage of memory sparse representation has been employed. So, to compare two portraits a dictionary is generated from each image using augmentation techniques. Then, each face is reconstructed sparsely by the other dictionary and if there is a negligible average of reconstruction error, couple of faces are matched. The proposed method has been assessed in various conditions of several face datasets and the results show improvement comparing to all sparse representational approaches. Although the evaluations indicate a bit less accuracy than CNN-based methods, the main advantage is less usage of memory that can lead running on mobile devices.

[1]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[2]  Enrique G. Ortiz,et al.  Computer Vision and Image Understanding , 2013 .

[3]  Maliheh Miri Face verification in the wild using similarity in representations , 2017, 2017 Artificial Intelligence and Signal Processing Conference (AISP).

[4]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Christoph Palm,et al.  Gabor Filtering of Complex Hue/Saturation Images for Color Texture Classification , 2000 .

[6]  Xin Jin,et al.  Privacy Preserving Face Identification in the Cloud through Sparse Representation , 2015, CCBR.

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[9]  Muhammad Khurram Khan,et al.  Two-Directional Two-Dimensional Random Projection and Its Variations for Face and Palmprint Recognition , 2011, ICCSA.

[10]  Geoff S. Nitschke,et al.  Improving Deep Learning with Generic Data Augmentation , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[11]  K. Krishna Prasad,et al.  A Conceptual Study on User Identification and Verification Process using Face Recognition Technique , 2017, International Journal of Applied Engineering and Management Letters.

[12]  M. K. Haldar,et al.  A Survey on Biometrics and Cancelable Biometrics Systems , 2018, Int. J. Image Graph..

[13]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[14]  Parinya Sanguansat Two-Dimensional Random Projection for Face Recognition , 2010, 2010 First International Conference on Pervasive Computing, Signal Processing and Applications.

[15]  William J. Christmas,et al.  When Face Recognition Meets with Deep Learning: An Evaluation of Convolutional Neural Networks for Face Recognition , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[16]  Panu Turcot,et al.  Better matching with fewer features: The selection of useful features in large database recognition problems , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[17]  Robi Polikar Ensemble learning , 2009, Scholarpedia.

[18]  Chu-Song Chen,et al.  Cross-Age Reference Coding for Age-Invariant Face Recognition and Retrieval , 2014, ECCV.

[19]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Muhammad Khurram Khan,et al.  Dynamic weighted discrimination power analysis: A novel approach for face and palmprint recognition in DCT domain , 2010 .

[21]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[22]  Jongmoo Choi,et al.  Pooling Faces: Template Based Face Recognition with Pooled Face Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[23]  Christopher Ré,et al.  Learning to Compose Domain-Specific Transformations for Data Augmentation , 2017, NIPS.

[24]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[25]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[26]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[27]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[28]  Yann LeCun,et al.  Transformation Invariance in Pattern Recognition - Tangent Distance and Tangent Propagation , 2012, Neural Networks: Tricks of the Trade.

[29]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[30]  Alberto L. Sangiovanni-Vincentelli,et al.  A Contract-Based Methodology for Aircraft Electric Power System Design , 2014, IEEE Access.

[31]  P. Allison Multiple Imputation for Missing Data , 2000 .

[32]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[33]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[34]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[35]  Benny Pinkas,et al.  SCiFI - A System for Secure Face Identification , 2010, 2010 IEEE Symposium on Security and Privacy.

[36]  Jonghyun Choi,et al.  Face verification using sparse representations , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[37]  Richa Singh,et al.  Disguise detection and face recognition in visible and thermal spectrums , 2013, 2013 International Conference on Biometrics (ICB).

[38]  Vladik Kreinovich,et al.  Why l1 Is a Good Approximation to l0: A Geometric Explanation , 2013 .

[39]  Daksha Yadav,et al.  Face Verification with Disguise Variations via Deep Disguise Recognizer , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[40]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[43]  Yuxiao Hu,et al.  Learning a Spatially Smooth Subspace for Face Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Shiliang Sun,et al.  Multi-view learning overview: Recent progress and new challenges , 2017, Inf. Fusion.

[45]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Jing Xu,et al.  Dynamic weighted discrimination power analysis in DCT domain for face and palmprint recognition , 2010, 2010 International Conference on Information and Communication Technology Convergence (ICTC).

[47]  Marzuki Khalid,et al.  A review of methods for face verification under illumination variation , 2011, ICIP 2011.

[48]  Sattar Hashemi,et al.  Sparse Representation Using Deep Learning to Classify Multi-Class Complex Data , 2018, Iranian Journal of Science and Technology, Transactions of Electrical Engineering.

[49]  Peter König,et al.  Do deep nets really need weight decay and dropout? , 2018, ArXiv.

[50]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[52]  Tal Hassner,et al.  Effective face frontalization in unconstrained images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Siyu Huang,et al.  Cyber-physical system enabled nearby traffic flow modelling for autonomous vehicles , 2017, 2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC).

[54]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[55]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[56]  Hong Liu,et al.  An improved label fusion approach with sparse patch‐based representation for MRI brain image segmentation , 2017, Int. J. Imaging Syst. Technol..

[57]  Qi Zhu,et al.  CCEDA: building bridge between subspace projection learning and sparse representation-based classification , 2014 .

[58]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[59]  Stratis Ioannidis,et al.  Intermediate Data Caching Optimization for Multi-Stage and Parallel Big Data Frameworks , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[60]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[61]  Rama Chellappa,et al.  Facial similarity across age, disguise, illumination and pose , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[62]  Zhenan Sun,et al.  Dynamic Feature Learning for Partial Face Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[63]  Lu Leng,et al.  Two-dimensional cancelable biometric scheme , 2012, 2012 International Conference on Wavelet Analysis and Pattern Recognition.

[64]  Ran He,et al.  A Regularized Correntropy Framework for Robust Pattern Recognition , 2011, Neural Computation.

[65]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.