Hyperspectral Band Selection for Face Recognition Based on a Structurally Sparsified Deep Convolutional Neural Networks

Hyperspectral imaging systems collect and process information from specific wavelengths across the electromagnetic spectrum. The fusion of multi-spectral bands in the visible spectrum has been exploited to improve face recognition performance over conventional broad band face images. In this paper, we propose a new Convolutional Neural Network (CNN) framework which adopts a structural sparsity learning technique to select the optimal spectral bands to obtain the best face recognition performance over all of the spectral bands. Specifically, in this method, all the bands are fed to a CNN and the convolutional filters in the first layer of the CNN are then regularized by employing a group Lasso algorithm to zero out the redundant bands during the training of the network. Contrary to other methods which usually select the bands manually or in a greedy fashion, our method selects the optimal spectral bands automatically to achieve the best face recognition performance over all the spectral bands. Moreover, experimental results demonstrate that our method outperforms state of the art band selection methods for face recognition on several publicly-available hyperspectral face image datasets.

[1]  Josef Kittler,et al.  Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ajmal S. Mian,et al.  Face Recognition Using Sparse Approximated Nearest Points between Image Sets , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[4]  LinLin Shen,et al.  Hyperspectral face recognition using 3D Gabor wavelets , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[6]  Larry S. Davis,et al.  Covariance discriminative learning: A natural and efficient approach to image set classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Luc Van Gool,et al.  Hyperspectral CNN for image classification & band selection, with application to face recognition , 2016 .

[8]  Bruce J. Tromberg,et al.  Comparison of Spectral-Only and Spectral/Spatial Face Recognition for Personal Identity Verification , 2009, EURASIP J. Adv. Signal Process..

[9]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Wen Gao,et al.  Manifold-Manifold Distance with application to face recognition based on image set , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Quan Pan,et al.  Studies on Hyperspectral Face Recognition in Visible Spectrum With Feature Band Selection , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Nasser M. Nasrabadi,et al.  A Deep Face Identification Network Enhanced by Facial Attributes Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Fred A. Kruse,et al.  Comparison of AVIRIS and Hyperion for Hyperspectral Mineral Mapping , 2002 .

[16]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Stefan A. Robila,et al.  Toward hyperspectral face recognition , 2008, Electronic Imaging.

[18]  Nasser M. Nasrabadi,et al.  Unsupervised Image-to-Image Translation Using Domain-Specific Variational Information Bound , 2018, NeurIPS.

[19]  Ruiping Wang,et al.  Manifold Discriminant Analysis , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Arif Mahmood,et al.  Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS Regression , 2015, IEEE Transactions on Image Processing.

[21]  Han Jiang,et al.  Deep residual networks for hyperspectral image classification , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[22]  Dan Hu,et al.  Hyperspectral Band Selection Based on Deep Convolutional Neural Network and Distance Density , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Trevor J. Bihl,et al.  QUEST Hierarchy for Hyperspectral Face Recognition , 2012, Adv. Artif. Intell..

[24]  Wei Liu,et al.  A new hyperspectral band selection approach based on convolutional neural network , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[25]  Yong Man Ro,et al.  Local Color Vector Binary Patterns From Multichannel Face Images for Face Recognition , 2012, IEEE Transactions on Image Processing.

[26]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Nasser M. Nasrabadi,et al.  Matrix Completion for Graph-Based Deep Semi-Supervised Learning , 2019, AAAI.

[30]  Zhenhua Guo,et al.  Feature Band Selection for Online Multispectral Palmprint Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[31]  Na Li,et al.  A NOVEL DEEP CONVOLUTIONAL NEURAL NETWORK FOR SPECTRAL–SPATIAL CLASSIFICATION OF HYPERSPECTRAL DATA , 2018 .

[32]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[33]  Arif Mahmood,et al.  Hyperspectral Face Recognition using 3D-DCT and Partial Least Squares , 2013, BMVC.