Image-level Classification in Hyperspectral Images using Feature Descriptors, with Application to Face Recognition

In this paper, we proposed a novel pipeline for image-level classification in the hyperspectral images. By doing this, we show that the discriminative spectral information at image-level features lead to significantly improved performance in a face recognition task. We also explored the potential of traditional feature descriptors in the hyperspectral images. From our evaluations, we observe that SIFT features outperform the state-of-the-art hyperspectral face recognition methods, and also the other descriptors. With the increasing deployment of hyperspectral sensors in a multitude of applications, we believe that our approach can effectively exploit the spectral information in hyperspectral images, thus beneficial to more accurate classification.

[1]  LinLin Shen,et al.  Hyperspectral face recognition using 3D Gabor wavelets , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  A. Robertson,et al.  Colorimetry: Fundamentals and Applications , 2005 .

[3]  Namil Kim,et al.  Multispectral pedestrian detection: Benchmark dataset and baseline , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yun Luo,et al.  Pedestrian detection in near-infrared night vision system , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[5]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[6]  Arif Mahmood,et al.  Hyperspectral Face Recognition using 3D-DCT and Partial Least Squares , 2013, BMVC.

[7]  Jun Zhou,et al.  3D Reconstruction from Hyperspectral Images , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[8]  Arif Mahmood,et al.  Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS Regression , 2015, IEEE Transactions on Image Processing.

[9]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[11]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[12]  Bruce J. Tromberg,et al.  Comparison of Spectral-Only and Spectral/Spatial Face Recognition for Personal Identity Verification , 2009, EURASIP J. Adv. Signal Process..

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Jun Zhou,et al.  Salient object detection in hyperspectral imagery , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Stefan A. Robila,et al.  Toward hyperspectral face recognition , 2008, Electronic Imaging.

[17]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[18]  Sabine Süsstrunk,et al.  Material Classification Using Color and NIR Images , 2009, CIC.

[19]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Nicolas Papadakis,et al.  A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value , 2003 .

[21]  Quan Pan,et al.  Studies on Hyperspectral Face Recognition in Visible Spectrum With Feature Band Selection , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Sabine Süsstrunk,et al.  Multi-spectral SIFT for scene category recognition , 2011, CVPR 2011.

[24]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Jun Zhou,et al.  3D local derivative pattern for hyperspectral face recognition , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).