A Bayesian Hashing approach and its application to face recognition

With the rapid development in the computer vision community, many recent studies show that high-dimensional feature representations can produce better accuracies in various image and video content recognition tasks. However, it also brings high costs for both computation and storage. In this paper, we introduce a novel method called Bayesian Hashing, which learns an optimal Hamming embedding to encode high-dimensional features to binary bits, and discuss its application to the challenging problem of face recognition. The learned hashing representation is modeled with a well-designed supervised Bayesian learning framework, which consists of three ingredients. First, we elaborately model local bit correlations using Naive Bayesian model (FERN), and boost FERNs to obtain a classifier for the hashing bit stream. Second, without incurring additional storage cost, we impose hashing bit-stream permutations to obtain a series of classifiers, which could achieve better performance. Third, we introduce the sequential forward floating search (SFFS) algorithm to perform model selection on multiple-permutation models, gaining further performance improvement. We carry out extensive evaluations and comparative studies, which demonstrate that the proposed approach gives superior performance on both accuracy and speed. State-of-the-art results are achieved on several well-known face recognition benchmarks.

[1]  Wen Gao,et al.  Hierarchical Ensemble of Global and Local Classifiers for Face Recognition , 2009, IEEE Trans. Image Process..

[2]  Li Bai,et al.  Cosine Similarity Metric Learning for Face Verification , 2010, ACCV.

[3]  Chengjun Liu,et al.  Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Nicolas Pinto,et al.  Beyond simple features: A large-scale feature search approach to unconstrained face recognition , 2011, Face and Gesture 2011.

[5]  Shiguang Shan,et al.  Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jun Wang,et al.  Non-transitive Hashing with Latent Similarity Components , 2015, KDD.

[7]  Jun Wang,et al.  Probabilistic Attributed Hashing , 2015, AAAI.

[8]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[9]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  David Suter,et al.  Fast Supervised Hashing with Decision Trees for High-Dimensional Data , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Bin Fan,et al.  Beyond Mahalanobis metric: Cayley-Klein metric learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Rui Yan,et al.  Kernel coupled distance metric learning for gait recognition and face recognition , 2013, Neurocomputing.

[15]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[16]  Pascal Fua,et al.  LDAHash: Improved Matching with Smaller Descriptors , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Xiangyu Zhu,et al.  High-fidelity Pose and Expression Normalization for face recognition in the wild , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Gang Hua,et al.  Probabilistic Elastic Matching for Pose Variant Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Rongrong Ji,et al.  Supervised hashing with kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[24]  PietikainenMatti,et al.  Face Description with Local Binary Patterns , 2006 .

[25]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Srinivasan Parthasarathy,et al.  Bayesian Locality Sensitive Hashing for Fast Similarity Search , 2011, Proc. VLDB Endow..

[28]  Wei Jia,et al.  Locality preserving discriminant projections for face and palmprint recognition , 2010, Neurocomputing.

[29]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Hanjiang Lai,et al.  Supervised Hashing for Image Retrieval via Image Representation Learning , 2014, AAAI.

[31]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Tal Hassner,et al.  Face recognition in unconstrained videos with matched background similarity , 2011, CVPR 2011.

[33]  LinLin Shen,et al.  Joint representation and pattern learning for robust face recognition , 2015, Neurocomputing.

[34]  Yuan Yan Tang,et al.  Supervised Regularization Locality-Preserving Projection Method for Face Recognition , 2012, Int. J. Wavelets Multiresolution Inf. Process..

[35]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[36]  Wei Liu,et al.  Learning Binary Codes for Maximum Inner Product Search , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Qiwei Gu,et al.  Consistent feature selection and its application to face recognition , 2014, Journal of Intelligent Information Systems.

[38]  Xilin Chen,et al.  Projection Metric Learning on Grassmann Manifold with Application to Video based Face Recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Xiaogang Wang,et al.  Hybrid Deep Learning for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[40]  Tomaso A. Poggio,et al.  Face recognition with support vector machines: global versus component-based approach , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[41]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[42]  Shenghuo Zhu,et al.  Large Scale Strongly Supervised Ensemble Metric Learning, with Applications to Face Verification and Retrieval , 2012, ArXiv.

[43]  Oren Barkan,et al.  Fast High Dimensional Vector Multiplication Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[44]  Andrew Zisserman,et al.  A Compact and Discriminative Face Track Descriptor , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[46]  Peng Li,et al.  Hashing with dual complementary projection learning for fast image retrieval , 2013, Neurocomputing.

[47]  Cordelia Schmid,et al.  Is that you? Metric learning approaches for face identification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[48]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[49]  Shiguang Shan,et al.  Log-Euclidean Metric Learning on Symmetric Positive Definite Manifold with Application to Image Set Classification , 2015, ICML.

[50]  Andrew Zisserman,et al.  Fisher Vector Faces in the Wild , 2013, BMVC.

[51]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[52]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Dongqing Zhang,et al.  Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization , 2014, AAAI.

[54]  Binbin Pan,et al.  A novel discriminant criterion based on feature fusion strategy for face recognition , 2015, Neurocomputing.

[55]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Guodong Guo,et al.  Boosting for fast face recognition , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[57]  Matti Pietikäinen,et al.  Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[59]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[60]  Heydi Mendez Vazquez,et al.  Volume structured ordinal features with background similarity measure for video face recognition , 2013, 2013 International Conference on Biometrics (ICB).

[61]  Jing Liu,et al.  Learning Low-Rank Representations with Classwise Block-Diagonal Structure for Robust Face Recognition , 2014, AAAI.

[62]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[63]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Honglak Lee,et al.  Learning hierarchical representations for face verification with convolutional deep belief networks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Jun Wang,et al.  Optimal Bayesian Hashing for Efficient Face Recognition , 2015, IJCAI.