Deep High-order Asymmetric Supervised Hashing for Image Retrieval

Deep hashing has recently been attracting more and more attentions for large-scale image retrieval task owing to its superior performance of search efficiency and less storage space requirements. Among deep hashing models, asymmetric deep hashing performs feature learning on query dataset and directly generates hash code on database images, significantly improving the retrieval performance of deep hashing models. Meanwhile, recently works also establish that high-order statistic of deep features are helpful to obtain more discriminant representations of images. Therefore, to boost the retrieval capability of deep hashing, this work tries to integrate merits of the high-order statistic module and the asymmetric deep hashing architecture, and it further proposes a novel deep high-order asymmetric supervised hashing (DHoASH) for image retrieval. More specifically, we utilize a powerful global covariance pooling module based on matrix power normalization to compute the second-order statistic features of input images, which is fluently embedded into an asymmetric hashing architecture in an end-to-end manner, leading to the generation of more discriminant binary hashing code. Experiment results on two benchmarks illuminates the effectiveness of the proposed DHoASH, which also achieves very competitive retrieval accuracy compared to the state-of-the-art methods.

[1]  Wu-Jun Li,et al.  Feature Learning Based Deep Supervised Hashing with Pairwise Labels , 2015, IJCAI.

[2]  Cristian Sminchisescu,et al.  Matrix Backpropagation for Deep Networks with Structured Layers , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  King Ngi Ngan,et al.  Discriminative deep metric learning for asymmetric discrete hashing , 2020, Neurocomputing.

[4]  Xianhua Zeng,et al.  Deep forest hashing for image retrieval , 2019, Pattern Recognit..

[5]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  David Zhang,et al.  Dual Asymmetric Deep Hashing Learning , 2018, IEEE Access.

[7]  Rongrong Ji,et al.  Supervised hashing with kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Alexandr Andoni,et al.  Optimal Data-Dependent Hashing for Approximate Near Neighbors , 2015, STOC.

[9]  Shiguang Shan,et al.  Deep Supervised Hashing for Fast Image Retrieval , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yi Shi,et al.  Deep Supervised Hashing with Triplet Labels , 2016, ACCV.

[11]  Yang Yang,et al.  Deep Asymmetric Pairwise Hashing , 2017, ACM Multimedia.

[12]  Sheng Jin Deep Saliency Hashing , 2018, ArXiv.

[13]  Yifan Yang,et al.  Deep Policy Hashing Network with Listwise Supervision , 2019, ICMR.

[14]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[15]  Wu-Jun Li,et al.  Asymmetric Deep Supervised Hashing , 2017, AAAI.

[16]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[17]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[18]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[19]  Jianmin Wang,et al.  Deep Quantization Network for Efficient Image Retrieval , 2016, AAAI.

[20]  Qilong Wang,et al.  Global Second-Order Pooling Convolutional Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jianmin Wang,et al.  Deep Hashing Network for Efficient Similarity Retrieval , 2016, AAAI.

[22]  Hanjiang Lai,et al.  Supervised Hashing for Image Retrieval via Image Representation Learning , 2014, AAAI.

[23]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[24]  Lin Yang,et al.  Asymmetric Discrete Graph Hashing , 2017, AAAI.

[25]  Tieniu Tan,et al.  Deep Supervised Discrete Hashing , 2017, NIPS.

[26]  Qilong Wang,et al.  Is Second-Order Information Helpful for Large-Scale Visual Recognition? , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Wei Liu,et al.  Hashing with Graphs , 2011, ICML.

[28]  Jen-Hao Hsiao,et al.  Deep learning of binary hash codes for fast image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Kristen Grauman,et al.  Kernelized locality-sensitive hashing for scalable image search , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.