Large-scale image retrieval based on boosting iterative quantization hashing with query-adaptive reranking

Image hashing based Approximate Nearest Neighbor (ANN) searching has drawn more and more attention in large-scale image dataset applications. It is still challenging to learn hashing codes to achieve good search performance. In this paper, we propose an image retrieval method based on boosting iterative quantization hashing method with query-adaptive reranking. Firstly, in boosting iterative quantization hashing embedding, we adopt boosting-based method to generate inputs to learn hashing functions. Then we optimize the hashing functions with a loss function by considering the relationship between samples. Once the hashing codes are generated, Query-Adaptive Reranking (QAR) method is proposed to learn bit-level weights for each category and query-adaptive weights for each hashing bit. In this way, the discrete Hamming distance value can be continuous, and many irrelevant returned images can be sorted to the back. We conduct experiments on three public datasets, and comparison results with six state-of-the-art methods to illustrate the effectiveness of the proposed method.

[1]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[2]  Jonathan Brandt,et al.  Transform coding for fast approximate nearest neighbor search in high dimensions , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Piotr Indyk,et al.  Nearest-neighbor-preserving embeddings , 2007, TALG.

[4]  Nenghai Yu,et al.  Complementary hashing for approximate nearest neighbor search , 2011, 2011 International Conference on Computer Vision.

[5]  Hua Li,et al.  Mobile Search With Multimodal Queries , 2008, Proceedings of the IEEE.

[6]  Xiangwei Kong,et al.  A balanced semi-supervised hashing method for CBIR , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Xiao Zhang,et al.  Sparse spectral hashing , 2012, Pattern Recognit. Lett..

[8]  Jun Wang,et al.  Semi-supervised learning for scalable and robust visual search , 2011, ACMMR.

[9]  Wei Liu,et al.  Hashing with Graphs , 2011, ICML.

[10]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[11]  Shih-Fu Chang,et al.  Semi-supervised hashing for scalable image retrieval , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[13]  Kristen Grauman,et al.  Kernelized locality-sensitive hashing for scalable image search , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[15]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[16]  Shih-Fu Chang,et al.  Sequential Projection Learning for Hashing with Compact Codes , 2010, ICML.

[17]  Wei-Ying Ma,et al.  AnnoSearch: Image Auto-Annotation by Search , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Antonio Torralba,et al.  Small codes and large image databases for recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Trevor Darrell,et al.  Fast pose estimation with parameter-sensitive hashing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  TorralbaAntonio,et al.  Modeling the Shape of the Scene , 2001 .

[21]  Shuicheng Yan,et al.  Learning reconfigurable hashing for diverse semantics , 2011, ICMR '11.

[22]  Svetlana Lazebnik,et al.  Locality-sensitive binary codes from shift-invariant kernels , 2009, NIPS.

[23]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[24]  Chengwei Yao,et al.  Semi-supervised spectral hashing for fast similarity search , 2013, Neurocomputing.

[25]  Pascal Fua,et al.  LDAHash: Improved Matching with Smaller Descriptors , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Ding Liu A strong lower bound for approximate nearest neighbor searching , 2004, Inf. Process. Lett..

[28]  Cordelia Schmid,et al.  Improving Bag-of-Features for Large Scale Image Search , 2010, International Journal of Computer Vision.