Geometry and Topology Preserving Hashing for SIFT Feature

In recent years, content-based image retrieval has been of concern because of practical needs on Internet services, especially methods that can improve retrieving speed and accuracy. The SIFT feature is a well-designed local feature. It has mature applications in feature matching and retrieval, whereas the raw SIFT feature is high dimensional, with high storage cost as well as computational cost in feature similarity measurements. Thus, we propose a hashing scheme for fast SIFT feature-based image matching and retrieval. First, a training process of the hashing function involves geometric and topological information being introduced; second, a geometry-enhanced similarity evaluation that considers both the global and details of images in evaluation is explained. Compared with state-of-the-art methods, our method achieves better performance.

[1]  Jen-Hao Hsiao,et al.  Deep learning of binary hash codes for fast image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Meng Wang,et al.  Enhancing Sketch-Based Image Retrieval by Re-Ranking and Relevance Feedback , 2016, IEEE Transactions on Image Processing.

[3]  Xuelong Li,et al.  On Combining Social Media and Spatial Technology for POI Cognition and Image Localization , 2017, Proceedings of the IEEE.

[4]  Kristen Grauman,et al.  Kernelized Locality-Sensitive Hashing , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[6]  Zhetao Li,et al.  POI Summarization by Aesthetics Evaluation From Crowd Source Social Media , 2018, IEEE Transactions on Image Processing.

[7]  Meng Jian,et al.  Semi-Supervised Bi-Dictionary Learning for Image Classification With Smooth Representation-Based Label Propagation , 2016, IEEE Transactions on Multimedia.

[8]  Heng Tao Shen,et al.  Hashing for Similarity Search: A Survey , 2014, ArXiv.

[9]  Trevor Darrell,et al.  Learning to Hash with Binary Reconstructive Embeddings , 2009, NIPS.

[10]  Qi Tian,et al.  Super-Bit Locality-Sensitive Hashing , 2012, NIPS.

[11]  Shih-Fu Chang,et al.  Semi-supervised hashing for scalable image retrieval , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Shiguang Shan,et al.  Deep Supervised Hashing for Fast Image Retrieval , 2016, International Journal of Computer Vision.

[13]  Petros Daras,et al.  Content-Based Guided Image Filtering, Weighted Semi-Global Optimization, and Efficient Disparity Refinement for Fast and Accurate Disparity Estimation , 2016, IEEE Transactions on Multimedia.

[14]  Yongdong Zhang,et al.  Scalable Similarity Search With Topology Preserving Hashing , 2014, IEEE Transactions on Image Processing.

[15]  Chu-Song Chen,et al.  Supervised Learning of Semantics-Preserving Hash via Deep Convolutional Neural Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yongjun Zhang,et al.  Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yongdong Zhang,et al.  Topology preserving hashing for similarity search , 2013, MM '13.

[18]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[19]  Geoffrey E. Hinton,et al.  Semantic hashing , 2009, Int. J. Approx. Reason..

[20]  Wu-Jun Li,et al.  Scalable Graph Hashing with Feature Transformation , 2015, IJCAI.

[21]  Zhe Wang,et al.  Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search , 2007, VLDB.

[22]  Tsuhan Chen,et al.  Image retrieval with geometry-preserving visual phrases , 2011, CVPR 2011.

[23]  Dimitris N. Metaxas,et al.  Large Scale Medical Image Search via Unsupervised PCA Hashing , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Xueming Qian,et al.  Spatial Verification for Scalable Mobile Image Retrieval , 2014, CIKM.

[25]  Jiwen Lu,et al.  Deep hashing for compact binary codes learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Yongdong Zhang,et al.  A Prior-Free Weighting Scheme for Binary Code Ranking , 2014, IEEE Transactions on Multimedia.

[27]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[28]  Hanjiang Lai,et al.  Supervised Hashing for Image Retrieval via Image Representation Learning , 2014, AAAI.

[29]  Qi Tian,et al.  SIFT match verification by geometric coding for large-scale partial-duplicate web image search , 2013, TOMCCAP.

[30]  Dan Zhang,et al.  Weighted hashing for fast large scale similarity search , 2013, CIKM.

[31]  Xueming Qian,et al.  Joint Hypergraph Learning for Tag-Based Image Retrieval , 2018, IEEE Transactions on Image Processing.

[32]  Qi Tian,et al.  A General Framework for Linear Distance Preserving Hashing , 2018, IEEE Transactions on Image Processing.

[33]  Xueming Qian,et al.  Tag-Based Image Search by Social Re-ranking , 2016, IEEE Transactions on Multimedia.

[34]  Tao Mei,et al.  Learning salient visual word for scalable mobile image retrieval , 2015, Pattern Recognit..

[35]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Qingming Huang,et al.  Robust Spatial Consistency Graph Model for Partial Duplicate Image Retrieval , 2013, IEEE Transactions on Multimedia.

[37]  Shih-Fu Chang,et al.  Semi-Supervised Hashing for Large-Scale Search , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Xueming Qian,et al.  Image Taken Place Estimation via Geometric Constrained Spatial Layer Matching , 2015, MMM.

[39]  Shiliang Zhang,et al.  Embedding Multi-Order Spatial Clues for Scalable Visual Matching and Retrieval , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[40]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[42]  Wu-Jun Li,et al.  Feature Learning Based Deep Supervised Hashing with Pairwise Labels , 2015, IJCAI.

[43]  Meng Wang,et al.  Image Location Inference by Multisaliency Enhancement , 2017, IEEE Transactions on Multimedia.

[44]  Xueming Qian,et al.  Scalable Mobile Image Retrieval by Exploring Contextual Saliency , 2015, IEEE Transactions on Image Processing.

[45]  Qi Tian,et al.  Binary SIFT: towards efficient feature matching verification for image search , 2012, ICIMCS '12.

[46]  Luo Juan,et al.  A comparison of SIFT, PCA-SIFT and SURF , 2009 .

[47]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[48]  Qi Tian,et al.  Image Retargeting for Preserving Robust Local Feature: Application to Mobile Visual Search , 2016, IEEE Transactions on Multimedia.