An Application of Ternary Hash Retrieval Method for Remote Sensing Images in Panoramic Video

With the development of multimedia technology, the application of panoramic video is emerging, and there are specific application scenarios in the field of drones. Remote sensing images have tremendous applications in data acquisition and processing in the panoramic maps used to construct the panoramic videos. Efficient remote sensing image retrieval can greatly improve the efficiency of image utilization and get a fast response in the construction of panoramic video. Thus, how to achieve fast and efficient remote sensing image retrieval becomes increasingly important. Scholars have explored a number of ways to address this problem, from traditional manual feature-based retrieval methods to deep hash retrieval methods that today can cope with large data volumes. The hash method is a way to encode high-dimensional data into a set of binary codes while maintaining similarity between images. In this paper, we propose an end-to-end ternary label depth hashing method that is capable of both feature learning and hash coding processes in one-stage. The experimental results show that the algorithm has high accuracy and good retrieval effect.

[1]  Fang Liu,et al.  Unsupervised Deep Feature Learning for Remote Sensing Image Retrieval , 2018, Remote. Sens..

[2]  David J. Fleet,et al.  Minimal Loss Hashing for Compact Binary Codes , 2011, ICML.

[3]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[4]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.

[5]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[6]  Avik Bhattacharya,et al.  Siamese graph convolutional network for content based remote sensing image retrieval , 2019, Comput. Vis. Image Underst..

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Hanjiang Lai,et al.  Supervised Hashing for Image Retrieval via Image Representation Learning , 2014, AAAI.

[9]  Romesh Saigal Numerical Continuation Methods, An Introduction (Eugene Allgower and Kurt Georg) , 1991, SIAM Rev..

[10]  Nenghai Yu,et al.  Order preserving hashing for approximate nearest neighbor search , 2013, ACM Multimedia.

[11]  Jin Yang,et al.  A remote-sensing image-retrieval model based on an ensemble neural networks , 2018 .

[12]  Robert Wright,et al.  A comparative evaluation of video remote sensing and field survey for revegetation monitoring of a pipeline route , 1998 .

[13]  Minyi Guo,et al.  Supervised hashing with latent factor models , 2014, SIGIR.

[14]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[15]  Shih-Fu Chang,et al.  Sequential Projection Learning for Hashing with Compact Codes , 2010, ICML.

[16]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Wu-Jun Li,et al.  Feature Learning Based Deep Supervised Hashing with Pairwise Labels , 2015, IJCAI.

[18]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Naeem Ramzan,et al.  Learning transfer using deep convolutional features for remote sensing image retrieval , 2019 .

[20]  Wei Liu,et al.  Hashing with Graphs , 2011, ICML.

[21]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[22]  Thorsten Joachims,et al.  Learning structural SVMs with latent variables , 2009, ICML '09.

[23]  Rongrong Ji,et al.  Supervised hashing with kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[25]  Jianmin Wang,et al.  Deep Hashing Network for Efficient Similarity Retrieval , 2016, AAAI.

[26]  Ian D. Reid,et al.  Fast Training of Triplet-Based Deep Binary Embedding Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Nicu Sebe,et al.  A Survey on Learning to Hash , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  WangJun,et al.  Semi-Supervised Hashing for Large-Scale Search , 2012 .

[29]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[30]  Bing Liu,et al.  Siamese Convolutional Neural Networks for Remote Sensing Scene Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[31]  Hanjiang Lai,et al.  Simultaneous feature learning and hash coding with deep neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Philip S. Yu,et al.  HashNet: Deep Learning to Hash by Continuation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Jianmin Wang,et al.  Deep Cauchy Hashing for Hamming Space Retrieval , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[36]  Joan Bruna,et al.  Divide and Conquer Networks , 2016, ICLR.

[37]  Tieniu Tan,et al.  Deep semantic ranking based hashing for multi-label image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Dacheng Tao,et al.  Adversarial Examples for Hamming Space Search , 2020, IEEE Transactions on Cybernetics.

[39]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[40]  Don Kimber,et al.  FlyCam: practical panoramic video and automatic camera control , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).