VideoGIS data retrieval based on multi-feature fusion

With the rapid development of smart cities and the advance of city safety and defense demands, the question that how to accurately discover and retrieve the data that users request from VideoGIS data faces a series of bottleneck problems. VideoGIS data retrieval is one of the important ways to solve above problems. In order to accelerate the rate of feature matching and improve the efficiency of the video retrieval, a new method of VideoGIS data retrieval based on multi-feature fusion is proposed in this paper. The method firstly use video frame difference based on Euclidean distance to extract the key frames under the spatial and temporal sampling of the video. On the basis of this, the global features (e.g. color, shape, texture) are fused by different weighted coefficients, then the feature vector, as the video multi-feature fusion representation, can be constructed by fusing the global features and local features. Based on the multi-feature fusion, correlation between video features is made full use. Compared with the method of single feature and two-feature fusion, the experimental results indicate that the proposed retrieval method has better retrieval effect.

[1]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[2]  Yao Zhao,et al.  Frame Fusion for Video Copy Detection , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Jiann-Jone Chen,et al.  Content-based Video Retrieval with Multi Features , 2014, ICS.

[4]  R. Baskaran,et al.  A Content Based Video Retrieval Analysis System with Extensive Features by Using Kullback-Leibler , 2014, Int. J. Comput. Intell. Syst..

[5]  Li Dere Big Data in Smart City , 2014 .

[6]  Rishi Kumar,et al.  Techniques for key frame extraction: Shot segmentation and feature trajectory computation , 2016, 2016 6th International Conference - Cloud System and Big Data Engineering (Confluence).

[7]  Sung Wook Baik,et al.  Adaptive key frame extraction for video summarization using an aggregation mechanism , 2012, J. Vis. Commun. Image Represent..

[8]  Siddu P. Algur,et al.  Video Key Frame Extraction using Entropy value as Global and Local Feature , 2016, ArXiv.

[9]  Dheeraj Agrawal,et al.  An analysis based on local binary pattern (LBP) and color moment (CM) for efficient image retrieval , 2016, 2016 International Conference on Emerging Technological Trends (ICETT).

[10]  Larry S. Davis,et al.  Re-ranking by Multi-feature Fusion with Diffusion for Image Retrieval , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[11]  Aleksandar Milosavljevic,et al.  GIS-augmented video surveillance , 2010, Int. J. Geogr. Inf. Sci..

[12]  Kong Yun-feng,et al.  Design of GeoVideo Data Model and Implementation of Web-Based VideoGIS , 2010 .

[13]  O. Ayhan Erdem,et al.  Multi-Featured Content-Based Image Retrieval Using Color and Texture Features , 2016 .

[14]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[15]  Jiwu Huang,et al.  Perceptual video hashing robust against geometric distortions , 2011, Science China Information Sciences.

[16]  Kyoung-Ho Choi,et al.  Generation of video metadata supporting video-GIS integration , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[18]  Ashish M. Kothari,et al.  A Review Paper on Key Frame Extraction , 2014 .

[19]  Qi Tian,et al.  Query-adaptive late fusion for image search and person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Raimondo Schettini,et al.  Erratum to: An innovative algorithm for key frame extraction in video summarization , 2012, Journal of Real-Time Image Processing.

[21]  Shradha Gupta,et al.  Performance of SIFT based Video Retrieval , 2011 .

[22]  Sudeep D. Thepade,et al.  Image Retrieval using Texture Features extracted from GLCM, LBG and KPE , 2010 .

[23]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .