Fast key-frame image retrieval of intelligent city security video based on deep feature coding in high concurrent network environment

Aiming at the problems faced by the connection management module in single packet processing in intelligent city security video retrieval, we firstly propose the traffic locality quantization index based on the traffic characteristics of the backbone link to quantitatively analyze the traffic locality characteristics in the backbone link. And then, a key-frame abstraction and retrieval of videos based on deep learning is proposed to improve the efficiency and accuracy of video retrieval, where an adaptive key-frame selection algorithm is designed and the existing convolutional neural network framework is used to extract the features of key-frames, and unsupervised, semi-supervised and supervised retraining models are designed to improve the effectiveness of the feature extraction of the convolutional neural network and the accuracy of the video retrieval. Experimental results based on the public video datasets show that our proposed key-frame image retrieval model realizes a good precision for key-frame representation, and achieves high accuracy and efficiency for video retrieval.

[1]  Qing Zhu,et al.  A NoSQL-SQL Hybrid Organization and Management Approach for Real-Time Geospatial Data: A Case Study of Public Security Video Surveillance , 2017, ISPRS Int. J. Geo Inf..

[2]  Sung Wook Baik,et al.  Multi-scale contrast and relative motion-based key frame extraction , 2018, EURASIP J. Image Video Process..

[3]  Zi Huang,et al.  Linear cross-modal hashing for efficient multimedia search , 2013, ACM Multimedia.

[4]  Shailendra S. Aote,et al.  An automatic video annotation framework based on two level keyframe extraction mechanism , 2018, Multimedia Tools and Applications.

[5]  Yunde Jia,et al.  Heterogeneous Hashing Network for Face Retrieval Across Image and Video Domains , 2019, IEEE Transactions on Multimedia.

[6]  Xiong Li,et al.  An improved and provably secure three-factor user authentication scheme for wireless sensor networks , 2018, Peer-to-Peer Netw. Appl..

[7]  Hyeoncheol Kim,et al.  Implementation of convergence P2P information retrieval system from captured video frames , 2018, Peer Peer Netw. Appl..

[8]  Meng Yang,et al.  Large-Margin Softmax Loss for Convolutional Neural Networks , 2016, ICML.

[9]  Anastasios Tefas,et al.  A salient dictionary learning framework for activity video summarization via key-frame extraction , 2018, Inf. Sci..

[10]  Wen Gao,et al.  HNIP: Compact Deep Invariant Representations for Video Matching, Localization, and Retrieval , 2017, IEEE Transactions on Multimedia.

[11]  Zoran A. Salcic,et al.  System-level approach to the design of ambient intelligence systems based on wireless sensor and actuator networks , 2015, J. Ambient Intell. Humaniz. Comput..

[12]  Srinivasan Ramakrishnan,et al.  Fibonacci Based Key Frame Selection and Scrambling for Video Watermarking in DWT–SVD Domain , 2018, Wirel. Pers. Commun..

[13]  Umapada Pal,et al.  Date-field retrieval in scene image and video frames using text enhancement and shape coding , 2017, Neurocomputing.

[14]  Thomas Mensink,et al.  New Modality: Emoji Challenges in Prediction, Anticipation, and Retrieval , 2018, IEEE Transactions on Multimedia.

[15]  Zi Huang,et al.  Effective Multiple Feature Hashing for Large-Scale Near-Duplicate Video Retrieval , 2013, IEEE Transactions on Multimedia.

[16]  Dan Zhang,et al.  Learning to Hash with Partial Tags: Exploring Correlation between Tags and Hashing Bits for Large Scale Image Retrieval , 2014, ECCV.

[17]  Ying Deng,et al.  Self-feedback image retrieval algorithm based on annular color moments , 2019, EURASIP J. Image Video Process..

[18]  P. K. Bora,et al.  Perceptual video hashing based on temporal wavelet transform and random projections with application to indexing and retrieval of near-identical videos , 2019, Multimedia Tools and Applications.

[19]  Nestor Burtnyk,et al.  Interactive skeleton techniques for enhancing motion dynamics in key frame animation , 1976, Commun. ACM.

[20]  Nicu Sebe,et al.  Quantization-based hashing: a general framework for scalable image and video retrieval , 2018, Pattern Recognit..

[21]  Xirong Li,et al.  Predicting Visual Features From Text for Image and Video Caption Retrieval , 2017, IEEE Transactions on Multimedia.

[22]  Shifeng Wu,et al.  Civil engineering supervision video retrieval method optimization based on spectral clustering and R-tree , 2019, Neural Computing and Applications.

[23]  Linlin Liu,et al.  Sitcom-star-based clothing retrieval for video advertising: a deep learning framework , 2018, Neural Computing and Applications.

[24]  N. Burtnyk,et al.  Computer-Generated Key-Frame Animation , 1971 .

[25]  Ken-ichi Anjyo,et al.  Animating pictures of water scenes using video retrieval , 2016, The Visual Computer.

[26]  Xirong Li,et al.  Tag relevance fusion for social image retrieval , 2014, Multimedia Systems.

[27]  Zhongfu Ye,et al.  A Novel Chinese Sign Language Recognition Method Based on Keyframe-Centered Clips , 2018, IEEE Signal Processing Letters.

[28]  Yun-Hui Liu,et al.  Odometry-Vision-Based Ground Vehicle Motion Estimation With SE(2)-Constrained SE(3) Poses , 2019, IEEE Transactions on Cybernetics.

[29]  Guoliang Fan,et al.  Combined key-frame extraction and object-based video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Shouling Ji,et al.  Video Big Data Retrieval Over Media Cloud: A Context-Aware Online Learning Approach , 2019, IEEE Transactions on Multimedia.

[31]  Regunathan Radhakrishnan,et al.  Video summarization using descriptors of motion activity: A motion activity based approach to key-frame extraction from video shots , 2001, J. Electronic Imaging.

[32]  Daiyin Zhu,et al.  Height Retrieval in Postprocessing-Based VideoSAR Image Sequence Using Shadow Information , 2018, IEEE Sensors Journal.

[33]  Tianming Liu,et al.  A novel video key-frame-extraction algorithm based on perceived motion energy model , 2003, IEEE Trans. Circuits Syst. Video Technol..

[34]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.