Video hashing with secondary frames and invariant moments

Abstract Video hashing is a useful technique of many multimedia systems, such as video copy detection, video authentication, tampering localization, video retrieval, and anti-privacy search. In this paper, we propose a novel video hashing with secondary frames and invariant moments. An important contribution is the secondary frame construction with 3D discrete wavelet transform, which can reach initial data compression and robustness against noise and compression. In addition, since invariant moments are robust and discriminative features, hash generation based on invariant moments extracted from secondary frames can ensure good classification of the proposed video hashing. Extensive experiments on 8300 videos are conducted to validate efficiency of the proposed video hashing. The results show that the proposed video hashing can resist many digital operations and has good discrimination. Performance comparisons with some state-of-the-art algorithms illustrate that the proposed video hashing outperforms the compared algorithms in classification in terms of receiver operating characteristic results.

[1]  Navajit Saikia,et al.  Perceptual hashing in the 3D-DWT domain , 2015, 2015 International Conference on Green Computing and Internet of Things (ICGCIoT).

[2]  Jinhui Tang,et al.  Multimedia retrieval by deep hashing with multilevel similarity learning , 2019, J. Vis. Commun. Image Represent..

[3]  C. De Vleeschouwer,et al.  Robust video hashing based on radial projections of key frames , 2005, IEEE Transactions on Signal Processing.

[4]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[5]  Jungong Han,et al.  Cross-View Retrieval via Probability-Based Semantics-Preserving Hashing , 2017, IEEE Transactions on Cybernetics.

[6]  Shichao Zhang,et al.  Robust Perceptual Image Hashing Based on Ring Partition and NMF , 2014, IEEE Transactions on Knowledge and Data Engineering.

[7]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[8]  Jin Young Kim,et al.  Robust audio fingerprinting using peak-pair-based hash of non-repeating foreground audio in a real environment , 2016, Cluster Computing.

[9]  Priyanka Singh Robust Homomorphic Video Hashing , 2020, ArXiv.

[10]  Nicu Sebe,et al.  Quantization-based hashing: a general framework for scalable image and video retrieval , 2018, Pattern Recognit..

[11]  Dengpan Ye,et al.  High Accuracy Perceptual Video Hashing via Low-Rank Decomposition and DWT , 2020, MMM.

[12]  Ju Liu,et al.  LLE-based video hashing for video identification , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[13]  Qiang Ni,et al.  Joint Image-Text Hashing for Fast Large-Scale Cross-Media Retrieval Using Self-Supervised Deep Learning , 2019, IEEE Transactions on Industrial Electronics.

[14]  Fouad Khelifi,et al.  Perceptual Video Hashing for Content Identification and Authentication , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Zhenjun Tang,et al.  Robust image hashing with visual attention model and invariant moments , 2020, IET Image Process..

[16]  Meng Wang,et al.  Unsupervised t-Distributed Video Hashing and Its Deep Hashing Extension , 2017, IEEE Transactions on Image Processing.

[17]  Prabin Kumar Bora,et al.  Perceptual video hashing using 3D-radial projection technique , 2017, 2017 Fourth International Conference on Signal Processing, Communication and Networking (ICSCN).

[18]  Ju Liu,et al.  Visual Attention Based Temporally Weighting Method for Video Hashing , 2013, IEEE Signal Processing Letters.

[19]  Robust Quantization for General Similarity Search. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[20]  Yue Qi,et al.  Chinese character image retrieval based on moment invariants and shape context , 2015, 2015 IEEE International Conference on Computer and Communications (ICCC).

[21]  Ling Shao,et al.  Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval , 2019, IEEE Transactions on Image Processing.

[22]  Zhenjun Tang,et al.  Robust Video Hashing Based on Multidimensional Scaling and Ordinal Measures , 2021, Secur. Commun. Networks.

[23]  Nasir D. Memon,et al.  Spatio–Temporal Transform Based Video Hashing , 2006, IEEE Transactions on Multimedia.

[24]  Alessandro Neri,et al.  Video watermarking in the 3D-DWT domain using perceptual masking , 2005, IEEE International Conference on Image Processing 2005.

[25]  Vishal Monga,et al.  Robust Video Hashing via Multilinear Subspace Projections , 2012, IEEE Transactions on Image Processing.

[26]  Jing Wang,et al.  A visual saliency based video hashing algorithm , 2012, 2012 19th IEEE International Conference on Image Processing.

[27]  Manuel P. Malumbres,et al.  A fast 3D-DWT video encoder with reduced memory usage suitable for IPTV , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[28]  Shichao Zhang,et al.  Robust Image Hashing With Ring Partition and Invariant Vector Distance , 2016, IEEE Transactions on Information Forensics and Security.

[29]  Xianglin Huang,et al.  Multi-modal sequence model with gated fully convolutional blocks for micro-video venue classification , 2019, Multimedia Tools and Applications.

[30]  Guoqiang Han,et al.  Multi-granularity geometrically robust video hashing for tampering detection , 2018, Multimedia Tools and Applications.

[31]  Zhenjun Tang,et al.  Video Hashing with DCT and NMF , 2020, Comput. J..

[32]  P. K. Bora,et al.  Perceptual video hashing based on temporal wavelet transform and random projections with application to indexing and retrieval of near-identical videos , 2019, Multimedia Tools and Applications.

[33]  Xiaobo Lu,et al.  Learning spatial-temporal features for video copy detection by the combination of CNN and RNN , 2018, J. Vis. Commun. Image Represent..

[34]  Fan Yang,et al.  Robust image hashing via colour vector angles and discrete wavelet transform , 2014, IET Image Process..

[35]  Ling Shao,et al.  Learning to Hash With Optimized Anchor Embedding for Scalable Retrieval , 2017, IEEE Transactions on Image Processing.

[36]  Shichao Zhang,et al.  Robust Image Hashing with Tensor Decomposition , 2019, IEEE Transactions on Knowledge and Data Engineering.

[37]  Meng Wang,et al.  Self-Supervised Video Hashing With Hierarchical Binary Auto-Encoder , 2018, IEEE Transactions on Image Processing.

[38]  Jiwu Huang,et al.  Perceptual video hashing robust against geometric distortions , 2011, Science China Information Sciences.

[39]  Jiandong Zhao,et al.  Vehicle-logo recognition based on modified HU invariant moments and SVM , 2017, Multimedia Tools and Applications.

[40]  Ning Chen,et al.  A robust hashing algorithm based on SURF for video copy detection , 2012, Comput. Secur..

[41]  P. K. Bora,et al.  Perceptual video hashing based on Tucker decomposition with application to indexing and retrieval of near-identical videos , 2015, Multimedia Tools and Applications.

[42]  Yilong Yin,et al.  Spherical torus-based video hashing for near-duplicate video detection , 2016, Science China Information Sciences.

[43]  Ivanna K. Timotius,et al.  Spatio-temporal digital video hashing using edge orientation histogram and discrete cosine transform , 2014, 2014 International Conference on Information Technology Systems and Innovation (ICITSI).

[44]  Neil J. Hurley,et al.  Performance Analysis of Robust Audio Hashing , 2007, IEEE Transactions on Information Forensics and Security.

[45]  Chang Dong Yoo,et al.  Robust video fingerprinting for content-based video identification , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Bart Preneel,et al.  From Image Hashing to Video Hashing , 2010, MMM.

[47]  Yue-Nan Li Energy Based Robust Video Hash Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[48]  Ton Kalker,et al.  Visual hashing of digital video: applications and techniques , 2001, Optics + Photonics.