Geometrically robust video hashing based on ST-PCT for video copy detection

Copy videos flooding in the network infringe the video copyright and heavy the storage pressure on the video services server, which raises a huge demand for video copy detection techniques that can accurately and quickly detect the copies of video from huge video database. This paper aims to generate a video hash which has not only high discrimination but also robustness against geometrical and spatial-temporal transformations. First, we propose Spatial-Temporal Polar Cosine Transform (ST-PCT), which considers a video as a three-dimensional matrix and performs two-dimensional Polar Cosine Transforms (PCT) after performing a one-dimensional Discrete Cosine Transform (DCT) on video. This transformation can extract features of the spatial-temporal domain and has geometric invariance. Then, based on ST-PCT, we propose a geometrically robust video hashing method for video copy detection. The video features generated by ST-PCT are compressed and quantified to a compact binary hash code. Experimental results show that compared with the state-of-the-art methods, the proposed method has better robustness, higher accuracy, and faster calculation speed.

[1]  Sukhendu Das,et al.  Trajectory representation using Gabor features for motion-based video retrieval , 2009, Pattern Recognit. Lett..

[2]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[3]  Xudong Jiang,et al.  Two-Dimensional Polar Harmonic Transforms for Invariant Image Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  A. Enis Çetin,et al.  Motion Vector Based Features for Content Based Video Copy Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[5]  Rabab Kreidieh Ward,et al.  A Robust and Fast Video Copy Detection System Using Content-Based Fingerprinting , 2011, IEEE Transactions on Information Forensics and Security.

[6]  Hao Chen,et al.  Video Copy Detection Based On Temporal Contextual Hashing , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[7]  Navajit Saikia,et al.  Perceptual hashing in the 3D-DWT domain , 2015, 2015 International Conference on Green Computing and Internet of Things (ICGCIoT).

[8]  Amina Serir,et al.  Weber Binarized Statistical Image Features (WBSIF) based video copy detection , 2016, J. Vis. Commun. Image Represent..

[9]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[10]  R. C. Mahajan,et al.  Authenticating using secret key in digital video watermarking using 3-level DWT , 2015, 2015 International Conference on Communication, Information & Computing Technology (ICCICT).

[11]  N. Divecha,et al.  Implementation and performance analysis of DCT-DWT-SVD based watermarking algorithms for color images , 2013, 2013 International Conference on Intelligent Systems and Signal Processing (ISSP).

[12]  Yong Man Ro,et al.  Adaptive weighted fusion with new spatial and temporal fingerprints for improved video copy detection , 2014, Signal Process. Image Commun..

[13]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[14]  Deng Cai,et al.  Density Sensitive Hashing , 2012, IEEE Transactions on Cybernetics.

[15]  Xinpeng Zhang,et al.  Robust Hashing for Image Authentication Using Zernike Moments and Local Features , 2013, IEEE Transactions on Information Forensics and Security.

[16]  Shih-Fu Chang,et al.  Spherical hashing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Süleyman Baykut,et al.  Robust video copy detection in large-scale TV streams using local features and CFAR based threshold , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[18]  Zhijie Zhang,et al.  Video copy detection based on Speeded Up Robust Features and Locality Sensitive Hashing , 2010, 2010 IEEE International Conference on Automation and Logistics.

[19]  Hong Liu,et al.  A Segmentation and Graph-Based Video Sequence Matching Method for Video Copy Detection , 2013, IEEE Transactions on Knowledge and Data Engineering.

[20]  Po-Chyi Su,et al.  Efficient copy detection for compressed digital videos by spatial and temporal feature extraction , 2015, Multimedia Tools and Applications.

[21]  Yilong Yin,et al.  Two-layer video fingerprinting strategy for near-duplicate video detection , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[22]  Yassine Himeur,et al.  Robust video copy detection based on ring decomposition based binarized statistical image features and invariant color descriptor (RBSIF-ICD) , 2018, Multimedia Tools and Applications.

[23]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[24]  Nasir D. Memon,et al.  Spatio–Temporal Transform Based Video Hashing , 2006, IEEE Transactions on Multimedia.

[25]  Yassine Himeur,et al.  Joint color and texture descriptor using ring decomposition for robust video copy detection in large databases , 2015, 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[26]  Chang Dong Yoo,et al.  Robust video fingerprinting for content-based video identification , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  John R. Kender,et al.  Fast Near-Duplicate Video Retrieval via Motion Time Series Matching , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[28]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[29]  Yassine Himeur,et al.  A fast and robust Key-frames based Video Copy Detection using BSIF-RMI , 2014, 2014 International Conference on Signal Processing and Multimedia Applications (SIGMAP).

[30]  Haojie Li,et al.  Compact CNN Based Video Representation for Efficient Video Copy Detection , 2017, MMM.

[31]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[32]  Jing Li,et al.  Two-class 3D-CNN classifiers combination for video copy detection , 2018, Multimedia Tools and Applications.

[33]  Blake D. Bryant,et al.  IEEE Transactions on Information Forensics and Security , 2018 .

[34]  Miguel Morales-Sandoval,et al.  A robust and low-cost video fingerprint extraction method for copy detection , 2017, Multimedia Tools and Applications.

[35]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[36]  Guoqiang Han,et al.  Multi-granularity geometrically robust video hashing for tampering detection , 2018, Multimedia Tools and Applications.

[37]  Xiaobo Lu,et al.  Learning spatial-temporal features for video copy detection by the combination of CNN and RNN , 2018, J. Vis. Commun. Image Represent..

[38]  Sanket Shinde,et al.  Recent advances in content based video copy detection , 2015, 2015 International Conference on Pervasive Computing (ICPC).