Caught Red-Handed: Toward Practical Video-Based Subsequences Matching in the Presence of Real-World Transformations

Every minute, staggering amounts of user-generated videos are uploaded to on-line social networks. These videos can generate significant advertising revenue, providing strong incentive for unscrupulous individuals that wish to capitalize on this bonanza by pirating short clips from popular content and altering the copied media in ways that might bypass detection. Unfortunately, while the challenges posed by the use of skillful transformations has been known for quite some time, current state-of-the-art methods still suffer from severe limitations. Indeed, most of today's techniques perform poorly in the face of real world copies. To address this, we propose a novel approach that leverages temporal characteristics to identify subsequences of a video that were copied from elsewhere. Our approach takes advantage of a new temporal feature to index a reference library in a manner that is robust to popular spatial and temporal transformations in pirated videos. Our experimental evaluation on 27 hours of video obtained from social networks demonstrates that our technique significantly outperforms the existing state-of-the-art approaches with respect to accuracy, resilience, and efficiency.

[1]  Olivier Buisson,et al.  Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search , 2007, IEEE Transactions on Multimedia.

[2]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[3]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[4]  Luc Van Gool,et al.  Spatio-temporal features for robust content-based video copy detection , 2008, MIR '08.

[5]  Olivier Buisson,et al.  Z-grid-based probabilistic retrieval for scaling up content-based copy detection , 2007, CIVR '07.

[6]  Olivier Buisson,et al.  ViCopT: a robust system for content-based video copy detection in large databases , 2009, Multimedia Systems.

[7]  Lucas Hilderbrand Youtube: Where Cultural Memory and Copyright Converge , 2007 .

[8]  Sid-Ahmed Berrani,et al.  Adaptive similarity search in large databases - application to image/video copy detection , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[9]  Pierre N. Leval Toward a Fair Use Standard , 1990 .

[10]  Hung-Khoon Tan,et al.  Scalable detection of partial near-duplicate videos by visual-temporal consistency , 2009, ACM Multimedia.

[11]  Özgür Ulusoy,et al.  Video copy detection using multiple visual cues and MPEG-7 descriptors , 2010, J. Vis. Commun. Image Represent..

[12]  Chu-Song Chen,et al.  Efficient and Effective Video Copy Detection Based on Spatiotemporal Analysis , 2007, ISM 2007.

[13]  Zi Huang,et al.  Multiple feature hashing for real-time large scale near-duplicate video retrieval , 2011, ACM Multimedia.

[14]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[15]  Jan-Michael Frahm,et al.  Watching the Watchers: Automatically Inferring TV Content From Outdoor Light Effusions , 2014, CCS.

[16]  Abigail R. Simon Contracting in the Dark: Casting Light on the Shadows of Second Level Agreements , 2014 .

[17]  Rabab Kreidieh Ward,et al.  A Robust and Fast Video Copy Detection System Using Content-Based Fingerprinting , 2011, IEEE Transactions on Information Forensics and Security.

[18]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[19]  Ruud M. Bolle,et al.  Comparison of sequence matching techniques for video copy detection , 2001, IS&T/SPIE Electronic Imaging.

[20]  Fred Stentiford,et al.  Video sequence matching based on temporal ordinal measurement , 2008, Pattern Recognit. Lett..

[21]  Yan Ke,et al.  Efficient Near-duplicate Detection and Sub-image Retrieval , 2004 .

[22]  Chong-Wah Ngo,et al.  Practical elimination of near-duplicates from web video search , 2007, ACM Multimedia.

[23]  Jean-Hugues Chenot,et al.  A large-scale audio and video fingerprints-generated database of TV repeated contents , 2014, 2014 12th International Workshop on Content-Based Multimedia Indexing (CBMI).

[24]  Taylor B Bartholomew The Death of Fair Use in Cyberspace: YouTube and the Problem With Content ID , 2015 .

[25]  Shih-Fu Chang,et al.  Detecting image near-duplicate by stochastic attributed relational graph matching with learning , 2004, MULTIMEDIA '04.

[26]  Mei-Chen Yeh,et al.  A compact, effective descriptor for video copy detection , 2009, MM '09.

[27]  Jiajun Wang,et al.  VCDB: A Large-Scale Database for Partial Copy Detection in Videos , 2014, ECCV.

[28]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[29]  William Plowden The Compact , 2003 .

[30]  Olivier Buisson,et al.  Robust voting algorithm based on labels of behavior for video copy detection , 2006, MM '06.

[31]  Yao Zhao,et al.  Frame Fusion for Video Copy Detection , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Qi Tian,et al.  Fast and robust short video clip search using an index structure , 2004, MIR '04.

[33]  Luo Juan,et al.  A comparison of SIFT, PCA-SIFT and SURF , 2009 .

[34]  Brandon Brown Fortifying the Safe Harbors: Reevaluating the DMCA in a Web 2.0 World , 2008 .

[35]  Desney S. Tan,et al.  Spy-resistant keyboard: more secure password entry on public touch screen displays , 2005, OZCHI.

[36]  Xian-Sheng Hua,et al.  Robust video signature based on ordinal measure , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[37]  Chu-Song Chen,et al.  A Framework for Handling Spatiotemporal Variations in Video Copy Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.