The MPEG-7 Video Signature Tools for Content Identification

This paper presents the core technologies of the video signature tools recently standardized by ISO/IEC Moving Picture Experts Group (MPEG) as an amendment to the MPEG-7 Standard (ISO/IEC 15938). The video signature is a high-performance content fingerprint that is suitable for desktop scale to web-scale deployment and provides high levels of robustness to common video editing operations and high temporal localization accuracy at extremely low false alarm rates, achieving a detection rate in the order of 96% at a false alarm rate in the order of five false matches per million comparisons. The applications of the video signature are numerous and include rights management and monetization, distribution management, usage monitoring, metadata association, and corporate or personal database management. In this paper, we review the prior work in the field, explain the standardization process and status, and provide details and evaluation results for the video signature tools.

[1]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Chu-Song Chen,et al.  Efficient and Effective Video Copy Detection Based on Spatiotemporal Analysis , 2007, ISM 2007.

[3]  Fred Stentiford,et al.  Video sequence matching based on temporal ordinal measurement , 2008, Pattern Recognit. Lett..

[4]  Mubarak Shah,et al.  University of Central Florida at TRECVID 2008 Content Based Copy Detection and Surveillance Event Detection , 2008, TRECVID.

[5]  Chong-Wah Ngo,et al.  Practical elimination of near-duplicates from web video search , 2007, ACM Multimedia.

[6]  Mei-Chen Yeh,et al.  A compact, effective descriptor for video copy detection , 2009, MM '09.

[7]  Zi Huang,et al.  UQLIPS: A Real-time Near-duplicate Video Clip Detection System , 2007, VLDB.

[8]  Olivier Buisson,et al.  Robust voting algorithm based on labels of behavior for video copy detection , 2006, MM '06.

[9]  David D. Lewis,et al.  Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval , 1998, ECML.

[10]  Ruud M. Bolle,et al.  Comparison of sequence matching techniques for video copy detection , 2001, IS&T/SPIE Electronic Imaging.

[11]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[12]  Paul Over,et al.  TRECVID-2008 content-based copy detection task overview (slides) , 2008 .

[13]  Tao Liu,et al.  AT&T Research at TRECVID 2009 Content-based Copy Detection , 2009, TRECVID.

[14]  Anindya Sarkar,et al.  Duplicate Video Detection-Comparison of Proposed Distance Function with Dynamic Time Warping and Dependence of Detection Accuracy on Keyframe Selection , 2009 .

[15]  David Salomon,et al.  Data compression - The Complete Reference, 4th Edition , 2004 .

[16]  Nikola Sprljan,et al.  Compressed signature for video identification , 2010, 28th Picture Coding Symposium.

[17]  Alberto Del Bimbo,et al.  Video Clip Matching Using MPEG-7 Descriptors and Edit Distance , 2006, CIVR.

[18]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[19]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Olivier Buisson,et al.  Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search , 2007, IEEE Transactions on Multimedia.

[21]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Aggelos K. Katsaggelos,et al.  Local feature extraction for video copy detection in a database , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[24]  B. S. Manjunath,et al.  Efficient and Robust Detection of Duplicate Videos in a Large Database , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[26]  Fei Wang,et al.  Real-time large scale near-duplicate web video retrieval , 2010, ACM Multimedia.

[27]  David Salomon,et al.  Data Compression: The Complete Reference , 2006 .

[28]  Tao Mei,et al.  Scalable clip-based near-duplicate video detection with ordinal measure , 2010, CIVR '10.