Content-Based Video Copy Detection Benchmarking at TRECVID

This article presents an overview of the video copy detection benchmark which was run over a period of 4 years (2008--2011) as part of the TREC Video Retrieval (TRECVID) workshop series. The main contributions of the article include i) an examination of the evolving design of the evaluation framework and its components (system tasks, data, measures); ii) a high-level overview of results and best-performing approaches; and iii) a discussion of lessons learned over the four years. The content-based copy detection (CCD) benchmark worked with a large collection of synthetic queries, which is atypical for TRECVID, as was the use of a normalized detection cost framework. These particular evaluation design choices are motivated and appraised.

[1]  Luntian Mou,et al.  A multimodal video copy detection approach with sequential pyramid matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  S.M. Ji,et al.  A survey of the image copy detection , 2008, 2008 IEEE Conference on Cybernetics and Intelligent Systems.

[3]  Tao Liu,et al.  AT&T Research at TRECVID 2009 Content-based Copy Detection , 2009, TRECVID.

[4]  Juan Manuel Barrios.  Content-based video copy detection , 2009, MM '09.

[5]  Gilles Boulianne,et al.  CRIM AT TRECVID-2011: Content-Based Copy Detection using Nearest-Neighbor Mapping , 2011, TRECVID.

[6]  Wessel Kraaij,et al.  Visual Tools for Assisting Child Pornography Investigators , 2008 .

[7]  Edward Y. Chang,et al.  Enhancing DPF for near-replica image recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Shih-Fu Chang,et al.  Internet image archaeology: automatically tracing the manipulation history of photographs on the web , 2008, ACM Multimedia.

[9]  Cordelia Schmid,et al.  An Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering , 2010, IEEE Transactions on Multimedia.

[10]  Werner Bailer.  Evaluating detection of near duplicate video segments , 2010, CIVR '10.

[11]  Julien Law-To,et al.  INRIA-IMEDIA TRECVID 2008: Video Copy Detection , 2008, TRECVID.

[12]  Antonio Albiol,et al.  Detection of TV commercials , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Kiriakos N. Kutulakos.  Trends and Topics in Computer Vision , 2010, Lecture Notes in Computer Science.

[14]  Patrick Cardinal,et al.  CRIM’s content-based audio copy detection system for TRECVID 2009 , 2012, 2010 International Workshop on Content Based Multimedia Indexing (CBMI).

[15]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[16]  Patrick Cardinal,et al.  Crim's content-based audio copy detection system for TRECVID 2009 , 2010, CBMI.

[17]  Tao Liu,et al.  Effective and scalable video copy detection , 2010, MIR '10.

[18]  Yan Ke,et al.  Efficient Near-duplicate Detection and Sub-image Retrieval , 2004 .

[19]  Yongdong Zhang,et al.  Effective and Efficient Image Copy Detection Based on GPU , 2010, ECCV Workshops.

[20]  Tiejun Huang,et al.  Video Copy Detection Using a Soft Cascade of Multimodal Features , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[21]  Zi Huang,et al.  Near-duplicate video retrieval: Current research and future trends , 2013, CSUR.

[22]  Yan Ke,et al.  An efficient parts-based near-duplicate and sub-image retrieval system , 2004, MULTIMEDIA '04.

[23]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[24]  Olivier Buisson,et al.  Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search , 2007, IEEE Transactions on Multimedia.

[25]  J. Breen,et al.  YouTube or YouLose? Can YouTube Survive a Copyright Infringement Lawsuit , 2007 .

[26]  Patrick Cardinal,et al.  Content-based video copy detection using nearest-neighbor mapping , 2010, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[27]  Zi Huang,et al.  Practical Online Near-Duplicate Subsequence Detection for Continuous Video Streams , 2010, IEEE Transactions on Multimedia.

[28]  Noel Murphy,et al.  Automatic TV advertisement detection from MPEG bitstream , 2002, Pattern Recognit..

[29]  Chong-Wah Ngo,et al.  Practical elimination of near-duplicates from web video search , 2007, ACM Multimedia.

[30]  Wen Gao,et al.  PKU-IDM @TRECVID2011 CBCD: Content-Based Copy Detection with Cascade of Multimodal Features and Temporal Pyramid Matching , 2011, TRECVID.

[31]  Cordelia Schmid,et al.  INRIA-LEAR'S Video Copy Detection System , 2008, TRECVID.

[32]  Chu-Song Chen,et al.  A Time Warping Based Approach for Video Copy Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[33]  Shumeet Baluja,et al.  Audio Fingerprinting: Combining Computer Vision & Data Stream Processing , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[34]  Jonathan G. Fiscus,et al.  Topic detection and tracking evaluation overview , 2002 .

[35]  Patrick Cardinal,et al.  CRIM´s Content-Based Copy Detection System for TRECVID , 2009, TRECVID.

[36]  Wen Gao,et al.  PKU-IDM @ TRECVid 2010: Copy Detection with Visual-Audio Feature Fusion and Sequential Pyramid Matching , 2010 .