Near-duplicate video retrieval: Current research and future trends

The exponential growth of online videos, along with increasing user involvement in video-related activities, has been observed as a constant phenomenon during the last decade. User's time spent on video capturing, editing, uploading, searching, and viewing has boosted to an unprecedented level. The massive publishing and sharing of videos has given rise to the existence of an already large amount of near-duplicate content. This imposes urgent demands on near-duplicate video retrieval as a key role in novel tasks such as video search, video copyright protection, video recommendation, and many more. Driven by its significance, near-duplicate video retrieval has recently attracted a lot of attention. As discovered in recent works, latest improvements and progress in near-duplicate video retrieval, as well as related topics including low-level feature extraction, signature generation, and high-dimensional indexing, are employed to assist the process. As we survey the works in near-duplicate video retrieval, we comparatively investigate existing variants of the definition of near-duplicate video, describe a generic framework, summarize state-of-the-art practices, and explore the emerging trends in this research topic.

[1]  Chong-Wah Ngo,et al.  On the Annotation of Web Videos by Efficient Near-Duplicate Search , 2010, IEEE Transactions on Multimedia.

[2]  Zi Huang,et al.  Bounded coordinate system indexing for real-time video clip search , 2009, TOIS.

[3]  Jiri Matas,et al.  Large-Scale Discovery of Spatially Related Images , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Kristen Grauman,et al.  Efficiently searching for similar images , 2010, Commun. ACM.

[5]  Zi Huang,et al.  Efficient and Continuous Near-duplicate Video Detection , 2010, 2010 12th International Asia-Pacific Web Conference.

[6]  Zi Huang,et al.  Practical Online Near-Duplicate Subsequence Detection for Continuous Video Streams , 2010, IEEE Transactions on Multimedia.

[7]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Justin Zobel,et al.  Detection of video sequences using compact signatures , 2006, TOIS.

[9]  Shuicheng Yan,et al.  Near-duplicate keyframe retrieval by nonrigid image matching , 2008, ACM Multimedia.

[10]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[11]  Hung-Khoon Tan,et al.  Efficient Mining of Multiple Partial Near-Duplicate Alignments by Temporal Network , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Chong-Wah Ngo,et al.  Scale-Rotation Invariant Pattern Entropy for Keypoint-Based Near-Duplicate Detection , 2009, IEEE Transactions on Image Processing.

[13]  Nuria Oliver,et al.  Understanding near-duplicate videos: a user-centric approach , 2009, ACM Multimedia.

[14]  Georges Quénot,et al.  TRECVID 2015 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics , 2011, TRECVID.

[15]  Olivier Buisson,et al.  A posteriori multi-probe locality sensitive hashing , 2008, ACM Multimedia.

[16]  Fei Wang,et al.  Real-time large scale near-duplicate web video retrieval , 2010, ACM Multimedia.

[17]  Hung-Khoon Tan,et al.  Scalable detection of partial near-duplicate videos by visual-temporal consistency , 2009, ACM Multimedia.

[18]  Parham Aarabi,et al.  Tiny Videos: A Large Data Set for Nonparametric Video Retrieval and Frame Classification , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Olivier Buisson,et al.  Scalable mining of large video databases using copy detection , 2008, ACM Multimedia.

[20]  Olivier Buisson,et al.  Robust voting algorithm based on labels of behavior for video copy detection , 2006, MM '06.

[21]  Ira Assent,et al.  Robust Adaptable Video Copy Detection , 2009, SSTD.

[22]  Mei-Chen Yeh,et al.  Video copy detection by fast sequence matching , 2009, CIVR '09.

[23]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[24]  Hung-Khoon Tan,et al.  Accelerating near-duplicate video matching by combining visual similarity and alignment distortion , 2008, ACM Multimedia.

[25]  Cordelia Schmid,et al.  An Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering , 2010, IEEE Transactions on Multimedia.

[26]  Chong-Wah Ngo,et al.  Near-duplicate keyframe retrieval with visual keywords and semantic context , 2007, CIVR '07.

[27]  Hung-Khoon Tan,et al.  Real-Time Near-Duplicate Elimination for Web Video Search With Content and Context , 2009, IEEE Transactions on Multimedia.

[28]  Jun Adachi,et al.  Scene duplicate detection based on the pattern of discontinuities in feature point trajectories , 2008, ACM Multimedia.

[29]  Beng Chin Ooi,et al.  Towards effective indexing for very large video sequence database , 2005, SIGMOD '05.

[30]  Olivier Buisson,et al.  ViCopT: a robust system for content-based video copy detection in large databases , 2009, Multimedia Systems.

[31]  Zi Huang,et al.  Online Near-Duplicate Video Clip Detection and Retrieval: An Accurate and Fast System , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[32]  Andrew Zisserman,et al.  Near Duplicate Image Detection: min-Hash and tf-idf Weighting , 2008, BMVC.

[33]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Athman Bouguettaya,et al.  An Efficient Near-Duplicate Video Shot Detection Method Using Shot-Based Interest Points , 2009, IEEE Transactions on Multimedia.

[35]  Qingming Huang,et al.  Near-duplicate video matching with transformation recognition , 2009, MM '09.

[36]  Chong-Wah Ngo,et al.  Efficient Near-Duplicate Keyframe Retrieval with Visual Language Models , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[37]  Chong-Wah Ngo,et al.  Practical elimination of near-duplicates from web video search , 2007, ACM Multimedia.

[38]  Jun Adachi,et al.  Scene duplicate detection from videos based on trajectories of feature points , 2007, MIR '07.

[39]  Zi Huang,et al.  UQLIPS: A Real-time Near-duplicate Video Clip Detection System , 2007, VLDB.

[40]  Zi Huang,et al.  Mining near-duplicate graph for cluster-based reranking of web video search results , 2010, TOIS.

[41]  Li Chen,et al.  Video copy detection: a comparative study , 2007, CIVR '07.

[42]  Chong-Wah Ngo,et al.  Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval , 2009, Comput. Vis. Image Underst..

[43]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[44]  Beng Chin Ooi,et al.  Continuous Content-Based Copy Detection over Streaming Videos , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[45]  Hung-Khoon Tan,et al.  Near-Duplicate Keyframe Identification With Interest Point Matching and Pattern Learning , 2007, IEEE Transactions on Multimedia.

[46]  Panos Kalnis,et al.  Quality and efficiency in high dimensional nearest neighbor search , 2009, SIGMOD Conference.

[47]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[48]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[49]  Beng Chin Ooi,et al.  iDistance: An adaptive B+-tree based indexing method for nearest neighbor search , 2005, TODS.

[50]  Cordelia Schmid,et al.  Improving Bag-of-Features for Large Scale Image Search , 2010, International Journal of Computer Vision.

[51]  共立出版株式会社 コンピュータ・サイエンス : ACM computing surveys , 1978 .

[52]  Mubarak Shah,et al.  Content based video matching using spatiotemporal volumes , 2008, Comput. Vis. Image Underst..

[53]  Christian Böhm,et al.  ProVeR: Probabilistic Video Retrieval using the Gauss-Tree , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[54]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[55]  Lu Liu,et al.  Video Histogram: A Novel Video Signature for Efficient Web Video Duplicate Detection , 2007, MMM.