Frame filtering and path verification for improving video copy detection

Recently, the frame fusion based video copy detection scheme provides a possibility to detect copies in a continuous query video stream. However, its computational complexity is high since a large amount of returned reference frames need to be handled by some reference clip reconstruction methods. In addition, dense frame sampling strategies generally used for improving copy localization precision not only further aggravates the computational efficiency but also leads to much more false alarms due to content redundancy among frames. To alleviate the above problems, a new scheme is proposed for improving the performance of the frame fusion based video copy detection in both efficiency and effectiveness. In particular, the continuous similarity property among neighbor frames is learned for guiding the design of smart frame filtering method so as to greatly reduce the redundancy among frames. Then, an effective path verification scheme, which utilizes cross-clip verification strategy, is given for removing false alarms. The extensive experimental results show that the proposed schemes remarkably improve the detection accuracy of the baseline frame fusion scheme and give a comparable localization accuracy to it.

[1]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yao Zhao,et al.  Multimodal Fusion for Video Search Reranking , 2010, IEEE Transactions on Knowledge and Data Engineering.

[3]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Yusuke Uchida,et al.  Fast and accurate content-based video copy detection using bag-of-global visual features , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Wen Gao,et al.  Video Copy-Detection and Localization with a Scalable Cascading Framework , 2013, IEEE MultiMedia.

[7]  Cordelia Schmid,et al.  An Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering , 2010, IEEE Transactions on Multimedia.

[8]  Yao Zhao,et al.  Frame Fusion for Video Copy Detection , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Fangzhe Chang,et al.  Efficient video copy detection via aligning video signature time series , 2012, ICMR.

[10]  Vasudev Bhaskaran,et al.  Spatiotemporal sequence matching for efficient video copy detection , 2005, IEEE Trans. Circuits Syst. Video Technol..

[11]  Cordelia Schmid,et al.  Compact Video Description for Copy Detection with Precise Temporal Alignment , 2010, ECCV.