Identification of video subsequence using bipartite graph matching

Subsequence identification consists of identifying real positions of a specific video clip in a video stream together with the operations that may be used to transform the former into a subsequence from the latter. To cope with this problem, we propose a new approach, considering a bipartite graph matching to measure video clip similarity with a target video stream which has not been preprocessed.The main contributions of our work are the application of a simple and efficient distance to solve the subsequence identification problem along with the definition of a hit function that identifies precisely which operations were used in query transformation. Experimental results demonstrate that our method performances achieve 90% recall with 93% precision, though it is done without preprocessing of the target video.

[1]  Tat-Seng Chua,et al.  Retrieval of News Video Using Video Sequence Matching , 2005, 11th International Multimedia Modelling Conference.

[2]  Wolfgang Effelsberg,et al.  VisualGREP: a systematic method to compare and retrieve video sequences , 1997, Electronic Imaging.

[3]  R. Nigel Horspool,et al.  Practical fast searching in strings , 1980, Softw. Pract. Exp..

[4]  John R. Smith,et al.  Using MPEG-7 and MPEG-21 for personalizing video , 2004, IEEE MultiMedia.

[5]  Joachim M. Buhmann,et al.  Empirical Evaluation of Dissimilarity Measures for Color and Texture , 2001, Comput. Vis. Image Underst..

[6]  Patrick Gros,et al.  A fast shot matching strategy for detecting duplicate sequences in a television stream , 2005, CVDB '05.

[7]  Wei Xiong,et al.  Query by video clip , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Olivier Buisson,et al.  Content-based video copy detection in large databases: a local fingerprints statistical similarity search approach , 2005, IEEE International Conference on Image Processing 2005.

[9]  John M. Gauch,et al.  Identification of new commercials using repeated video sequence detection , 2005, IEEE International Conference on Image Processing 2005.

[10]  Yao Zhao,et al.  Frame Fusion for Video Copy Detection , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  José San Pedro,et al.  Video Retrieval Using an EDL-Based Timeline , 2005, IbPRIA.

[12]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[13]  Yuxin Peng,et al.  Clip-based similarity measure for query-dependent clip retrieval and video summarization , 2006, IEEE Trans. Circuits Syst. Video Technol..

[14]  Donald A. Adjeroh,et al.  A Distance Measure for Video Sequences , 1999, Comput. Vis. Image Underst..

[15]  Silvio Jamil Ferzoli Guimarães,et al.  Counting of Video Clip Repetitions using a Modified BMH Algorithm: Preliminary Results , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[16]  Gonzalo Navarro,et al.  A guided tour to approximate string matching , 2001, CSUR.

[17]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[18]  Tat-Seng Chua,et al.  A match and tiling approach to content-based video retrieval , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[19]  Silvio Jamil Ferzoli Guimarães,et al.  Bipartite graph matching for video clip localization , 2007 .

[20]  Stephan Volmer,et al.  Temporally Tolerant Video Matching , 2003 .

[21]  Li Deng,et al.  A video retrieval algorithm based on ensemble similarity , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[22]  Wolfgang Effelsberg,et al.  VisualGREP: A Systematic Method to Compare and Retrieve Video Sequences , 2004, Multimedia Tools and Applications.

[23]  John M. Gauch,et al.  Finding and identifying unknown commercials using repeated video sequence detection , 2006, Comput. Vis. Image Underst..

[24]  Zi Huang,et al.  Practical Online Near-Duplicate Subsequence Detection for Continuous Video Streams , 2010, IEEE Transactions on Multimedia.

[25]  S. Guimarães,et al.  Identification and analysis of video subsequence using bipartite graph matching , 2010 .

[26]  Zi Huang,et al.  Effective and Efficient Query Processing for Video Subsequence Identification , 2009, IEEE Transactions on Knowledge and Data Engineering.

[27]  Sanjeev R. Kulkarni,et al.  A framework for measuring video similarity and its application to video query by example , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[28]  Hsin-Min Wang,et al.  Time-Series Linear Search for Video Copies Based on Compact Signature Manipulation and Containment Relation Modeling , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[30]  Hermann Ney,et al.  Features for Image Retrieval: A Quantitative Comparison , 2004, DAGM-Symposium.