Motion information for video retrieval

In this paper, we propose the use of motion tracks to generate video features, which are applied to perform video retrieval. We simply use the location of the object's center-of-gravity and its velocity across consecutive video frames to from motion flows, which are then recorded and stored in a video database. In the video retrieval phase, we propose the use of n-gram matching strategy to execute the video retrieval task. The retrieval process can be triggered query-by-example. We identify corresponding query and index contents accurately in order to detect “similar” videos. Experiments are carried out on CMU database. An empirical comparison over the state-of-the-art dynamic programming techniques is encouraging and demonstrates the advantage and feasibility of the n-gram method.

[1]  Olivier Buisson,et al.  Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search , 2007, IEEE Transactions on Multimedia.

[2]  Zhu Li,et al.  Real-time human action recognition by luminance field trajectory analysis , 2008, ACM Multimedia.

[3]  Kyu-Won Lee,et al.  Video retrieval based on the object's motion trajectory , 2000, Visual Communications and Image Processing.

[4]  Justin Zobel,et al.  Detection of video sequences using compact signatures , 2006, TOIS.

[5]  Ajay Divakaran,et al.  MPEG-7 visual motion descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[6]  Narendra Ahuja,et al.  Motion based retrieval of dynamic objects in videos , 2004, MULTIMEDIA '04.

[7]  Atsuo Yoshitaka,et al.  V-QBE: video database retrieval by means of example motion of objects , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[8]  Xiao-Ping Zhang,et al.  Automatic identification of digital video based on shot-level sequence matching , 2005, MULTIMEDIA '05.

[9]  Patrick Pérez,et al.  Statistical motion-based video indexing and retrieval , 2000, RIAO.

[10]  Alberto Del Bimbo,et al.  Video Clip Matching Using MPEG-7 Descriptors and Edit Distance , 2006, CIVR.

[11]  Rangasami L. Kashyap,et al.  Models for motion-based video indexing and retrieval , 2000, IEEE Trans. Image Process..

[12]  Saadat M. Alhashmi,et al.  Automatic indexing and recognition of re-broadcasted video programs through visual and temporal features , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[13]  Arbee L. P. Chen,et al.  Retrieving video data via motion tracks of content symbols , 1997, CIKM '97.

[14]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..