Shot Detection and Motion Analysis for Automatic MPEG-7 Annotation of Sports Videos

In this paper we describe general algorithms that are devised for MPEG-7 automatic annotation of Formula 1 videos, and in particular for camera-car shots detection. We employed a shot detection algorithm suitable for cuts and linear transitions detection, which is able to precisely detect both the transition's center and length. Statistical features based on MPEG motion compensation vectors are then employed to provide motion characterization, using a subset of the motion types defined in MPEG-7, and shot type classification. Results on shot detection and classification are provided.

[1]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Nasser Kehtarnavaz,et al.  Real-Time Imaging VI , 2002 .

[3]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[4]  André Zaccarin,et al.  A system for reliable dissolve detection in videos , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Wei Xiong,et al.  Efficient Scene Change Detection and Camera Motion Annotation for Video Classification , 1998, Comput. Vis. Image Underst..

[6]  King Ngi Ngan,et al.  Long transition analysis for digital video sequences , 2001 .

[7]  Frank J. Seinstra,et al.  Object Recognition by a Robot Dog Connected to aWide-Area Grid System , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Alain Jacot-Descombes,et al.  Efficient Segmentation and Camera Motion Indexing of Compressed Video , 1999, Real Time Imaging.

[9]  Edoardo Ardizzone,et al.  Video indexing using MPEG motion compensation vectors , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  Alberto Del Bimbo,et al.  Ontologies enriched with visual information for video annotation , 2005 .

[11]  Alberto Del Bimbo,et al.  Video Annotation with Pictorially Enriched Ontologies , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[12]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[13]  J. Astola,et al.  Vector median filters , 1990, Proc. IEEE.

[14]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[15]  Marcel Worring,et al.  On the surplus value of semantic video analysis beyond the key frame , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[16]  Junji Maeda.  Method for extracting camera operations in order to describe subscenes in video sequences , 1994, Electronic Imaging.

[17]  Marcel Worring,et al.  User transparent parallel processing of the 2004 NIST TRECVID data set , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[18]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[19]  Rita Cucchiara,et al.  MPEG-7 compliant shot detection in sport videos , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[20]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[21]  Alberto Del Bimbo,et al.  Soccer Videos Highlight Prediction and Annotation in Real Time , 2005, ICIAP.

[22]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jesús Bescós,et al.  Real-time shot change detection over online MPEG-2 video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.