Parametric model for video content analysis

In this paper, we propose a parametric model for the video content analysis. We use the autoregressive (AR) modeling to model the frame feature sequence over time and make the future analysis in the AR parametric space. Based on our parametric framework, applications of detecting shot boundaries in video sequences, extracting key frames and combined spatial-temporal features for shot classification are proposed. Experiments show that our new parametric framework can present the video content better than the traditional color histogram.

[1]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Ki Park,et al.  Key Frame Extraction Based on Shot Coverage and Distortion , 2005, PCM.

[3]  Dominique Barba,et al.  Grouping video shots into scenes based on 1D mosaic descriptors , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Bo Zhang,et al.  A unified shot boundary detection framework based on graph partition model , 2005, MULTIMEDIA '05.

[5]  Qi Tian,et al.  A unified framework for semantic shot classification in sports video , 2005, IEEE Trans. Multim..

[6]  Evangelos Pallis,et al.  Shot boundary detection without threshold parameters , 2006, J. Electronic Imaging.

[7]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[8]  Chong-Wah Ngo,et al.  Analysis of spatiotemporal slices for video content representation , 2000 .

[9]  Hanqing Lu,et al.  Replay detection in broadcasting sports video , 2004, Third International Conference on Image and Graphics (ICIG'04).

[10]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[11]  Giuseppe Caccia,et al.  Key frames extraction in athletic video , 2003, Visual Communications and Image Processing.

[12]  W. James MacLean.  Spatial Coherence for Visual Motion Analysis , 2006 .

[13]  Hui Fang,et al.  A fuzzy logic approach for detection of video shot boundaries , 2006, Pattern Recognit..

[14]  Hicham G. Elmongui,et al.  Spatio-temporal Histograms , 2005, SSTD.

[15]  Borko Furht,et al.  Video and Image Processing in Multimedia Systems , 1995 .

[16]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  John Adcock,et al.  FXPAL Experiments for TRECVID 2004 , 2004, TRECVID.

[18]  Yap-Peng Tan,et al.  An effective post-refinement method for shot boundary detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Patrick Gros,et al.  HMM based structuring of tennis videos using visual and audio cues , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[20]  B. Moor,et al.  Subspace angles and distances between ARMA models , 2000 .

[21]  Yoshinobu Tonomura,et al.  VideoMAP and VideoSpaceIcon: tools for anatomizing video content , 1993, INTERCHI.

[22]  Michael T. Orchard,et al.  Motion field modeling for video sequences , 1997, IEEE Trans. Image Process..

[23]  Thomas Kailath,et al.  Modern signal processing , 1985 .

[24]  Ioannis Pitas,et al.  Shot detection in video sequences using entropy based metrics , 2002, Proceedings. International Conference on Image Processing.

[25]  Wen Gao,et al.  Unsupervised sports video scene clustering and its applications to story units detection , 2005, Visual Communications and Image Processing.

[26]  Haibin Lu,et al.  Robust gradual scene change detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[27]  Mubarak Shah,et al.  Video scene segmentation using Markov chain Monte Carlo , 2006, IEEE Transactions on Multimedia.

[28]  Xu De,et al.  Efficient key-frame extraction using density-estimation-based nonparametric clustering , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[29]  Tsuhan Chen,et al.  Shot boundary detection using temporal statistics modeling , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Zheng Tan,et al.  A unified shot boundary detection method based on linear prediction with Bayesian cost functions , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..

[31]  Shiqiang Yang,et al.  An HMM-based framework for video semantic analysis , 2005, IEEE Trans. Circuits Syst. Video Technol..

[32]  Michael T. Orchard,et al.  Synthesizing processed video by filtering temporal relationships , 2002, IEEE Trans. Image Process..

[33]  Chong-Wah Ngo,et al.  Motion-Based Video Representation for Scene Change Detection , 2004, International Journal of Computer Vision.