Content-Driven Adaptation of On-Line Video

This work presents an on-line approach to the selection of a variable number of frames from a compressed video sequence, just attending to selection rules applied over domain independent semantic features. The localization of these semantic features helps to infer the non homogeneous distribution of semantically relevant information, which allows to reduce the amount of adapted data while maintaining the meaningful information. The extraction of the required features is performed on-line, as demanded for many leading applications. This is achieved via techniques that operate on the compressed domain, which have been adapted to operate on-line. A subjective evaluation of online frame selection validates our results.

[1]  Guoliang Fan,et al.  Key-frame extraction for object-based video segmentation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimal video summary generation , 2005, IEEE Transactions on Image Processing.

[3]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[4]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 2004, Multimedia Tools and Applications.

[5]  Edward J. Delp,et al.  Wavelet based rate scalable video compression , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  Touradj Ebrahimi,et al.  Semantic video analysis for adaptive content delivery and automatic description , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[8]  Qingming Huang,et al.  Subjective evaluation criterion for selecting affective features and modeling highlights , 2006, Electronic Imaging.

[9]  Stefanos D. Kollias,et al.  A stochastic framework for optimal key frame extraction from MPEG video databases , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[10]  Jesús Bescós,et al.  Camera Motion Analysis in On-line MPEG Sequences , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[11]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[12]  Ajay Divakaran,et al.  Framework for measurement of the intensity of motion activity of video segments , 2004, J. Vis. Commun. Image Represent..

[13]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Daniel DeMenthon,et al.  Automatic Performance Evaluation for Video Summarization , 2004 .

[15]  Koichiro Honda,et al.  Automatic video summarization by using color and utterance information , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[16]  Anthony Vetro,et al.  Object-based transcoding for adaptable video content delivery , 2001, IEEE Trans. Circuits Syst. Video Technol..

[17]  Michael G. Christel Evaluation and user studies with respect to video summarization and browsing , 2006, Electronic Imaging.

[18]  Anil K. Jain,et al.  Automatic Caption Localization in Compressed Video , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Cuneyt M. Taskiran Evaluation of automatic video summarization systems , 2006, Electronic Imaging.

[20]  Baoxin Li,et al.  Event detection and summarization in American football broadcast video , 2001, IS&T/SPIE Electronic Imaging.

[21]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[22]  Edward J. Delp,et al.  Automated video summarization using speech transcripts , 2001, IS&T/SPIE Electronic Imaging.

[23]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Shih-Fu Chang,et al.  Survey of compressed-domain features used in audio-visual indexing and analysis , 2003, J. Vis. Commun. Image Represent..

[25]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[26]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[27]  Jenq-Neng Hwang,et al.  An integrated scheme for object-based video abstraction , 2000, ACM Multimedia.

[28]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[29]  Anthony G. Constantinides,et al.  Variable size block matching motion compensation with applications to video coding , 1990 .

[30]  Marta Mrak,et al.  A SCALABLE CODING FRAMEWORK FOR EFFICIENT VIDEO ADAPTATION , 2005 .

[31]  Christian Timmerer,et al.  Bitstream syntax description-based adaptation in streaming and constrained environments , 2005, IEEE Transactions on Multimedia.

[32]  SangKeun Lee,et al.  A fast clustering algorithm for video abstraction , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[33]  Janko Calic,et al.  Efficient key-frame extraction and video analysis , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[34]  Monson H. Hayes,et al.  A compressed domain video object segmentation system , 2002, Proceedings. International Conference on Image Processing.

[35]  Ajay Divakaran,et al.  Constant pace skimming and temporal sub-sampling of video using motion activity , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[36]  Jesús Bescós,et al.  Real-time shot change detection over online MPEG-2 video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Ajay Divakaran,et al.  Subjective assessment of consumer video summarization , 2006, Electronic Imaging.

[38]  Anthony Vetro,et al.  Video transcoding architectures and techniques: an overview , 2003, IEEE Signal Process. Mag..

[39]  Marco Ceccarelli,et al.  Visual search in a SMASH system , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[40]  Jens-Rainer Ohm,et al.  Advances in Scalable Video Coding , 2005, Proceedings of the IEEE.