Object-based and event-based semantic video adaptation

Semantic video adaptation allows transmitting video content with different viewing quality, depending on the relevance of the content from the user's viewpoint. To this end, an automatic annotation subsystem must be employed that automatically detect relevant objects and events in the video stream. We present a composite framework that is made of an automatic annotation engine and a semantics-based adaptation module. Three new different compression solutions are proposed that work at the object or event level. Their performance is compared according to a new measure that takes into account the user's satisfaction and the effects on it of the errors in the annotation module.

[1]  C. Colombo,et al.  Automatic , 2013, Definitions.

[2]  Yong Wang,et al.  Content-based utility function prediction for real-time MPEG-4 video transcoding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Shih-Fu Chang,et al.  Content-based video summarization and adaptation for ubiquitous media access , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[4]  Yong Wang,et al.  Content-adaptive utility-based video adaptation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[5]  Kazuhiko Sumi,et al.  Object-based coding for long-term archive of surveillance video , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Surya Nepal,et al.  Automatic detection of 'Goal' segments in basketball videos , 2001, MULTIMEDIA '01.

[7]  C.-C. Jay Kuo,et al.  Rule-based video classification system for basketball video indexing , 2000, MULTIMEDIA '00.

[8]  Mohammed Ghanbari,et al.  Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats , 2000, IEEE Trans. Multim..

[9]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[10]  John R. Smith,et al.  Adapting Multimedia Internet Content for Universal Access , 1999, IEEE Trans. Multim..

[11]  John R. Smith,et al.  Using MPEG-7 and MPEG-21 for personalizing video , 2004, IEEE MultiMedia.

[12]  Anthony Vetro,et al.  MPEG-21 digital item adaptation: enabling universal multimedia access , 2004, IEEE MultiMedia.

[13]  Chen-Hsiu Huang.  Video Transcoding Architectures and Techniques : An Overview , 2003 .

[14]  Rita Cucchiara,et al.  Semantic Video Transcoding Using Classes of Relevance , 2003, Int. J. Image Graph..

[15]  Rita Cucchiara,et al.  SEMANTIC ANNOTATION AND TRANSCODING FOR SPORT VIDEOS , 2003 .