Event on demand with MPEG-21 video adaptation system

In this paper, we present an event-on-demand (EoD)video adaptation system. The proposed system supports users in deciding their events of interest and considers network conditions to adapt video source by event selection and frame dropping.Firstly, events are detected by audio/video analysis and annotated by the description schemes (DSs)provided by MPEG-7 Multimedia Description Schemes (MDSs). And then, to achieve a generic adaptation solution, the adaptation is developed following MPEG-21 Digital Item Adaptation (DIA)framework. We look at early release of the MPEG-21 Reference Software on XML generation and develop our own system for EoD video adaptation in three steps:1) the event information is parsed from MPEG-7 annotation XML file together with bitstream to generate generic Bitstream Syntax Description (gBSD). 2) Users' preference, Network Characteristic and Adaptation QoS (AQoS) are considered for making adaptation decision. 3) adaptation engine automatically parses adaptation decisions and gBSD to achieve adaptation.Unlike most existing adaptation work, the system adapts video of events with interest according to users' preference. Implementation following MPEG-7 and MPEG-21 standards provides a generic video adaptation solution. gBSD based adaptation avoids complex video computation. 30 students from various departments were invited to test the system and their responses has been positive.

[1]  Jan Gecsei,et al.  Adaptation in Distributed Multimedia Systems , 1997, IEEE Multim..

[2]  Jaakko J. Sauvola,et al.  A Content Model for the Mobile Adaptation of Multimedia Information , 2001, J. VLSI Signal Process..

[3]  Steven McCanne,et al.  An active service framework and its application to real-time multimedia transcoding , 1998, SIGCOMM '98.

[4]  E. Manning,et al.  The Utility Model for Adaptive Multimedia Systems , 1997 .

[5]  Ofer Hadar,et al.  Optimal transrating via DCT coefficients modification and dropping , 2005, ITRE 2005. 3rd International Conference on Information Technology: Research and Education, 2005..

[6]  M. Hicks,et al.  User-specified adaptive scheduling in a streaming media network , 2003, 2003 IEEE Conference onOpen Architectures and Network Programming..

[7]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[8]  Shih-Fu Chang,et al.  Real-time content-based adaptive streaming of sports videos , 2001, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001).

[9]  Jong-Wook Baek,et al.  Management of service level agreements for multimedia Internet service using a utility model , 2001, IEEE Commun. Mag..

[10]  Henning Schulzrinne,et al.  An integrated resource negotiation, pricing, and QoS adaptation framework for multimedia applications , 2000, IEEE Journal on Selected Areas in Communications.

[11]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[12]  Mahmoud Naghshineh,et al.  End-to-end QoS provisioning in multimedia wireless/mobile networks using an adaptive framework , 1997, IEEE Commun. Mag..

[13]  Christian Timmerer,et al.  Bitstream syntax description: a tool for multimedia resource adaptation within MPEG-21 , 2003, Signal Process. Image Commun..

[14]  Richard Han,et al.  Dynamic adaptation in an image transcoding proxy for mobile Web browsing , 1998, IEEE Wirel. Commun..

[15]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[16]  Min Xu,et al.  Multimodal Semantic Analysis and Annotation for Basketball Video , 2006, EURASIP J. Adv. Signal Process..

[17]  Jon Crowcroft,et al.  Quality-of-Service Routing for Supporting Multimedia Applications , 1996, IEEE J. Sel. Areas Commun..

[18]  Ming-Ting Sun,et al.  Digital Video Transcoding , 2005, Proceedings of the IEEE.

[19]  Yong Wang,et al.  Content-adaptive utility-based video adaptation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[20]  Yui-Lam Chan,et al.  New architecture for dynamic frame-skipping transcoder , 2002, IEEE Trans. Image Process..

[21]  Domenico Cotroneo,et al.  A user-driven adaptation strategy for mobile video streaming applications , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[22]  Edward J. Delp,et al.  Wavelet based rate scalable video compression , 1999, IEEE Trans. Circuits Syst. Video Technol..

[23]  Douglas L. Jones,et al.  Design and evaluation of a cross-layer adaptation framework for mobile multimedia systems , 2003, IS&T/SPIE Electronic Imaging.