Utility-Based Video Adaptation for Universal Multimedia Access (UMA) and Content-Based Utility Function Prediction for Real-Time Video Transcoding

Many techniques exist for adapting videos to satisfy heterogeneous resource conditions or user preferences, whereas selection of the best adaptation operation among various choices usually is either ad hoc or inefficient. To provide a systematic solution, we present a conceptual framework based on utility function (UF), which models video entity, adaptation, resource, utility, and the relations among them. In order to support real-time video adaptation, we present a content-based statistical paradigm to facilitate the prediction of UF for real-time transcoding of live videos. Instead of modelling the UF through analytical models, as in the conventional rate-distortion framework, the proposed approach formulates the prediction as a classification and regression problem. Each video clip is classified into one of distinctive categories and then local regression is used to accurately predict the utility value. Our extensive experiment results based on MPEG-4 transcoding demonstrate that the proposed method achieves very promising performance - up to 89% accuracy in choosing the optimal transcoding operation (in both spatial and temporal dimensions) with the highest quality over a diverse range of target bit rates

[1]  Charilaos Christopoulos,et al.  Video transcoding for universal multimedia access , 2000, MULTIMEDIA '00.

[2]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[3]  Shih-Fu Chang Optimal Video Adaptation and Skimming Using a Utility-Based Framework , 2002 .

[4]  Mohammed Ghanbari,et al.  Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats , 2000, IEEE Trans. Multim..

[5]  Min Wu,et al.  Video transcoding by reducing spatial resolution , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[6]  Anthony Vetro,et al.  Rate-distortion optimized video coding considering frameskip , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Yong Wang,et al.  MPEG-4 Real Time FD-CD Transcoding , 2003 .

[8]  Yong Wang,et al.  Optimal adaptation decision-taking for terminal and network quality-of-service , 2005, IEEE Transactions on Multimedia.

[9]  Di Zhong,et al.  Segmentation, Index and Summarization of Digital Video Content , 2001 .

[10]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[11]  Yong Wang,et al.  Predicting optimal operation of MC-3DSBC multidimensional scalable video coding using subjective quality measurement , 2004, IS&T/SPIE Electronic Imaging.

[12]  John R. Smith,et al.  Adapting Multimedia Internet Content for Universal Access , 1999, IEEE Trans. Multim..

[13]  Alexandros Eleftheriadis,et al.  Dynamic rate shaping of compressed digital video , 2006, IEEE Transactions on Multimedia.

[14]  Yong Wang,et al.  Content-based utility function prediction for real-time MPEG-4 video transcoding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  Oliver Werner,et al.  Requantization for transcoding of MPEG-2 intraframes , 1999, IEEE Trans. Image Process..

[16]  Yong Wang,et al.  Content-adaptive utility-based video adaptation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[17]  Jae S. Lim,et al.  Optimal multidimensional bit-rate control for video communication , 2002, IEEE Trans. Image Process..

[18]  John W. Woods,et al.  Bidirectional MC-EZBC with lifting implementation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Yasuyuki Nakajima,et al.  Real-time Estimation of Subjective Utility Functions for MPEG-4 Video Objects , 1999 .

[20]  Bin Zhang Generalized K-Harmonic Means -- Boosting in Unsupervised Learning , 2000 .

[21]  T. Cover,et al.  Rate Distortion Theory , 2001 .

[22]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .