Adapting Multimedia Internet Content for Universal Access

Content delivery over the Internet needs to address both the multimedia nature of the content and the capabilities of the diverse client platforms the content is being delivered to. We present a system that adapts multimedia Web documents to optimally match the capabilities of the client device requesting it. This system has two key components. 1) A representation scheme called the InfoPyramid that provides a multimodal, multiresolution representation hierarchy for multimedia. 2) A customizer that selects the best content representation to meet the client capabilities while delivering the most value. We model the selection process as a resource allocation problem in a generalized rate distortion framework. In this framework, we address the issue of both multiple media types in a Web document and multiple resource types at the client. We extend this framework to allow prioritization on the content items in a Web document. We illustrate our content adaptation technique with a web server that adapts multimedia news stories to clients as diverse as workstations, PDA's and cellular phones.

[1]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[2]  T. V. Lakshman,et al.  VBR video: tradeoffs and potentials , 1998, Proc. IEEE.

[3]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[4]  Antonio Ortega.  Optimization techniques for adaptive quantization of image and video under delay constraints , 1994 .

[5]  Steven McCanne,et al.  An application level video gateway , 1995, MULTIMEDIA '95.

[6]  John R. Smith,et al.  Content-based transcoding of images in the Internet , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  John R. Smith,et al.  Multimedia content customization for universal access , 1998, Other Conferences.

[8]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[9]  Bill N. Schilit,et al.  Digestor: Device-Independent Access to the World Wide Web , 1997, Comput. Networks.

[10]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[11]  Aggelos K. Katsaggelos,et al.  Rate-Distortion Based Video Compression , 1997, Springer US.

[12]  Eric A. Brewer,et al.  Adapting to network and client variability via on-demand dynamic distillation , 1996, ASPLOS VII.

[13]  S. Gribble,et al.  Adapting to Network and Client Variation Using Active Proxies : Lessons and PerspectivesArmando , 1998 .

[14]  Eric A. Brewer,et al.  Reducing WWW Latency and Bandwidth Requirements by Real-Time Distillation , 1996, Comput. Networks.

[15]  John R. Smith,et al.  Multimedia content description in the InfoPyramid , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  Gregg C. Vanderheiden.  Anywhere, Anytime (+ Anyone) Access to the Next-Generation WWW , 1997, Comput. Networks.

[17]  M. Dertouzos.  THE FUTURE OF COMPUTING , 1999 .

[18]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[19]  Eric A. Brewer,et al.  Adapting to network and client variation using infrastructural proxies: lessons and perspectives , 1998, IEEE Wirel. Commun..

[20]  Sansanee Auephanwiriyakul,et al.  An active transcoding proxy to support mobile web access , 1998, Proceedings Seventeenth IEEE Symposium on Reliable Distributed Systems (Cat. No.98CB36281).

[21]  G. R. Walsh,et al.  Methods Of Optimization , 1976 .

[22]  John R. Smith,et al.  Detecting image purpose in World Wide Web documents , 1998, Electronic Imaging.

[23]  K. Ramchandran,et al.  From Rate-distortion Theory To Commercial Image and Video Compression Technology , 1998, IEEE Signal Processing Magazine.

[24]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[25]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[26]  Rakesh Mohan,et al.  Text-based search of TV news stories , 1996, Other Conferences.

[27]  John R. Smith,et al.  Transcoding Internet content for heterogeneous client devices , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).