TeleMorph: A Fuzzy Logic Approach to Network-Aware Transmoding in Mobile Intelligent Multimedia Presentation Systems

Mobile intelligent multimedia presentation systems are limited by various constraints including mobile network characteristics, mobile device capabilities, and user preferences. Those presentation systems which incorporate remotely stored multimedia rely on the bandwidth which is available during actual content transmission on the connecting mobile network. One approach to deal with this is to transcode content, thus reducing its data rate requirement, although this technique is inherently limited by the lowest acceptable quality of that media element. Alternatively, content can be transmoded to different modalities with lower bandwidth requirements. TeleMorph, a cross-modality adaptation control platform is detailed in this paper. The main premise of TeleMorph is that cross-modality adaptation decisions in mobile presentation systems must occur with primary consideration for bandwidth fluctuations. TeleMorph has been implemented as a network-aware fuzzy inference system that controls cross-modality adaptations between multimodal audio-video, audio-images, and images-text presentations, as well as unimodal audio and text presentations. Initially, a brief introduction to Intelligent Multimedia and Mobile Intelligent Multimedia is given, and related systems discussed. TeleTuras, a tourist information application implemented as a testbed for TeleMorph, is utilized for objective and subjective evaluations through its integration of six disparate test scenarios that incorporate various media types and qualities. Positive results for each evaluation technique, based on specific metrics, are also presented. In addition, future work on TeleMorph is also detailed.

[1]  Eric A. Brewer,et al.  Reducing WWW Latency and Bandwidth Requirements by Real-Time Distillation , 1996, Comput. Networks.

[2]  Susanne Boll,et al.  ZYX-A Multimedia Document Model for Reuse and Adaptation of Multimedia Content , 2001, IEEE Trans. Knowl. Data Eng..

[3]  Morris Sloman,et al.  A survey of quality of service in mobile computing environments , 1999, IEEE Communications Surveys & Tutorials.

[4]  Eric A. Brewer,et al.  Adapting to network and client variation using infrastructural proxies: lessons and perspectives , 1998, IEEE Wirel. Commun..

[5]  Susanne Boll,et al.  A cross-media adaptation strategy for multimedia presentations , 1999, MULTIMEDIA '99.

[6]  Katerina Pastra Beyond Multimedia Integration: corpora and annotations for cross-media decision mechanisms , 2006, LREC.

[7]  Wolfgang Klas,et al.  Cardio-OP: Gallery of Cardiac Surgery , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems , 2006, SmartKom.

[9]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[10]  Wolfgang Wahlster,et al.  Dialogue Systems Go Multimodal: The SmartKom Experience , 2006, SmartKom.

[11]  Morris Sloman,et al.  QoS and Context Awareness for Mobile Computing , 1999, HUC.

[12]  Yong Man Ro,et al.  Modality conversion for QoS management in universal multimedia access , 2005 .

[13]  Yong Man Ro,et al.  Modality Conversion in Content Adaptation for Universal Multimedia Access , 2003, CISST.

[14]  Yong Man Ro,et al.  Effective adaptation of multimedia documents with modality conversion , 2005, Signal Process. Image Commun..

[15]  Eric A. Brewer,et al.  Adapting to network and client variability via on-demand dynamic distillation , 1996, ASPLOS VII.

[16]  K. Holyoak Mental representations. , 1982, Science.

[17]  Alexander Zipf,et al.  Developing Location Based Services for Tourism. The Service Providers' View , 2001, ENTER.

[18]  Kevin Curran,et al.  Bandwidth determined transmoding through fuzzy logic in mobile intelligent multimedia presentation systems , 2006, Artificial Intelligence Review.

[19]  Axel Hildebrand,et al.  EMBASSI: Electronic multimedia and service assistance , 2000 .

[20]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[21]  Stefan Wirag Scheduling of adaptive multimedia documents , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[22]  Rainer Malaka,et al.  Device-dependant modality selection for user-interfaces: an empirical study , 2002, IUI '02.

[23]  김대영,et al.  Universal Multimedia Access , 2008, Encyclopedia of Multimedia.

[24]  Rainer Malaka,et al.  Multi-modal Interaction in Private Environments , 2001 .

[25]  A. Baddeley,et al.  Working Memory: The multiple-component model , 1999 .

[26]  Kevin Curran,et al.  Transcoding media for bandwidth constrained mobile devices , 2005, Int. J. Netw. Manag..