Assessing the quality of sensory experience for multimedia presentations

This paper introduces the concept of sensory experience by utilizing sensory effects such as wind or lighting as another dimension which contributes to the quality of the user experience. In particular, we utilize a representation format for sensory effects that are attached to traditional multimedia resources such as audio, video, and image contents. Sensory effects (e.g., wind, lighting, explosion, heat, cold) are rendered on special devices (e.g., fans, ambient lights, motion chair, air condition) in synchronization with the traditional multimedia resources and shall stimulate other senses than audition and vision (e.g., mechanoreception, equilibrioception, thermoreception), with the intention to increase the users Quality of Experience (QoE). In particular, the paper provides a comprehensive introduction into the concept of sensory experience, its assessment in terms of the QoE, and related standardization and implementation efforts. Finally, we will highlight open issues and research challenges including future work.

[1]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[2]  George Ghinea,et al.  Synchronization of Olfaction-Enhanced Multimedia , 2009, IEEE Transactions on Multimedia.

[3]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[4]  Boris E. R. de Ruyter,et al.  New research perspectives on Ambient Intelligence , 2009, J. Ambient Intell. Smart Environ..

[5]  Kyoungro Yoon,et al.  4-D broadcasting with MPEG-V , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[6]  Boris E. R. de Ruyter,et al.  Ambient intelligence: visualizing the future , 2004, AVI.

[7]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[8]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[9]  Christian Timmerer,et al.  Increasing the user experience of multimedia presentations with sensory effects , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[10]  Christian Timmerer,et al.  Improving the Quality of multimedia Experience through sensory effects , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[11]  Christian Timmerer,et al.  A test-bed for quality of multimedia experience evaluation of Sensory Effects , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[12]  Markus Fiedler,et al.  Testing the IQX Hypothesis for Exponential Interdependency between QoS and QoE of Voice Codecs iLBC and G.711 , 2008 .

[13]  Michael Zyda,et al.  Interactions in Perceived Quality of Auditory-Visual Displays , 2000, Presence: Teleoperators & Virtual Environments.

[14]  Fernando Pereira A Triple User Characterization Model for Video Adaptation and Quality of Experience Evaluatio , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[15]  Munchurl Kim,et al.  A Metadata Schema Design on Representation of Sensory Effect Information for Sensible Media and its Service Framework using UPnP , 2008, 2008 10th International Conference on Advanced Communication Technology.

[16]  Choi Bum Suk,et al.  Sensory Effect Metadata for SMMD Media Service , 2009, 2009 Fourth International Conference on Internet and Web Applications and Services.

[17]  Christian Timmerer,et al.  Sensory Experience for Videos on the Web , 2011, 2011 Workshop on Multimedia on the Web.

[18]  Angela Chang,et al.  Audio-haptic feedback in mobile phones , 2005, CHI Extended Abstracts.

[19]  Kwang-Seok Hong,et al.  Location awareness-based intelligent multi-agent technology , 2010, Multimedia Systems.