Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System

This article proposes the integration of multisensorial stimuli and multimodal interaction components into a sports multimedia asset under two dimensions: immersion and interaction. The first dimension comprises a binaural audio system and a set of sensory effects synchronized with the audiovisual content, whereas the second explores interaction through the insertion of interactive 3D objects into the main screen and on-demand presentation of additional information in a second touchscreen. We present an end-to-end solution integrating these components into a hybrid (internet-broadcast) television system using current 3DTV standards. Results from an experimental study analyzing the perceived quality of these stimuli and their influence on the Quality of Experience are presented.

[1]  P. Vorderer,et al.  Media entertainment: The psychology of its appeal. , 2000 .

[2]  Dan R. Olsen,et al.  Interactive television news , 2012, TOMCCAP.

[3]  Maximo Cobos,et al.  Parametric head-related transfer function modeling and interpolation for cost-efficient binaural sound applications. , 2013, The Journal of the Acoustical Society of America.

[4]  BajcsyRuzena,et al.  Enabling multi-party 3D tele-immersive environments with ViewCast , 2010 .

[5]  YoonKyoungro.  End-to-end framework for 4-D broadcasting based on MPEG-V standard , 2013 .

[6]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[7]  Gabriel-Miro Muntean,et al.  Subjective evaluation of olfactory and visual media synchronization , 2013, MMSys.

[8]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.

[9]  Iris Galloso Guitard,et al.  Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System , 2014 .

[10]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[11]  Kyoungro Yoon,et al.  End-to-end framework for 4-D broadcasting based on MPEG-V standard , 2013, Signal Process. Image Commun..

[12]  Eric Psota,et al.  Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[14]  Christian Timmerer,et al.  Assessing the quality of sensory experience for multimedia presentations , 2012, Signal Process. Image Commun..

[15]  George Ghinea,et al.  The sweet smell of success: Enhancing multimedia applications with olfaction , 2012, TOMCCAP.

[16]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[17]  Boris E. R. de Ruyter,et al.  Ambient intelligence: visualizing the future , 2004, AVI.

[18]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Marina Krcmar,et al.  Conceptualizing Media Enjoyment as Attitude: Implications for Mass Media Effects Research , 2004 .

[20]  Maximo Cobos,et al.  Subjective quality assessment of multichannel audio accompanied with video in representative broadcasting genres , 2015, Multimedia Systems.

[21]  Christian Timmerer,et al.  Increasing the user experience of multimedia presentations with sensory effects , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[22]  David Garrido Garrido,et al.  Foundations of a New Interaction Paradigm for Immersive 3D Multimedia , 2012 .

[23]  Martijn J. Schuemie,et al.  Research on Presence in Virtual Reality: A Survey , 2001, Cyberpsychology Behav. Soc. Netw..

[24]  Christian Timmerer,et al.  An end-to-end tool chain for Sensory Experience based on MPEG-V , 2013, Signal Process. Image Commun..

[25]  Michael D. Slater,et al.  Alienation, Aggression, and Sensation Seeking as Predictors of Adolescent Use of Violent Film, Computer, and Website Content , 2003 .

[26]  W. Hoogenstraaten,et al.  Immersive TV viewing with advanced Ambilight , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[27]  Abdulmotaleb El-Saddik,et al.  Touchable 3D video system , 2009, TOMCCAP.

[28]  Christian Timmerer,et al.  A test-bed for quality of multimedia experience evaluation of Sensory Effects , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[29]  Gerhard Goos,et al.  Ambient Intelligence , 2015, Lecture Notes in Computer Science.

[30]  C. Bracken,et al.  Telepresence and Attention : Secondary Task Reaction Time and Media Form , 2012 .

[31]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[32]  Jennings Bryant,et al.  Moral Judgment and Crime Drama: An Integrated Theory of Enjoyment , 2002 .

[33]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[34]  S. Möller,et al.  All Users Are (Not) Equal - The Influence of User Characteristics on Perceived Quality, Modality Choice and Performance , 2011, IWSDS.