Quality of experience study for multiple sensorial media delivery

Traditional video sequences make use of both visual images and audio tracks which are perceived by human eyes and ears, respectively. In order to present better ultra-reality virtual experience, the comprehensive human sensations (e.g. olfaction, haptic, gustatory, etc) needed to be exploited. In this paper, a multiple sensorial media (mulsemedia) delivery system is introduced to deliver multimedia sequences integrated with multiple media components which engage three or more of human senses such as sight, hearing, olfaction, haptic, gustatory, etc. Three sensorial effects (i.e. haptic, olfaction, and air-flowing) are selected for the purpose of demonstration. Subjective test is conducted to analyze the user perceived quality of experience of the mulsemedia service. It is concluded that the mulsemedia sequences can partly mask the decreased movie quality. Additionally the most preferable sensorial effect is haptic, followed by air-flowing and olfaction.

[1]  Stephen R. Gulliver,et al.  Multiple Sensorial Media Advances and Applications: New Developments in MulSeMedia , 2011 .

[2]  Paul Richard,et al.  Multi-modal virtual environments for education with haptic and olfactory feedback , 2006, Virtual Reality.

[3]  Gabriel-Miro Muntean,et al.  iPAS: An user perceived quality-based intelligent Prioritized Adaptive Scheme for IPTV in Wireless Home Networks , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[4]  Sethuraman Panchanathan,et al.  Modeling context in haptic perception, rendering, and visualization , 2006, TOMCCAP.

[5]  Gabriel-Miro Muntean,et al.  Resource Efficient Quality-Oriented Wireless Broadcasting of Adaptive Multimedia Content , 2007, IEEE Transactions on Broadcasting.

[6]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[7]  Joseph Kaye,et al.  Making Scents: aromatic output for HCI , 2004, INTR.

[8]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[9]  Gabriel-Miro Muntean,et al.  A Prioritized Adaptive Scheme for Multimedia Services over IEEE 802.11 WLANs , 2013, IEEE Transactions on Network and Service Management.

[10]  Gerard Jounghyun Kim,et al.  Using a vibro-tactile display for enhanced collision perception and presence , 2004, VRST '04.

[11]  Ton Kalker,et al.  The Road to Immersive Communication , 2012, Proceedings of the IEEE.