Modeling User Quality of Experience of Olfaction-Enhanced Multimedia

Research on modelling user quality of experience (QoE) to date has primarily focused the combination of traditional media components; audio and video, or the individual influence of each. However, multisensory experiences have recently gained significant traction in the research community as a novel method to enhance QoE beyond what is possible with traditional media. This paper presents a model developed based on empirical data. It estimates user QoE of olfaction-enhanced multimedia. A set of 12 olfaction enhanced video clips were viewed by 84 assessors. A strong age and gender balance produced 6048 user ratings across six questions. Employing this dataset, the proposed model considers the influence of: system factors, user factors and content factors on user perceived QoE. The model is instantiated and validated. The analysis indicates that: content factors have a 10% influence on user QoE; age factors have an 11% influence; and gender factors have an 8% influence on user QoE. Also, content factors had the highest number of statistically significant influences across all of the factors evaluated. These results suggest that human, and content in addition to system factors play a key role in perceptual multimedia quality of olfaction enhanced multimedia. Further work is required to understand the remaining factors as well as the relationship between the media components has on QoE.

[1]  Gabriel-Miro Muntean,et al.  A Tutorial for Olfaction-Based Multisensorial Media Application Design and Evaluation , 2017, ACM Comput. Surv..

[2]  Gabriel-Miro Muntean,et al.  Multiple-Scent Enhanced Multimedia Synchronization , 2014, TOMM.

[3]  Gabriel-Miro Muntean,et al.  Age and gender influence on perceived olfactory & visual media synchronization , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Fernando Pereira.  A Triple User Characterization Model for Video Adaptation and Quality of Experience Evaluatio , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[5]  George Ghinea,et al.  The sweet smell of success: Enhancing multimedia applications with olfaction , 2012, TOMCCAP.

[6]  Weisi Lin,et al.  Modelling Human Factors in Perceptual Multimedia Quality: On The Role of Personality and Culture , 2015, ACM Multimedia.

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  Gabriel-Miro Muntean,et al.  Audio Masking Effect on Inter-Component Skews in Olfaction-Enhanced Multimedia Presentations , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[9]  Yi Zhu,et al.  Towards a comprehensive model for predicting the quality of individual visual experience , 2015, Electronic Imaging.

[10]  George Ghinea,et al.  Synchronization of Olfaction-Enhanced Multimedia , 2009, IEEE Transactions on Multimedia.

[11]  Gabriel-Miro Muntean,et al.  The influence of human factors on olfaction based mulsemedia quality of experience , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  Gabriel-Miro Muntean,et al.  User-profile-based perceived olfactory and visual media synchronization , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[13]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[14]  Manuela Pereira,et al.  Factors Influencing Quality of Experience , 2014, Quality of Experience.

[15]  Antonio Liotta,et al.  QoE-aware QoS management , 2008, MoMM.

[16]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[17]  Chi Thanh Vi,et al.  Multisensory Experiences in HCI , 2017, IEEE MultiMedia.

[18]  Gabriel-Miro Muntean,et al.  A Prioritized Adaptive Scheme for Multimedia Services over IEEE 802.11 WLANs , 2013, IEEE Transactions on Network and Service Management.

[19]  Gabriel-Miro Muntean,et al.  Perceived Synchronization of Mulsemedia Services , 2015, IEEE Transactions on Multimedia.

[20]  Franz Zieris,et al.  Quality of Experience , 2020, Encyclopedia of Wireless Networks.

[21]  Andrej-Nikolai Spiess,et al.  An evaluation of R2 as an inadequate measure for nonlinear models in pharmacological and biochemical research: a Monte Carlo approach , 2010, BMC pharmacology.

[22]  Gabriel-Miro Muntean,et al.  Novel End-to-End Quality of Service Provisioning Algorithms for Multimedia Services in Virtualization-Based Future Internet , 2012, IEEE Transactions on Broadcasting.

[23]  Maurizio Murroni,et al.  A nonlinear quality of experience model for high dynamic spatio-temporal mulsemedia , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[24]  Gabriel-Miro Muntean,et al.  Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery , 2015, IEEE Transactions on Multimedia.

[25]  Renata Rybarova,et al.  Application of immersive technologies for education: State of the art , 2015, 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL).

[26]  Gabriel-Miro Muntean,et al.  Olfactory-enhanced multimedia video clips datasets , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[27]  Alexandre N. Tuch,et al.  Opportunities for odor: experiences with smell and implications for technology , 2014, CHI.

[28]  Andrzej Jajszczyk,et al.  QoX: What is it really? , 2011, IEEE Communications Magazine.

[29]  George Ghinea,et al.  Olfaction-enhanced multimedia: perspectives and challenges , 2011, Multimedia Tools and Applications.

[30]  Liam Murphy,et al.  Subjective assessment of the quality-oriented adaptive scheme , 2005, IEEE Transactions on Broadcasting.

[31]  Carlos Velasco,et al.  Digitizing the chemical senses: Possibilities & pitfalls , 2017, Int. J. Hum. Comput. Stud..

[32]  Touradj Ebrahimi.  Quality of multimedia experience: past, present and future , 2009, MM '09.

[33]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[34]  Liam Murphy,et al.  Objective and subjective evaluation of QOAS video streaming over broadband networks , 2005, IEEE Transactions on Network and Service Management.

[35]  George Ghinea,et al.  Perceived Synchronization of Olfactory Multimedia , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[36]  Maurice Chastrette,et al.  Olfaction, Taste, and Cognition: Classification of Odors and Structure–Odor Relationships , 2002 .

[37]  Gabriel-Miro Muntean,et al.  Age and gender influences on perceived olfactory and visual media synchronization. , 2013 .

[38]  Christian Timmerer,et al.  A Generic Utility Model Representing the Quality of Sensory Experience , 2014, TOMM.

[39]  Gabriel-Miro Muntean,et al.  Olfaction-Enhanced Multimedia , 2016, ACM Comput. Surv..

[40]  Weisi Lin,et al.  Mulsemedia: State of the Art, Perspectives, and Challenges , 2014, TOMM.

[41]  Gabriel-Miro Muntean,et al.  The Impact of Scent Type on Olfaction-Enhanced Multimedia Quality of Experience , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[42]  Weisi Lin,et al.  Do Personality and Culture Influence Perceived Video Quality and Enjoyment? , 2016, IEEE Transactions on Multimedia.

[43]  Gabriel-Miro Muntean,et al.  Resource Efficient Quality-Oriented Wireless Broadcasting of Adaptive Multimedia Content , 2007, IEEE Transactions on Broadcasting.

[44]  Gabriel-Miro Muntean,et al.  Efficient delivery of multimedia streams over broadband networks using QOAS , 2006, IEEE Transactions on Broadcasting.

[45]  Klara Nahrstedt,et al.  Towards the understanding of human perceptual quality in tele-immersive shared activity , 2012, MMSys '12.

[46]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[47]  Andrew Perkis,et al.  Quality of Alternate Reality Experience and Its QoE Influencing Factors , 2017, AltMM@MM.

[48]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[49]  Anatole Lécuyer,et al.  Toward Haptic Cinematography: Enhancing Movie Experience with Haptic Effects based on Cinematographic Camera Motions , 2014 .

[50]  Joseph Nathaniel Kaye,et al.  Symbolic olfactory display , 2001 .

[51]  Christian Timmerer,et al.  A utility model for sensory experience , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[52]  Gabriel-Miro Muntean,et al.  Subjective evaluation of olfactory and visual media synchronization , 2013, MMSys.

[53]  GHEORGHITA GHINEA,et al.  User perception of media content association in olfaction-enhanced multimedia , 2012, TOMCCAP.

[54]  Takuji Narumi,et al.  Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction , 2011, CHI.

[55]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[56]  Liam Murphy,et al.  A Comparison-Based Study of Quality-Oriented Video on Demand , 2007, IEEE Transactions on Broadcasting.

[57]  George Ghinea,et al.  Information recall task impact in olfaction-enhanced multimedia , 2013, TOMCCAP.

[58]  Ali Israr,et al.  Sensing the future of HCI , 2016, Interactions.

[59]  George Ghinea,et al.  Olfaction-enhanced multimedia: Bad for information recall? , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[60]  Greger Wikstrand.  Improving user comprehension and entertainment in wireless streaming media introducing cognitive quality of service , 2003 .

[61]  Christian Timmerer,et al.  Sensory Experience: Quality of Experience Beyond Audio-Visual , 2014, Quality of Experience.

[62]  Cristina Hava Muntean,et al.  VQAMap: A Novel Mechanism for Mapping Objective Video Quality Metrics to Subjective MOS Scale , 2016, IEEE Transactions on Broadcasting.