Qualinet White Paper on Definitions of Quality of Experience

This White Paper is a contribution of the European Network on Quality of Experience in Multimedia Systems and Services, Qualinet (COST Action IC 1003, see www.qualinet.eu), to the scientific discussion about the term "Quality of Experience" (QoE) and its underlying concepts. It resulted from the need to agree on a working definition for this term which facilitates the communication of ideas within a multidisciplinary group, where a joint interest around multimedia communication systems exists, however approached from different perspectives. Thus, the concepts and ideas cited in this paper mainly refer to the Quality of Experience of multimedia communication systems, but may be helpful also for other areas where QoE is an issue. The Network of Excellence (NoE) Qualinet aims at extending the notion of network-centric Quality of Service (QoS) in multimedia systems, by relying on the concept of Quality of Experience (QoE). The main scientific objective is the development of methodologies for subjective and objective quality metrics taking into account current and new trends in multimedia communication systems as witnessed by the appearance of new types of content and interactions. A substantial scientific impact on fragmented efforts carried out in this field will be achieved by coordinating the research of European experts under the catalytic COST umbrella. The White Paper has been compiled on the basis of a first open call for ideas which was launched for the February 2012 Qualinet Meeting held in Prague, Czech Republic. The ideas were presented as short statements during that meeting, reflecting the ideas of the persons listed under the headline "Contributors" in the previous section. During the Prague meeting, the ideas have been further discussed and consolidated in the form of a general structure of the present document. An open call for authors was issued at that meeting, to which the persons listed as "Authors" in the previous section have announced their willingness to contribute in the preparation of individual sections. For each section, a coordinating author has been assigned which coordinated the writing of that section, and which is underlined in the author list preceding each section. The individual sections were then integrated and aligned by an editing group (listed as "Editors" in the previous section), and the entire document was iterated with the entire group of authors. Furthermore, the draft text was discussed with the participants of the Dagstuhl Seminar 12181 "Quality of Experience: From User Perception to Instrumental Metrics" which was held in Schlos Dagstuhl, Germany, May 1-4 2012, and a number of changes were proposed, resulting in the present document. As a result of the writing process and the large number of contributors, authors and editors, the document will not reflect the opinion of each individual person at all points. Still, we hope that it is found to be useful for everybody working in the field of Quality of Experience of multimedia communication systems, and most probably also beyond that field.

[1]  Christian Timmerer,et al.  Challenges of QoE management for cloud applications , 2012, IEEE Communications Magazine.

[2]  Katrien De Moor,et al.  Content categorization based on implicit and explicit user feedback: Combining self-reports with EEG emotional state analysis , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[3]  Sebastian Mller,et al.  Quality of Telephone-Based Spoken Dialogue Systems , 2004 .

[4]  Satu Jumisko-Pyykkö,et al.  Descriptive quality of experience for mobile 3D video , 2010, NordiCHI.

[5]  Luc Martens,et al.  Linking an integrated framework with appropriate methods for measuring QoE , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[6]  John Zimmerman,et al.  Measuring the dynamics of remembered experience over time , 2010, Interact. Comput..

[7]  W. Voiers,et al.  Diagnostic acceptability measure for speech communication systems , 1977 .

[8]  Christian Timmerer,et al.  Assessing the quality of sensory experience for multimedia presentations , 2012, Signal Process. Image Commun..

[9]  J. M. Kittross The measurement of meaning , 1959 .

[10]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[11]  Göte Nyman,et al.  Experienced quality factors: qualitative evaluation approach to audiovisual quality , 2007, Electronic Imaging.

[12]  Peter Reichl,et al.  “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience , 2012, 2012 IEEE International Conference on Communications (ICC).

[13]  Christian Timmerer,et al.  Digital item adaptation: overview of standardization and research activities , 2005, IEEE Transactions on Multimedia.

[14]  Jari Korhonen,et al.  Subjective comparison of temporal and quality scalability , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[15]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[16]  Gerardo Rubino,et al.  Quality assessment of interactive voice applications , 2008 .

[17]  Kalevi Kilkki An Introduction to Communications Ecosystems , 2012 .

[18]  Marcel Wältermann Dimension-based Quality Modeling of Transmitted Speech , 2013 .

[19]  G. Lorho,et al.  Perceived quality evaluation : an application to sound reproduction over headphones , 2010 .

[20]  R. Mayer,et al.  Multimedia learning: Are we asking the right questions? , 1997 .

[21]  S. Möller,et al.  All Users Are (Not) Equal - The Influence of User Characteristics on Perceived Quality, Modality Choice and Performance , 2011, IWSDS.

[22]  Marcel Wältermann,et al.  Direct Quantification of Latent Speech Quality Dimensions , 2012 .

[23]  G. Stemmler Differentielle Psychologie und Persönlichkeitsforschung , 2007 .

[24]  Ulrich Reiter,et al.  Profiling experienced quality factors of audiovisual 3D perception , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[25]  G. Pinchot,et al.  The Psychology of Personality , 1954, Nature.

[26]  Noel Crespi Toward Total Quality of Experience : A QoE Model in a Communication Ecosystem , .

[27]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[28]  Ute Jekosch,et al.  Voice and Speech Quality Perception: Assessment and Evaluation , 2005 .

[29]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[30]  Schuyler Quackenbush,et al.  Objective measures of speech quality , 1995 .

[31]  Martín Varela,et al.  QOE-driven mobility management — Integrating the users' quality perception into network — Level decision making , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[32]  Dominik Strohmeier Open profiling of quality: a mixed methods research approach for audiovisual quality evaluations , 2012, ACMMR.

[33]  H. Abdi Partial least squares regression and projection on latent structure regression (PLS Regression) , 2010 .

[34]  Gaetan Lorho,et al.  Individual Vocabulary Profiling of Spatial Enhancement Systems for Stereo Headphone Reproduction , 2005 .

[35]  Oliver Hohlfeld,et al.  Impact of frame rate and resolution on objective QoE metrics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[36]  Sebastian Möller,et al.  From Single-Call to Multi-Call Quality: A Study on Long-Term Quality Integration in Audio-Visual Speech Communication , 2011, INTERSPEECH.

[37]  Sebastian Möller,et al.  A new dimension-based framework model for the quality of speech communication services , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[38]  Kees Teunissen,et al.  Rapid perceptual image description (RaPID) method , 1996, Electronic Imaging.

[39]  Emil Volek,et al.  Handbuch der Semiotik , 1987 .

[40]  Sandra Hirche,et al.  Haptic Communications , 2012, Proceedings of the IEEE.

[41]  Klara Nahrstedt,et al.  Resource Management in Networked Multimedia Systems , 1995, Computer.

[42]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[43]  L. A. Pervin Handbook of Personality: Theory and Research , 1992 .

[44]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[45]  Satu Jumisko-Pyykkö,et al.  Framing the Context of Use for Mobile HCI , 2010, Int. J. Mob. Hum. Comput. Interact..

[46]  Sebastian Möller,et al.  Quality Engineering - Qualität kommunikationstechnischer Systeme , 2010 .

[47]  Alexander Raake,et al.  Speech Quality of VoIP - Assessment and Prediction , 2006 .

[48]  Virpi Roto,et al.  Demarcating User Experience Dagstuhl Seminar , 2011 .