Combination of physiological and subjective measures to assess quality of experience for audiovisual technologies

The competitive context in which the number of new audiovisual services increases requires taking user preferences into account to maintain the best possible quality of experience. The aim of the experiment presented in this paper is to study how standardized ITU subjective measures may be supplemented by physiological measurements. Subjective assessments (ITU-T P.920, P.911) and physiological measurements (Blood Volume Pulse, Temperature, Skin Conductance and Eye Tracking) are collected from 34 subjects viewing three different 2D audiovisual contents. Each content was presented under three different quality conditions: a reference one (without degradation) and two degraded ones (audio/video asynchrony or bitrates variations on audio and/or video). Results show an impact of quality variations on the subjective data but not on physiological measures. It might be explained by this first exploratory protocol (degradation, thresholds, content presentation layout, etc.) proposed to study audiovisual quality impact on physiological activity.

[1]  Michael Peter Hollier,et al.  Multi-modal Perception , 1999 .

[2]  David Graham Wastell,et al.  Stress, control and computer system design: A psychophysiological field study , 1996, Behav. Inf. Technol..

[3]  H. Wallach,et al.  The modification of stereoscopic depth-perception and the kinetic depth-effect. , 1963, The American journal of psychology.

[4]  John G. Beerends,et al.  The Influence of Video Quality on Perceived Audio Quality and Vice Versa , 1999 .

[5]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[6]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[7]  Gm Wilson,et al.  Investigating the impact of audio degradations on users: subjective vs objective assessment methods , 2000 .

[8]  F. Wilson,et al.  Should we accept anything less than TV quality: visual communication , 1996 .

[9]  S. Steinhauer,et al.  Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[10]  Ulrich Reiter,et al.  Influence of Interaction on Perceived Quality in Audiovisual Applications: Evaluation of Cross-Modal Influence , 2007 .

[11]  M. P. Hollier,et al.  Towards a multi-modal perceptual model , 1997 .

[12]  N. F. Dixon,et al.  The Detection of Auditory Visual Desynchrony , 1980, Perception.

[13]  K. J. Vicente,et al.  Spectral Analysis of Sinus Arrhythmia: A Measure of Mental Effort , 1987, Human factors.

[14]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[15]  Jennifer Healey,et al.  Affective wearables , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[16]  Andrew Steptoe,et al.  Blood pressure publication guidelines , 1996 .