Selecting scenes for 2D and 3D subjective video quality tests

This paper presents recommended techniques for choosing video sequences for subjective experiments. Subjective video quality assessment is a well-understood field, yet scene selection is often driven by convenience or content availability. Three-dimensional testing is a newer field that requires new considerations for scene selection. The impact of experiment design on best practices for scene selection will also be considered. A semi-automatic selection process for content sets for subjective experiments will be proposed.

[1]  Jonathan Burton,et al.  RMIT3DV: Pre-announcement of a creative commons uncompressed HD 3D video database , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[2]  T. Tominaga,et al.  Performance comparisons of subjective quality assessment methods for mobile video , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[3]  Daniel Minoli.  3D Television (3dtv) Technology, Systems, and Deployment: Rolling Out the Infrastructure for Next-Generation Entertainment , 2010 .

[4]  Seungjoon Yang,et al.  An effective de-interlacing technique using two types of motion information , 2003, IEEE Trans. Consumer Electron..

[5]  Arthur A. Webster.  Two Criteria for Video Test Scene Selection , 1994 .

[6]  Margaret H. Pinson,et al.  Audiovisual Quality Components , 2011, IEEE Signal Processing Magazine.

[7]  Nam Ik Cho,et al.  A New EDI-based Deinterlacing Algorithm , 2007, IEEE Transactions on Consumer Electronics.

[8]  Patrick Le Callet,et al.  New stereoscopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone , 2011, Electronic Imaging.

[9]  Christian Keimel,et al.  Video quality evaluation in the cloud , 2012, 2012 19th International Packet Video Workshop (PV).

[10]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[11]  Andrew Catellier,et al.  Impact of mobile devices and usage location on perceived multimedia quality , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[12]  I. Heynderickx,et al.  Measuring visual discomfort associated with 3D displays , 2009, Electronic Imaging.

[13]  Touradj Ebrahimi,et al.  A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video , 2010, Electronic Imaging.

[14]  Stefan Winkler,et al.  Issues in vision modeling for perceptual video quality assessment , 1999, Signal Process..

[15]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[16]  Stefan Winkler,et al.  Analysis of Public Image and Video Databases for Quality Assessment , 2012, IEEE Journal of Selected Topics in Signal Processing.

[17]  Jorge E. Caviedes,et al.  2D VS. 3D VISUAL QUALITY EVALUATION: THE DEPTH FACTOR , 2013 .

[18]  Margaret H. Pinson,et al.  The Consumer Digital Video Library , 2010 .

[19]  Marcus Barkowsky,et al.  ANALYSIS OF FREELY AVAILABLE SUBJECTIVE DATASET FOR HDTV INCLUDING CODING AND TRANSMISSION DISTORTIONS , 2010 .

[20]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[21]  Marcus Barkowsky,et al.  The influence of relative disparity and planar motion velocity on visual discomfort of stereoscopic videos , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[22]  John M. Libert,et al.  Perceptual Effects of Noise in Digital Video Compression , 1998 .

[23]  Marcus Barkowsky,et al.  NEW REQUIREMENTS OF SUBJECTIVE VIDEO QUALITY ASSESSMENT METHODOLOGIES FOR 3DTV , 2010 .

[24]  Junle Wang,et al.  Study on visual discomfort induced by stimulus movement at fixed depth on stereoscopic displays using shutter glasses , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[25]  Yong Man Ro,et al.  Subjective assessment of visual discomfort induced by binocular disparity and stimulus width in stereoscopic image , 2013, Electronic Imaging.

[26]  Yuzhen Niu,et al.  What Makes a Professional Video? A Computational Aesthetics Approach , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Narciso García,et al.  NAMA3DS1-COSPAD1: Subjective video quality assessment database on coding conditions introducing freely available high quality 3D stereoscopic sequences , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.