A full reference stereoscopic video quality assessment metric

We propose a full reference stereo video quality assessment algorithm for assessing the perceptual quality of natural stereo videos. We exploit the separable representation of motion and binocular disparity in the visual cortex and develop a four stage algorithm to measure the quality of a stereoscopic video called FLOSIM3D. First, we compute the temporal features by utilizing an existing 2D VQA metric which measures the temporal annoyance based on patch level statistics such as mean, variance and minimum eigen value and pools them with a frame categorization based non-linear pooling strategy. Second, a structure based 2D Image Quality Assessment (IQA) metric is used to compute the spatial quality of the frames. Next, the loss in depth cues is measured using a structure based metric. Finally, the features for each of the stereo views are pooled to obtain the final stereo video quality score. We demonstrate the state-of-the-art performance of the proposed metric on IRCCYN dataset involving H.264, JP2K compression artifacts.

[1]  Panos Nasiopoulos,et al.  METRIC FOR 3 D VIDEO COMPRESSION , 2013 .

[2]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[3]  Richard T Born,et al.  Joint tuning for direction of motion and binocular disparity in macaque MT is largely separable. , 2013, Journal of neurophysiology.

[4]  Kwanghoon Sohn,et al.  Depth map quality metric for three-dimensional video , 2009, Electronic Imaging.

[5]  Ahmet M. Kondoz,et al.  Toward an Impairment Metric for Stereoscopic Video: A Full-Reference Video Quality Metric to Assess Compressed Stereoscopic Video , 2013, IEEE Transactions on Image Processing.

[6]  Feng Qi,et al.  Stereoscopic video quality assessment based on stereo just-noticeable difference model , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Munchurl Kim,et al.  A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Damon M. Chandler,et al.  A spatiotemporal most-apparent-distortion model for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[9]  Chao Sun,et al.  An Efficient Quality Assessment Metric for 3D Video , 2012, 2012 IEEE 12th International Conference on Computer and Information Technology.

[10]  Ahmet M. Kondoz,et al.  Perceptual Video Quality Metric for 3D video quality assessment , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[11]  Alex D. Hwang,et al.  Instability of the perceived world while watching 3D stereoscopic imagery: A likely source of motion sickness symptoms , 2014, i-Perception.

[12]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[13]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[14]  Karen O. Egiazarian,et al.  Validation of a new full reference metric for quality assessment of mobile 3DTV content , 2011, 2011 19th European Signal Processing Conference.

[15]  Ahmet M. Kondoz,et al.  Prediction of stereoscopic video quality using objective quality models of 2-D video , 2008 .

[16]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Warnakulasuriya Anil Chandana Fernando,et al.  3D video assessment with Just Noticeable Difference in Depth evaluation , 2010, 2010 IEEE International Conference on Image Processing.

[18]  Sumohana S. Channappayya,et al.  No-reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics , 2016, Signal Process. Image Commun..

[19]  Frederic Dufaux,et al.  Emerging Technologies for 3D Video: Creation, Coding, Transmission and Rendering , 2013, Emerging Technologies for 3D Video.

[20]  Sumohana S. Channappayya,et al.  Super-multiview content with high angular resolution: 3D quality assessment on horizontal-parallax lightfield display , 2016, Signal Process. Image Commun..

[21]  James A. Crowell,et al.  Horizontal and vertical disparity, eye position, and stereoscopic slant perception , 1999, Vision Research.

[22]  A. Gotchev,et al.  A perceptual quality metric for high-definition stereoscopic 3D video , 2015, Electronic Imaging.

[23]  Sumohana S. Channappayya,et al.  Full-Reference Stereo Image Quality Assessment Using Natural Stereo Scene Statistics , 2015, IEEE Signal Processing Letters.

[24]  Sumohana S. Channappayya,et al.  An optical flow-based no-reference video quality assessment algorithm , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[25]  Narciso García,et al.  NAMA3DS1-COSPAD1: Subjective video quality assessment database on coding conditions introducing freely available high quality 3D stereoscopic sequences , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[26]  José Vinícius de Miranda Cardoso,et al.  Objective estimation of 3D video quality: A disparity-based weighting strategy , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[27]  Robert Earl Patterson Human Factors of Stereoscopic 3D Displays , 2015, Springer London.

[28]  Siwei Ma,et al.  Stereoscopic video quality assessment model based on spatial-temporal structural information , 2012, 2012 Visual Communications and Image Processing.

[29]  Ronald S. Harwerth,et al.  Temporal integration for stereoscopic vision , 2003, Vision Research.

[30]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[31]  Izumi Ohzawa,et al.  Joint-encoding of motion and depth by visual cortical neurons: neural basis of the Pulfrich effect , 2001, Nature Neuroscience.

[32]  G. DeAngelis,et al.  Organization of Disparity-Selective Neurons in Macaque Area MT , 1999, The Journal of Neuroscience.

[33]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[34]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[35]  Yanqing Li,et al.  No-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics , 2017, 2017 2nd International Conference on Multimedia and Image Processing (ICMIP).