No reference stereo video quality assessment based on motion feature in tensor decomposition domain

Abstract A no reference stereo video quality assessment method based on motion features extracted in tensor decomposition domain is proposed. Tensor decomposition is used to reduce dimension of color, view and time of stereo video, and motion information maps containing time-varying information of inter-views and intra-views are obtained. Statistical features such as generalized Gaussian distribution (GGD), asymmetric GGD, spatial entropy, spectral entropy associated with two views, and spectral entropy related to depth perception of stereo video, are extracted. Random forest is utilized to establish relationship between stereo video quality and the extracted features. Experimental results on NAMA3DS1-COSPAD1 database demonstrate that the proposed method achieves good performance on JP2K, resolution reduction, sharpening and their combination distortions, Pearson linear correlation coefficient (PLCC) values of these types of distortions are higher than 0.97, while for H.264 distortion the PLCC value is 0.8850, which means that the proposed metric is consistent with human visual perception.

[1]  Alan C. Bovik,et al.  A Completely Blind Video Integrity Oracle , 2016, IEEE Transactions on Image Processing.

[2]  David Broberg.  Infrastructures for Home Delivery, Interfacing, Captioning, and Viewing of 3-D Content , 2011, Proceedings of the IEEE.

[3]  Stefan Winkler,et al.  Stereo/multiview picture quality: Overview and recent advances , 2013, Signal Process. Image Commun..

[4]  Andrzej Cichocki,et al.  Bayesian CP factorization of incomplete tensor for EEG signal application , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[5]  Gabriel-Miro Muntean,et al.  An Innovative No-Reference Metric for Real-Time 3D Stereoscopic Video Quality Assessment , 2016, IEEE Transactions on Broadcasting.

[6]  Alan C. Bovik,et al.  Making image quality assessment robust , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[7]  Bora Uçar,et al.  High Performance Parallel Algorithms for the Tucker Decomposition of Sparse Tensors , 2016, 2016 45th International Conference on Parallel Processing (ICPP).

[8]  Jing Zhang,et al.  A Tensor-Driven Temporal Correlation Model for Video Sequence Classification , 2016, IEEE Signal Processing Letters.

[9]  Alan C. Bovik,et al.  Blind/Referenceless Image Spatial Quality Evaluator , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[10]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Xiangming Wen,et al.  Blind video quality assessment using natural video spatio-temporal statistics , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[12]  Gabriel-Miro Muntean,et al.  No reference objective quality metric for stereoscopic 3D video , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[13]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[14]  Fan Zhang,et al.  A Perception-Based Hybrid Model for Video Quality Assessment , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Touradj Ebrahimi,et al.  Free-viewpoint video sequences: A new challenge for objective quality metrics , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[16]  Narciso García,et al.  NAMA3DS1-COSPAD1: Subjective video quality assessment database on coding conditions introducing freely available high quality 3D stereoscopic sequences , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[17]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[18]  Bofeng Zhang,et al.  An Efficient Algorithm for Tensor Principal Component Analysis via Proximal Linearized Alternating Direction Method of Multipliers , 2016, 2016 International Conference on Advanced Cloud and Big Data (CBD).

[19]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[20]  Xiaofeng Gong,et al.  Tensor decomposition of EEG signals: A brief review , 2015, Journal of Neuroscience Methods.

[21]  Wei Zhao,et al.  No-reference objective stereo video quality assessment based on visual attention and edge difference , 2015, 2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[22]  Jean-Yves Guillemaut,et al.  Stereoscopic Video Quality Assessment Using Binocular Energy , 2017, IEEE Journal of Selected Topics in Signal Processing.

[23]  Mei Yu,et al.  Binocular perception based reduced-reference stereo video quality assessment method , 2016, J. Vis. Commun. Image Represent..

[24]  Alan C. Bovik,et al.  Blind quality assessment of videos using a model of natural scene statistics and motion coherency , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[25]  Chong-Ho Choi,et al.  Incremental $N$ -Mode SVD for Large-Scale Multilinear Generative Models , 2014, IEEE Transactions on Image Processing.