A No-reference Perceptual Quality Metric for Videos Distorted by Spatially Correlated noise

Assessing the perceptual quality of videos is critical for monitoring and optimizing video processing pipelines. In this paper, we focus on predicting the perceptual quality of videos distorted by noise. Existing video quality metrics are tuned for“white”, i.e., spatially uncorrelated noise. However, white noise is very rare in real videos. Based on our analysis of the noise correlation patterns in a broad and comprehensive video set, we build a video database that simulates the commonly encountered noise characteristics. Using the database, we develop a perceptual quality assessment algorithm that explicitly incorporates the noise correlations. Experimental results show that, for videos with spatially correlated noises, the proposed algorithm presents high accuracy in predicting perceptual qualities. CCS Concepts •Human-centered computing → User models; Laboratory experiments; Empirical studies in HCI;

[1]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[2]  Alan C. Bovik,et al.  A Completely Blind Video Integrity Oracle , 2016, IEEE Transactions on Image Processing.

[3]  Paul R. White,et al.  Synthesising film grain , 2004 .

[4]  Anil C. Kokaram,et al.  Measuring noise correlation for improved video denoising , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[6]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[8]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[9]  André Kaup,et al.  A dual-model approach to blind quality assessment of noisy images , 2013, 2013 Picture Coding Symposium (PCS).

[10]  Vijayan K. Asari,et al.  No-Reference Video Quality Assessment Based on Artifact Measurement and Statistical Analysis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Xiaolin Wu,et al.  Noise estimation using statistics of natural images , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[13]  Raveendran Paramesran,et al.  Blind image quality assessment for color images with additive Gaussian white noise using standard deviation , 2014, 2014 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[14]  Min Liu,et al.  Blind image quality assessment for noise , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[15]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[16]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[17]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[18]  Alan V. Oppenheim,et al.  Discrete-time signal processing (2nd ed.) , 1999 .

[19]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[20]  Damon M. Chandler,et al.  A spatiotemporal most-apparent-distortion model for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Gordon Erlebacher,et al.  Hybrid No-Reference Natural Image Quality Assessment of Noisy, Blurry, JPEG2000, and JPEG Images , 2011, IEEE Transactions on Image Processing.

[24]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[25]  David J. Field,et al.  How Close Are We to Understanding V1? , 2005, Neural Computation.

[26]  Christian Keimel,et al.  Towards an Evaluation of Denoising Algorithms with Respect to Realistic Camera Noise , 2013, 2013 IEEE International Symposium on Multimedia.

[27]  Antonio De Stefano,et al.  Synthesising and reducing film grain , 2006, J. Vis. Commun. Image Represent..

[28]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  Bernd Girod,et al.  The Information Theoretical Significance of Spatial and Temporal Masking in Video Signals , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[30]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[31]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[32]  R.M. Mersereau,et al.  Restoration of lossy compressed noisy images , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.