Measuring and managing picture quality

This chapter addresses the important area of image and video quality assessment. Methods for conducting subjective trials, and for analyzing the results from them, are first described and a discussion of the properties of some publicly available subjective test databases is provided. Objective measures of video quality are then reviewed and compared in terms of their correlations with subjective opinions. These include structural similarity, the video quality metric (VQM), visual signal-to-noise ratio (VSNR), spatial and temporal most apparent distortion (MAD), motion tuned spatio-temporal quality assessment (aka MOVIE), and the perception-based video metric (PVM). Video metrics also play an important role in the picture compression and delivery processes, for example enabling in-loop rate–quality optimization (RQO). This issue is discussed, describing some of the most common techniques that enable us to select the optimum coding parameters for each spatio-temporal region of a video. Finally, rate control methods are described.

[1]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[2]  K.G. Balmain,et al.  Medium Frequency Reradiation from a Steel Tower Power Line with and without a Detuner , 1984, IEEE Transactions on Broadcasting.

[3]  Stefan Winkler,et al.  Analysis of Public Image and Video Databases for Quality Assessment , 2012, IEEE Journal of Selected Topics in Signal Processing.

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[5]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[6]  Fan Zhang,et al.  A Parametric Framework for Video Compression Using Region-Based Texture Models , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[8]  Francesca De Simone,et al.  Subjective quality evaluation of the upcoming HEVC video compression standard , 2012, Other Conferences.

[9]  Harvey J. Everett.  Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[10]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[11]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[12]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[13]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[14]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Touradj Ebrahimi,et al.  Towards high efficiency video coding: Subjective evaluation of potential coding technologies , 2011, J. Vis. Commun. Image Represent..

[17]  Patrick Le Callet,et al.  An image quality assessment method based on perception of structural information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[18]  Hans Hoffmann,et al.  A Novel Method for Subjective Picture Quality Assessment and Further Studies of HDTV Formats , 2008, IEEE Transactions on Broadcasting.

[19]  Damon M. Chandler,et al.  A spatiotemporal most-apparent-distortion model for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[21]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[22]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[23]  Thomas Schierl,et al.  A rate control algorithm for HEVC with hierarchical GOP structures , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Abdul Hamid Sadka.  Compressed Video Communications , 2002 .

[25]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[26]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[27]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[28]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Do-Kyoung Kwon,et al.  Rate Control for H.264 Video With Enhanced Rate and Distortion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Jian Li,et al.  Nonparametric Missing Sample Spectral Analysis and Its Applications to Interrupted SAR , 2012, IEEE Journal of Selected Topics in Signal Processing.

[31]  V Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: experiments. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[33]  En-Hui Yang,et al.  Rate Distortion Optimization for H.264 Interframe Coding: A General Framework and Algorithms , 2007, IEEE Transactions on Image Processing.

[34]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[35]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[36]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[37]  Thrasyvoulos N. Pappas,et al.  Supra-threshold perceptual image coding , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[38]  Fan Zhang,et al.  A Perception-Based Hybrid Model for Video Quality Assessment , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[40]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[41]  Cedric Nishan Canagarajah,et al.  Multiple Priority Region of Interest Coding with H.264 , 2006, 2006 International Conference on Image Processing.

[42]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[43]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[44]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[45]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.