Using video quality metrics for something other than compression

The development of video quality metrics and perceptual video quality metrics has been a well established pursuit for more than 25 years. The body of work has been seen to be most relevant for improving the performance of visual compression algorithms. However, modeling the human perception of video with an algorithm of some sort is notoriously complicated. As a result the perceptual coding of video remains challenging and no standards have incorporated perceptual video quality metrics within their specification. In this paper we present the use of video metrics at the system level of a video processing pipeline. We show that it is possible to combine the artefact detection and correction process by posing the problem as a classification exercise. We also present the use of video metrics as part of a classical testing pipeline for software infrastructure, but here it is sensitive to the perceived quality in picture degradation.

[1]  H. D. L. Dzn.  Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. I. Attenuation characteristics with white and colored light. , 1958 .

[2]  Patrick Le Callet,et al.  High Dynamic Range Video - From Acquisition, to Display and Applications , 2016 .

[3]  Ming-Hsuan Yang,et al.  A New Image Quality Metric for Image Auto-denoising , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Anil C. Kokaram,et al.  Optimizing Transcoder Quality Targets Using a Neural Network with an Embedded Bitrate Model , 2016, Visual Information Processing and Communication.

[5]  Chao Chen,et al.  A No-reference Perceptual Quality Metric for Videos Distorted by Spatially Correlated noise , 2016 .

[6]  Huahui Wu,et al.  A cloud-based large-scale distributed video analysis system , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Anil C. Kokaram,et al.  A perceptual visibility metric for banding artifacts , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  J. O. Limb.  Source-receiver encoding of television signals , 1967 .

[9]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[10]  Rafal Mantiuk,et al.  Measurements of achromatic and chromatic contrast sensitivity functions for an extended range of adaptation luminance , 2013, Electronic Imaging.

[11]  Abdul Rehman,et al.  SSIM-based non-local means image denoising , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[13]  Stephen D. Voran,et al.  Objective video quality assessment system based on human perception , 1993, Electronic Imaging.

[14]  Anil Kokaram,et al.  OTT (Over-The-Top) in 2015 , 2015 .

[15]  Anil C. Kokaram,et al.  Multipass encoding for reducing pulsing artifacts in cloud based video transcoding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[16]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[17]  A B Watson,et al.  Perceptual-components architecture for digital video. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[18]  Pierre-Anthony Lemieux.  State of Interoperable Master Format (IMF) , 2017 .

[19]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[20]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[22]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[23]  Karel Fliegel,et al.  Using full-reference image quality metrics for automatic image sharpening , 2014, Photonics Europe.

[24]  S. McCarthy,et al.  Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution , 2014, Electronic Imaging.

[25]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[26]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[27]  Kai Zeng,et al.  Perceptual evaluation of image denoising algorithms , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[28]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.