HDR-VQM: An objective quality measure for high dynamic range video

High dynamic range (HDR) signals fundamentally differ from the traditional low dynamic range (LDR) ones in that pixels are related (proportional) to the physical luminance in the scene (i.e. scene-referred). For that reason, the existing LDR video quality measurement methods may not be directly used for assessing quality in HDR videos. To address that, we present an objective HDR video quality measure (HDR-VQM) based on signal pre-processing, transformation, and subsequent frequency based decomposition. Video quality is then computed based on a spatio-temporal analysis that relates to human eye fixation behavior during video viewing. Consequently, the proposed method does not involve expensive computations related to explicit motion analysis in the HDR video signal, and is therefore computationally tractable. We also verified its prediction performance on a comprehensive, in-house subjective HDR video database with 90 sequences, and it was found to be better than some of the existing methods in terms of correlation with subjective scores (for both across sequence and per sequence cases). A software implementation of the proposed scheme is also made publicly available for free download and use. HighlightsThe paper presents one of the first objective method for high dynamic range video quality estimation.It is based on analysis of short term video segments taking into account human viewing behavior.The method described in the paper would be useful in scenarios where HDR video quality needs to be determined in an HDR video chain study.

[1]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[2]  Frédéric Dufaux,et al.  Optimized tone mapping with perceptually uniform luminance values for backward-compatible high dynamic range video compression , 2012, 2012 Visual Communications and Image Processing.

[3]  Touradj Ebrahimi,et al.  Subjective and objective evaluation of HDR video compression , 2015 .

[4]  Claire Mantel,et al.  Comparing subjective and objective quality assessment of HDR images compressed with JPEG-XT , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[5]  Touradj Ebrahimi,et al.  HDR image compression: A new challenge for objective quality metrics , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[6]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[7]  Patrick Le Callet,et al.  Tone mapping based HDR compression: Does it affect visual experience? , 2014, Signal Process. Image Commun..

[8]  Manish Narwaria,et al.  Tone mapping-based high-dynamic-range image compression: study of optimization criterion and perceptual quality , 2013 .

[9]  Hans-Peter Seidel,et al.  Lossy compression of high dynamic range images and video , 2006, Electronic Imaging.

[10]  HeidrichWolfgang,et al.  HDR-VDP-2 , 2011 .

[11]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[12]  D. G. Green Regional variations in the visual acuity for interference fringes on the retina , 1970, The Journal of physiology.

[13]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[14]  Patrick Le Callet,et al.  IMPACT OF TONE MAPPING IN HIGH DYNAMIC RANGE IMAGE COMPRESSION , 2014 .

[15]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[16]  George Mather,et al.  Foundations of Perception , 2006 .

[17]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[18]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.

[19]  Frederic Dufaux,et al.  Performance evaluation of objective quality metrics for HDR image compression , 2014, Optics & Photonics - Optical Engineering + Applications.

[20]  King Ngi Ngan,et al.  Visual signal quality assessment , 2015 .

[21]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[22]  Patrick Le Callet,et al.  HDR-VDP-2.2: a calibrated method for objective quality prediction of high-dynamic range and standard images , 2014, J. Electronic Imaging.

[23]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[24]  Patrick Le Callet,et al.  On improving the pooling in HDR-VDP-2 towards better HDR perceptual quality assessment , 2014, Electronic Imaging.

[25]  Patrick Le Callet,et al.  Overt visual attention for free-viewing and quality assessment tasks Impact of the regions of interest on a video quality metric , 2010 .

[26]  Le CalletPatrick,et al.  Tone mapping based HDR compression , 2014 .

[27]  Weisi Lin,et al.  Low-Complexity Video Quality Assessment Using Temporal Quality Variations , 2012, IEEE Transactions on Multimedia.

[28]  Patrick Le Callet,et al.  High Dynamic Range Visual Quality of Experience Measurement: Challenges and Perspectives , 2015 .