Objective quality assessment of tone-mapped videos

With the fast advances in video acquisition, computational imaging, and display technologies, there has been a growing interest in high dynamic range (HDR) videos. Tone mapping operators (TMOs) that convert HDR content to low dynamic range (LDR) ones provide a practically useful solution for the visualization of HDR videos on standard LDR displays, where the user experience highly depends on the performance of the TMOs being used. Without an appropriate perceptual quality measure, different TMOs cannot be compared. Subjective experiments may be a reliable solution, but is time consuming, expensive, and difficult to be embedded into optimization processes. Here we make one of the first attempts to develop an objective quality assessment model for tone-mapped videos that incorporates structural fidelity, statistical naturalness and memory effect. Validation using subject-rated tone-mapped videos show that the proposed method is well-correlated with subjective scores.

[1]  Dominique Thoreau,et al.  Zonal brightness coherency for video tone mapping , 2014, Signal Process. Image Commun..

[2]  Hans-Peter Seidel,et al.  On evaluation of video quality metrics: an HDR dataset for computer graphics applications , 2011, Electronic Imaging.

[3]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[4]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[5]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[6]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[7]  Hans-Peter Seidel,et al.  Video quality assessment for computer graphics applications , 2010, SIGGRAPH 2010.

[8]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[9]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[10]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[11]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Transactions on Graphics.

[12]  Pavel Slavík,et al.  The naturalness of reproduced high dynamic range images , 2005, Ninth International Conference on Information Visualisation (IV'05).

[13]  Markus Fiedler,et al.  The memory effect and its implications on Web QoE modeling , 2011, 2011 23rd International Teletraffic Congress (ITC).

[14]  Alan C. Bovik,et al.  Delivery quality score model for Internet video , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[16]  Robert A. Frazor,et al.  Independence of luminance and contrast in natural scenes and in the early visual system , 2005, Nature Neuroscience.

[17]  Kai Zeng,et al.  High Dynamic Range Image Compression by Optimizing Tone Mapped Image Quality Index , 2015, IEEE Transactions on Image Processing.

[18]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[19]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[20]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[21]  Mohammed Ghanbari,et al.  Recency effect in the subjective assessment of digitally-coded television pictures , 1995 .

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Kurt Debattista,et al.  Evaluation of HDR video tone mapping for mobile devices , 2014, Signal Process. Image Commun..

[24]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[25]  Rafal Mantiuk,et al.  Assessment of video tone-mapping: Are cameras' S-shaped tone-curves good enough? , 2013, J. Vis. Commun. Image Represent..

[26]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[27]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[28]  Hans-Peter Seidel,et al.  Visible difference predicator for high dynamic range images , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[29]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..