Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure

High dynamic range (HDR) imaging techniques have been working constantly, actively, and validly in the fault detection and disease diagnosis in the astronomical and medical fields, and currently they have also gained much more attention from digital image processing and computer vision communities. While HDR imaging devices are starting to have friendly prices, HDR display devices are still out of reach of typical consumers. Due to the limited availability of HDR display devices, in most cases tone mapping operators (TMOs) are used to convert HDR images to standard low dynamic range (LDR) images for visualization. But existing TMOs cannot work effectively for all kinds of HDR images, with their performance largely depending on brightness, contrast, and structure properties of a scene. To accurately measure and compare the performance of distinct TMOs, in this paper develop an effective and efficient no-reference objective quality metric which can automatically assess LDR images created by different TMOs without access to the original HDR images. Our model is shown to be statistically superior to recent full- and no-reference quality measures on the existing tone-mapped image database and a new relevant database built in this work.

[1]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[2]  Don H. Johnson,et al.  Symmetrizing the Kullback-Leibler Distance , 2001 .

[3]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[4]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[5]  Wenjun Zhang,et al.  Details preservation inspired blind quality metric of tone mapping methods , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[6]  Lucjan Janowski,et al.  Modeling subjective tests of quality of experience with a Generalized Linear Model , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[7]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[8]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[9]  Wen Gao,et al.  Perceptual Video Coding Based on SSIM-Inspired Divisive Normalization , 2013, IEEE Transactions on Image Processing.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[13]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Wenjun Zhang,et al.  Automatic Contrast Enhancement Technology With Saliency Preservation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Gerald Schaefer,et al.  UCID: an uncompressed color image database , 2003, IS&T/SPIE Electronic Imaging.

[17]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[18]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[19]  Wenjun Zhang,et al.  An efficient color image quality metric with local-tuned-global model , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[20]  Winston H. Hsu,et al.  Scalable Mobile Visual Classification by Kernel Preserving Projection Over High-Dimensional Features , 2014, IEEE Transactions on Multimedia.

[21]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[22]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[23]  Pavel Slavík,et al.  The naturalness of reproduced high dynamic range images , 2005, Ninth International Conference on Information Visualisation (IV'05).

[24]  Simon Pietro Romano,et al.  Automated qualitative assessment of multi-modal distortions in digital images based on GLZ , 2010, Ann. des Télécommunications.

[25]  Patrick Le Callet,et al.  HDR-VDP-2.2: a calibrated method for objective quality prediction of high-dynamic range and standard images , 2014, J. Electronic Imaging.

[26]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[27]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[28]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[29]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[30]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[31]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[32]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[33]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[34]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[35]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[36]  Bhabatosh Chanda,et al.  Space-Time Facet Model for Human Activity Classification , 2014, IEEE Transactions on Multimedia.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[39]  Wenjun Zhang,et al.  Quality Assessment Considering Viewing Distance and Image Resolution , 2015, IEEE Transactions on Broadcasting.

[40]  Hans-Peter Seidel,et al.  Backward compatible high dynamic range MPEG video compression , 2006, SIGGRAPH 2006.

[41]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[42]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[43]  Robert A. Frazor,et al.  Independence of luminance and contrast in natural scenes and in the early visual system , 2005, Nature Neuroscience.

[44]  Wenjun Zhang,et al.  A new reduced-reference image quality assessment using structural degradation model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[45]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[46]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.