Quality Assessment for Tone-Mapped HDR Images Using Multi-Scale and Multi-Layer Information

Tone mapping operators and multi-exposure fusion methods allow us to enjoy the informative contents of high dynamic range (HDR) images with standard dynamic range devices, but also introduce distortions into HDR contents. Therefore methods are needed to evaluate tone-mapped image quality. Due to the complexity of possible distortions in a tonemapped image, information from different scales and different levels should be considered when predicting tone-mapped image quality. So we propose a new no-reference method of tone-mapped image quality assessment based on multi-scale and multi-layer features that are extracted from a pre-trained deep convolutional neural network model. After being aggregated, the extracted features are mapped to quality predictions by regression. The proposed method is tested on the largest public database for TMIQA and compared to existing no-reference methods. The experimental results show that the proposed method achieves better performance.

[1]  Xinfeng Zhang,et al.  Quality assessment of tone-mapped images based on sparse representation , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[2]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[3]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[4]  Brian L. Evans,et al.  Visual attention guided quality assessment of Tone-Mapped images using scene statistics , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Michael Wimmer,et al.  Image Attributes and Quality for Evaluation of Tone Mapping Operators , 2006 .

[7]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[8]  Neil D. B. Bruce,et al.  Saliency weighted quality assessment of tone-mapped images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[10]  Chunping Hou,et al.  Biologically Inspired Blind Quality Assessment of Tone-Mapped Images , 2018, IEEE Transactions on Industrial Electronics.

[11]  Wen Gao,et al.  Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure , 2016, IEEE Transactions on Multimedia.

[12]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[13]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Tone-Mapped HDR Pictures , 2017, IEEE Transactions on Image Processing.

[14]  Damon M. Chandler,et al.  No-reference image quality assessment based on log-derivative statistics of natural scenes , 2013, J. Electronic Imaging.

[15]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[16]  Ming Jiang,et al.  Exploiting High-Level Semantics for No-Reference Image Quality Assessment of Realistic Blur Images , 2017, ACM Multimedia.

[17]  Alan C. Bovik,et al.  Large-Scale Crowdsourced Study for Tone-Mapped HDR Pictures , 2017, IEEE Transactions on Image Processing.

[18]  Mohamed Cheriet,et al.  FSITM: A Feature Similarity Index For Tone-Mapped Images , 2015, IEEE Signal Processing Letters.