Tone Mapping Based on Multi-scale Histogram Synthesis

In this paper, we present a novel tone mapping algorithm that can be used for displaying wide dynamic range (WDR) images on low dynamic range (LDR) devices. The proposed algorithm is mainly motivated by the logarithmic response and local adaptation features of the human visual system (HVS). HVS perceives luminance differently when under different adaptation levels, and therefore our algorithm uses functions built upon different scales to tone map pixels to different values. Functions of large scales are used to maintain image brightness consistency and functions of small scales are used to preserve local detail and contrast. An efficient method using local variance has been proposed to fuse the values of different scales and to remove artifacts. The algorithm utilizes integral images and integral histograms to reduce computation complexity and processing time. Experimental results show that the proposed algorithm can generate high brightness, good contrast and appealing images that surpass the performance of many state-of-the-art tone mapping algorithms. This project is available at https://github.com/jieyang1987/ToneMapping-Based-on-Multi-scale-Histogram-Synthesis.

[1]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, ACM Trans. Graph..

[4]  Yang Ni,et al.  Logarithmic Image Sensor for Wide Dynamic Range Stereo Vision System , 2014, IHCI.

[5]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[6]  Guoping Qiu,et al.  An optimal tone reproduction curve operator for the display of high dynamic range images , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[7]  Mohamed Cheriet,et al.  FSITM: A Feature Similarity Index For Tone-Mapped Images , 2015, IEEE Signal Processing Letters.

[8]  Masahiro Okuda,et al.  High Dynamic Range image tone mapping based on local Histogram Equalization , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[9]  S. Kavadias,et al.  A logarithmic response CMOS image sensor with on-chip calibration , 2000, IEEE Journal of Solid-State Circuits.

[10]  Alain Horé,et al.  An FPGA implementation of a tone mapping algorithm with a halo-reducing filter , 2016, Journal of Real-Time Image Processing.

[11]  J.E.D. Hurwitz,et al.  Extended Dynamic Range From a Combined Linear-Logarithmic CMOS Image Sensor , 2006, IEEE Journal of Solid-State Circuits.

[12]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[13]  Jang-Kyoo Shin,et al.  A Linear-Logarithmic CMOS Image Sensor With Adjustable Dynamic Range , 2016, IEEE Sensors Journal.

[14]  Shmuel Einav,et al.  Biological Gain Control for High Dynamic Range Compression , 2003, CIC.

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[16]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[17]  Kai Zeng,et al.  High dynamic range image tone mapping by optimizing tone mapped image quality index , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[18]  Chi-Yi Tsai,et al.  A Fast Dynamic Range Compression With Local Contrast Preservation Algorithm and Its Application to Real-Time Video Enhancement , 2012, IEEE Transactions on Multimedia.

[19]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[20]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[21]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[22]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[23]  Wen Gao,et al.  Blind Quality Assessment of Tone-Mapped Images Via Analysis of Information, Naturalness, and Structure , 2016, IEEE Transactions on Multimedia.

[24]  S. Hecht,et al.  THE VISUAL DISCRIMINATION OF INTENSITY AND THE WEBER-FECHNER LAW , 1924, The Journal of general physiology.

[25]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Orly Yadid-Pecht,et al.  A New Filter for Reducing HALO Artifacts in Tone Mapped Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[27]  Rafal Mantiuk,et al.  Real-time noise-aware tone mapping , 2015, ACM Trans. Graph..

[28]  Guoping Qiu,et al.  Tone-mapping high dynamic range images by novel histogram adjustment , 2010, Pattern Recognit..

[29]  Orly Yadid-Pecht,et al.  A statistical derivation of an automatic tone mapping algorithm for wide dynamic range display , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  S. S. Stevens,et al.  Brightness function: effects of adaptation. , 1963, Journal of the Optical Society of America.

[31]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[32]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Marius Herscovitz,et al.  A modified Multi Scale Retinex algorithm with an improved global impressionof brightness for wide dynamic range pictures , 2004, Machine Vision and Applications.

[34]  Bo Gu,et al.  Local Edge-Preserving Multiscale Decomposition for High Dynamic Range Image Tone Mapping , 2013, IEEE Transactions on Image Processing.

[35]  Anders Ynnerman,et al.  A unified framework for multi-sensor HDR video reconstruction , 2013, Signal Process. Image Commun..

[36]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[37]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[38]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[39]  Orly Yadid-Pecht,et al.  Multi-Scale histogram tone mapping algorithm for display of wide dynamic range images , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[40]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[41]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[42]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[43]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[44]  S. Decker,et al.  A 256/spl times/256 CMOS imaging array with wide dynamic range pixels and column-parallel digital output , 1998, 1998 IEEE International Solid-State Circuits Conference. Digest of Technical Papers, ISSCC. First Edition (Cat. No.98CH36156).