A Tone-Mapping Technique Based on Histogram Using a Sensitivity Model of the Human Visual System

High-dynamic-range (HDR) images require tone mapping to be displayed properly on lower dynamic range devices. In this paper, a tone-mapping algorithm that uses histogram of luminance to construct a lookup table (LUT) for tone mapping is presented. Characteristics of the human visual system (HVS) are used to give more importance to visually distinguishable intensities while constructing the histogram bins. The method begins with constructing a histogram of the luminance channel, using bins that are perceived to be uniformly spaced by the HVS. Next, a refinement step is used, which removes the pixels from the bins that are indistinguishable by the HVS. Finally, the available display levels are distributed among the bins proportionate to the pixels counts thus giving due consideration to the visual contribution of each bin in the image. Quality assessment using both quantitative evaluations and user studies suggests that the presented algorithm produces tone-mapped images that are visually pleasant and preserve details of the original image better than the existing methods. Finally, implementation details of the algorithm on GPU for parallel processing are presented, which could achieve a significant gain in speed over CPU-based implementation.

[1]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[2]  Greg Ward Defining dynamic range , 2008, SIGGRAPH '08.

[3]  Sven Loncaric,et al.  Puma: A high-quality retinex-based tone mapping operator , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[4]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[5]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[6]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[7]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[8]  Justin Hensley,et al.  Efficient histogram generation using scattering on GPUs , 2007, SI3D.

[9]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[10]  Sven Loncaric,et al.  Color Badger: A Novel Retinex-Based Local Tone Mapping Operator , 2014, ICISP.

[11]  Rae-Hong Park,et al.  Tone mapping with contrast preservation and lightness correction in high dynamic range imaging , 2016, Signal Image Video Process..

[12]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[13]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[14]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[15]  Jaeseok Kim,et al.  Natural hdr image tone mapping based on retinex , 2011, IEEE Transactions on Consumer Electronics.

[16]  Norimichi Tsumura,et al.  Improvement and Evaluation of Real-Time Tone Mapping for High Dynamic Range Images Using Gaze Information , 2010, ACCV Workshops.

[17]  Yasufumi Takama,et al.  Relevance feedback-based image retrieval interface incorporating region and feature saliency patterns as visualizable image similarity criteria , 2003, IEEE Trans. Ind. Electron..

[18]  Wen Gao,et al.  Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video , 2010, International Journal of Computer Vision.

[19]  Ajay Luthra,et al.  High Dynamic Range and Wide Color Gamut Video Coding in HEVC: Status and Potential Future Enhancements , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[21]  Edoardo Provenzi,et al.  An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  L. Lenzen,et al.  Subjective viewer preference model for automatic HDR down conversion , 2017 .

[23]  Susanto Rahardja,et al.  Eye HDR: gaze-adaptive system for displaying high-dynamic-range images , 2009, SIGGRAPH ASIA '09.

[24]  Jan Kautz,et al.  Consistent tone reproduction , 2008 .

[25]  David Kane,et al.  Perceptual Dynamic Range for In-Camera Image Processing , 2015, BMVC.

[26]  Sankar K. Pal,et al.  Thresholding for edge detection using human psychovisual phenomena , 1986, Pattern Recognit. Lett..

[27]  Xavier Otazu,et al.  Which tone-mapping operator is the best? A comparative study of perceptual quality , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[29]  Kwanghoon Sohn,et al.  Normalized tone-mapping operators for color quality improvement in 3DTV , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[30]  Chwan-Hwa John Wu,et al.  A method for quantization scale factor selection in MPEG2 video sequence encoding using a bilayer fuzzy expert system , 1998, IEEE Trans. Ind. Electron..

[31]  Mohamed Cheriet,et al.  FSITM: A Feature Similarity Index For Tone-Mapped Images , 2015, IEEE Signal Processing Letters.

[32]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[33]  Mario Ignacio Chacon Murguia,et al.  An Adaptive Neural-Fuzzy Approach for Object Detection in Dynamic Backgrounds for Surveillance Systems , 2012, IEEE Transactions on Industrial Electronics.

[34]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[35]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[36]  Dung Trung Vo,et al.  Low line memory visually lossless compression for color images using non-uniform quantizers , 2011, IEEE Transactions on Consumer Electronics.

[37]  Anselmo Lastra,et al.  Fast Summed‐Area Table Generation and its Applications , 2005, Comput. Graph. Forum.

[38]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[39]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[40]  Yeong-Ho Ha,et al.  Visibility Enhancement of Mobile Device Through Luminance and Chrominance Compensation Upon Hue , 2017, IEEE Transactions on Industrial Electronics.

[41]  Philippe Fuchs,et al.  Visual Fatigue Reduction for Immersive Stereoscopic Displays by Disparity, Content, and Focus-Point Adapted Blur , 2012, IEEE Transactions on Industrial Electronics.