An Adaptive Method for Image Dynamic Range Adjustment

In this paper, we relate the operation of image dynamic range adjustment to the following two tasks: 1) for a high dynamic range (HDR) image, its dynamic range will be mapped to the available dynamic range of display devices and 2) for a low dynamic range (LDR) image, its distribution of intensity will be extended to adequately utilize the full dynamic range of display devices. The common goal of both tasks is to preserve or even enhance the details and improve the visibility of scenes when being matched to the available dynamic range of a display device. In this paper, we propose an efficient method for image dynamic range adjustment with three adaptive steps. First, according to the histogram of the luminance map separated from the given RGB image, two suitable Gamma functions are adaptively selected to separately adjust the luminance of the dark and bright components. Second, an adaptive fusion strategy is proposed to combine the two adjusted luminance maps in order to balance the enhancement of the details in different regions. Third, an adaptive luminance-dependent color restoration method is designed to combine the fused luminance map with the original color components to obtain more consistent color saturation between the images before and after dynamic range adjustment. Extensive experiments show that the proposed method can efficiently compress the dynamic range of HDR scenes with good contrast, clear details, and high structural fidelity of the original image appearance. In addition, the proposed method can also obtain promising performance when being used to enhance LDR nighttime images and greatly facilitates the object (car) detection in nighttime traffic scenes.

[1]  R. M. Boynton,et al.  Visual Adaptation in Monkey Cones: Recordings of Late Receptor Potentials , 1970, Science.

[2]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[3]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[4]  Yonghong Tian,et al.  Quality Assessment for Comparing Image Enhancement Algorithms , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Wenjun Zhang,et al.  Automatic Contrast Enhancement Technology With Saliency Preservation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[7]  Byungyong Ryu,et al.  Content-Aware Dark Image Enhancement Through Channel Division , 2012, IEEE Transactions on Image Processing.

[8]  Yücel Altunbasak,et al.  A Histogram Modification Framework and Its Application for Image Contrast Enhancement , 2009, IEEE Transactions on Image Processing.

[9]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[10]  Sumanta N. Pattanaik,et al.  Segmentation and adaptive assimilation for detail-preserving display of high-dynamic range images , 2003, The Visual Computer.

[11]  Hong Yan,et al.  Combining Region-of-Interest Extraction and Image Enhancement for Nighttime Vehicle Detection , 2016, IEEE Intelligent Systems.

[12]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[13]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[14]  Cheolkon Jung,et al.  Optimized Perceptual Tone Mapping for Contrast Enhancement of Images , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[16]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[17]  Yao Lu,et al.  Fast efficient algorithm for enhancement of low lighting video , 2011, ICME.

[18]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[19]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[20]  Kai-Fu Yang,et al.  Efficient illuminant estimation for color constancy using grey pixels , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[22]  Y. Rao,et al.  Generalized Equalization Model for Image Enhancement , 2016 .

[23]  Hamid Hassanpour,et al.  A locally-adaptive approach for image gamma correction , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[24]  J. Rabin The Retina: An Approachable Part of the Brain , 2013 .

[25]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[26]  Yong-Jie Li,et al.  A Retina Inspired Model for High Dynamic Range Image Rendering , 2016, BICS.

[27]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[28]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[29]  Ching-Te Chiu,et al.  BiTA/SWCE: Image Enhancement With Bilateral Tone Adjustment and Saliency Weighted Contrast Enhancement , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Xuelong Li,et al.  Exposure Fusion Using Boosting Laplacian Pyramid , 2014, IEEE Transactions on Cybernetics.

[31]  D. Baylor,et al.  Electrical responses of single cones in the retina of the turtle , 1970, The Journal of physiology.

[32]  Yongjie Li,et al.  A Retinal Adaptation Model for HDR Image Compression , 2017, CCCV.

[33]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[34]  Wolfgang Heidrich,et al.  Color correction for tone mapping , 2009, Comput. Graph. Forum.

[35]  Zhengguo Li,et al.  Single image brightening via exposure fusion , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  A. Ardeshir Goshtasby,et al.  Fusion of multi-exposure images , 2005, Image Vis. Comput..

[37]  김정연,et al.  서브블록 히스토그램 등화기법을 이용한 개선된 콘트래스트 강화 알고리즘 ( An Advanced Contrast Enhancement Using Partially Overlapped Sub-Block Histogram Equalization ) , 1999 .

[38]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[39]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[40]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[41]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[42]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[43]  Zhengguo Li,et al.  Detail-Enhanced Multi-Scale Exposure Fusion , 2017, IEEE Transactions on Image Processing.

[44]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[45]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[46]  Jack Tumblin,et al.  The Trilateral Filter for High Contrast Images and Meshes , 2003, Rendering Techniques.

[47]  Sangkeun Lee,et al.  An Efficient Content-Based Image Enhancement in the Compressed Domain Using Retinex Theory , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[49]  Yongjie Li,et al.  High Dynamic Range Image Rendering with a Luminance-Chromaticity Independent Model , 2015, IScIDE.

[50]  Jessica K. Hodgins,et al.  Two methods for display of high contrast images , 1999, TOGS.

[51]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[52]  Hong Yan,et al.  Nighttime Vehicle Detection Based on Bio-Inspired Image Enhancement and Weighted Score-Level Feature Fusion , 2017, IEEE Transactions on Intelligent Transportation Systems.

[53]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[54]  Boualem Boashash,et al.  Image fusion-based contrast enhancement , 2012, EURASIP Journal on Image and Video Processing.

[55]  Sumanta N. Pattanaik,et al.  Adaptive gain control for high dynamic range image display , 2002, SCCG '02.

[56]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[57]  Ning Xu,et al.  Intra-and-Inter-Constraint-Based Video Enhancement Based on Piecewise Tone Mapping , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[58]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[59]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[60]  Roy Hall,et al.  Illumination and Color in Computer Generated Imagery , 1988, Monographs in Visual Communication.

[61]  A. Oppenheim,et al.  Nonlinear filtering of multiplied and convolved signals , 1968 .

[62]  Joonki Paik,et al.  Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering , 1998 .

[63]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[64]  C. R. Hoffman,et al.  Illumination and Reflection Maps : Simulated Objects in Simulated and Real Environments Gene , 1984 .

[65]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[66]  Yang Gao,et al.  Fast Local Histogram Specification , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[67]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[68]  Robert L. Stevenson,et al.  Dynamic range improvement through multiple exposures , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[69]  Kai-Fu Yang,et al.  Color Constancy Using Double-Opponency , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.