An Inquiry on Contrast Enhancement Methods for Satellite Images

Enhancement algorithms are absolutely necessary for the visualization of both shadowed and bright image regions. Defining algorithms that permit to visualize them simultaneously without altering the image content is therefore extremely relevant for remote sensing applications. In this paper, we present the results of two successive benchmarks which tested the performance of the state-of-the-art contrast enhancement and tone-mapping algorithms applied to satellite images. Experts from the French Space Agency Centre National d'Etudes Spatiales (CNES), Service Régional de Traitement d'Image et de Télédétection (SERTIT), and two European universities assessed the quality and fidelity of the results of several state-of-the-art enhancement algorithms on the excerpts from seven images (five Pleiades and two simulated 30-cm images). The first benchmark permitted to tighten the procedure and the selection of the test images for the second one, and to make a first selection of concurrent algorithms. The second benchmark not only included the best algorithms selected by the first benchmark but also added even more competitors in the tone-mapping class. The results of both benchmarks were coherent. They point a particular retinex-based algorithm as the best compromise between the competitive requirements of a contrast enhancement in dark regions and a preservation of detail in bright parts.

[1]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[2]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[3]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[4]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[5]  Hiroshi Yamaguchi,et al.  Testing HDR Image Rendering Algorithms , 2004, CIC.

[6]  Rodney M. Goodman,et al.  A real-time neural system for color constancy , 1991, IEEE Trans. Neural Networks.

[7]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[8]  Peter G. Engeldrum,et al.  Psychometric Scaling: Avoiding the Pitfalls and Hazards , 2001, PICS.

[9]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[10]  Eunsung Lee,et al.  Contrast Enhancement Using Dominant Brightness Level Analysis and Adaptive Intensity Transformation for Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[11]  Jose Luis Lisani,et al.  Simplest Color Balance , 2011, Image Process. Line.

[12]  Jong Beom Ra,et al.  Enhancement of Optical Remote Sensing Images by Subband-Decomposed Multiscale Retinex With Hybrid Intensity Transfer Function , 2011, IEEE Geoscience and Remote Sensing Letters.

[13]  Jean-Michel Morel,et al.  A PDE Formalization of Retinex Theory , 2010, IEEE Transactions on Image Processing.

[14]  Werner Purgathofer,et al.  Tone Reproduction and Physically Based Spectral Rendering , 2002, Eurographics.

[15]  Jose Luis Lisani,et al.  Color and Contrast Enhancement by Controlled Piecewise Affine Histogram Equalization , 2012, Image Process. Line.

[16]  Ana Belén Petro,et al.  Selective Contrast Adjustment by Poisson Equation , 2013, Image Process. Line.

[17]  Jean-Michel Morel,et al.  What is the right center/surround for Retinex? , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  Alessandro Rizzi,et al.  The Art and Science of HDR Imaging: McCann/The Art and Science of HDR Imaging , 2011 .

[19]  Sos S. Agaian,et al.  Transform Coefficient Histogram-Based Image Enhancement Algorithms Using Contrast Entropy , 2007, IEEE Transactions on Image Processing.

[20]  Andreas Kolb,et al.  Interactive Dynamic Range Reduction for SAR Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[21]  Liangpei Zhang,et al.  A Perceptually Inspired Variational Method for the Uneven Intensity Correction of Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[23]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[24]  J. Campbell Introduction to remote sensing , 1987 .

[25]  Min Chen,et al.  Illumination and Contrast Balancing for Remote Sensing Images , 2014, Remote. Sens..

[26]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[27]  Carlo Gatta,et al.  A new algorithm for unsupervised global and local color correction , 2003, Pattern Recognit. Lett..

[28]  Jean-Michel Morel,et al.  Fourier implementation of Poisson image editing , 2012, Pattern Recognit. Lett..

[29]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[30]  Jean-Michel Morel,et al.  Retinex Poisson Equation: a Model for Color Perception , 2011, Image Process. Line.

[31]  Jean-Michel Morel,et al.  Multiscale Retinex , 2014, Image Process. Line.

[32]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[34]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..