Self-tunable transformation function for enhancement of high contrast color images

Abstract. A new image enhancement technique based on a self-tunable transformation function to improve the visual quality of images captured with low dynamic range devices in extreme lighting conditions is presented. This technique consists of four processes: histogram adjustment, dynamic range compression, contrast enhancement, and nonlinear color restoration. Histogram adjustment on each spectral band is performed to minimize the effect of illumination. Dynamic range compression is accomplished by a newly designed inverse sine nonlinear function that provides various nonlinear curvatures with an image dependent parameter. A nonlinear curve generated by this parameter is used to modify the intensity of each pixel in the luminance image. A nonlinear color restoration process based on the chromatic information and luminance of the original image is employed. The effectiveness of this technique is evaluated on various natural images and aerial images, and compared with other state-of the art techniques. A quantitative evaluation is performed by estimating the number of Harris corners and speeded up robust features on wide area motion imagery data. The application of the proposed algorithm on face detection is also demonstrated. The evaluation results demonstrate that the proposed method holds significant benefits for surveillance and security applications and also as a preprocessing technique for object detection and tracking applications.

[1]  S. Acton,et al.  Image enhancement using a contrast measure in the compressed domain , 2003, IEEE Signal Processing Letters.

[2]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[3]  G. Johnson,et al.  Regionally Adaptive Histogram Equalization of the Chest , 1987, IEEE Transactions on Medical Imaging.

[4]  Guoping Qiu,et al.  Novel histogram processing for colour image enhancement , 2004, Third International Conference on Image and Graphics (ICIG'04).

[5]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Sos S. Agaian,et al.  Nonlinear Unsharp Masking for Mammogram Enhancement , 2011, IEEE Transactions on Information Technology in Biomedicine.

[7]  Sos S. Agaian,et al.  Comparative study of logarithmic enhancement algorithms with performance measure , 2006, Electronic Imaging.

[8]  Sos S. Agaian,et al.  Comparative study of histogram equalization algorithms for image enhancement , 2010, Defense + Commercial Sensing.

[9]  Joonki Paik,et al.  Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering , 1998 .

[10]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[11]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Sos S. Agaian,et al.  A logarithmic measure of image enhancement , 2006, SPIE Defense + Commercial Sensing.

[13]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[14]  Ching-Te Chiu,et al.  BiTA/SWCE: Image Enhancement With Bilateral Tone Adjustment and Saliency Weighted Contrast Enhancement , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Salvador Gabarda,et al.  No-reference image quality assessment through the von Mises distribution , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Sos S. Agaian,et al.  Color image enhancement algorithm based on logarithmic transform coefficient histogram , 2011, Electronic Imaging.

[17]  Min H. Kim,et al.  Modeling Human Color Perception under Extended Luminance Levels Supplemental Material B , 1991 .

[18]  Sos S. Agaian,et al.  Human Visual System Based Multi-Histogram Equalization for Non-Uniform Illumination and Shoadow Correction , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[19]  Sos S. Agaian,et al.  Transform-based image enhancement algorithms with performance measure , 2001, IEEE Trans. Image Process..

[20]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[21]  Sos S. Agaian,et al.  Parameterized Logarithmic Framework for Image Enhancement , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Sos S. Agaian,et al.  Transform Coefficient Histogram-Based Image Enhancement Algorithms Using Contrast Entropy , 2007, IEEE Transactions on Image Processing.

[23]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[25]  Vasile Patrascu,et al.  COLOR IMAGE ENHANCEMENT METHOD USING FUZZY SURFACES IN THE FRAMEWORK OF THE LOGARITHMIC MODELS , 2004 .

[26]  Zhenyang Wu,et al.  Color image enhancement and evaluation algorithm based on human visual system , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2004, J. Electronic Imaging.

[28]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[29]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[30]  Sos S. Agaian,et al.  Adaptive multi-histogram equalization using human vision thresholding , 2007, Electronic Imaging.

[31]  Sos S. Agaian,et al.  Human visual system based similarity metrics , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[32]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[33]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[34]  Sos S. Agaian,et al.  A non-reference measure for objective edge map evaluation , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[35]  Vijayan K. Asari,et al.  An illuminance-reflectance nonlinear video enhancement model for homeland security applications , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[36]  Eunsung Lee,et al.  Wavelet-domain color image enhancement using filtered directional bases and frequency-adaptive shrinkage , 2010, IEEE Transactions on Consumer Electronics.

[37]  Vijayan K. Asari,et al.  A locally tuned nonlinear technique for color image enhancement , 2008 .

[38]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[39]  김정연,et al.  서브블록 히스토그램 등화기법을 이용한 개선된 콘트래스트 강화 알고리즘 ( An Advanced Contrast Enhancement Using Partially Overlapped Sub-Block Histogram Equalization ) , 1999 .

[40]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[41]  H. Kolb How the Retina Works , 2003, American Scientist.

[42]  Sos S. Agaian Visual morphology , 1999, Electronic Imaging: Nonlinear Image Processing.

[43]  Sos S. Agaian,et al.  A New Measure of Image Enhancement , 2000 .

[44]  Sim Heng Ong,et al.  Kurtosis-based no-reference quality assessment of JPEG2000 images , 2011, Signal Process. Image Commun..

[45]  Sos S. Agaian,et al.  Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Erik Reinhard,et al.  A neurophysiology-inspired steady-state color appearance model. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[47]  Sos S. Agaian,et al.  Wavelet transform coefficient histogram-based image enhancement algorithms , 2010, Defense + Commercial Sensing.

[48]  Vasile Patrascu,et al.  Fuzzy enhancement method using logarithmic models , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[49]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Vasile Patrascu,et al.  Color Image Enhancement Using the Support Fuzzification , 2003, IFSA.

[51]  Edoardo Provenzi,et al.  A Perceptually Inspired Variational Framework for Color Enhancement , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  S. Pizer,et al.  Adaptive grey level assignment in CT scan display. , 1984, Journal of computer assisted tomography.

[53]  Vijayan K. Asari,et al.  Adaptive and integrated neighborhood-dependent approach for nonlinear enhancement of color images , 2005, J. Electronic Imaging.

[54]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[55]  Marta Mrak,et al.  Reliability of Objective Picture Quality Measures , 2004 .

[56]  Gholamreza Anbarjafari,et al.  Satellite Image Contrast Enhancement Using Discrete Wavelet Transform and Singular Value Decomposition , 2010, IEEE Geoscience and Remote Sensing Letters.

[57]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[58]  Vijayan K. Asari,et al.  Nonlinear Enhancement of Extremely High Contrast Images for Visibility Improvement , 2006, ICVGIP.

[59]  A Hurlbert,et al.  Formal connections between lightness algorithms. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[60]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[61]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[62]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[63]  Vijayan K. Asari,et al.  Fast and robust wavelet-based dynamic range compression and contrast enhancement model with color restoration , 2009, Defense + Commercial Sensing.

[64]  Zia-ur Rahman,et al.  Statistics of visual representation , 2002, SPIE Defense + Commercial Sensing.

[65]  Sos S. Agaian,et al.  Contrast entropy based image enhancement and logarithmic transform coefficient histogram shifting , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[66]  Azeddine Beghdadi,et al.  Natural Rendering of Color Image based on Retinex , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[67]  Brian V. Funt,et al.  Analysis and Improvement of Multi-Scale Retinex , 1997, CIC.

[68]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[69]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[70]  Zia-ur Rahman,et al.  Multiscale retinex for color rendition and dynamic range compression , 1996, Optics & Photonics.

[71]  Sos S. Agaian,et al.  Multiscale image fusion using an adaptive similarity-based sensor weighting scheme and human visual system-inspired contrast measure , 2012, J. Electronic Imaging.