Infrared Image Enhancement Using Adaptive Histogram Partition and Brightness Correction

Infrared image enhancement is a crucial pre-processing technique in intelligent urban surveillance systems for Smart City applications. Existing grayscale mapping-based algorithms always suffer from over-enhancement of the background, noise amplification, and brightness distortion. To cope with these problems, an infrared image enhancement method based on adaptive histogram partition and brightness correction is proposed. First, the grayscale histogram is adaptively segmented into several sub-histograms by a locally weighted scatter plot smoothing algorithm and local minima examination. Then, the fore-and background sub-histograms are distinguished according to a proposed metric called grayscale density. The foreground sub-histograms are equalized using a local contrast weighted distribution for the purpose of enhancing the local details, while the background sub-histograms maintain the corresponding proportions of the whole dynamic range in order to avoid over-enhancement. Meanwhile, a visual correction factor considering the property of human vision is designed to reduce the effect of noise during the procedure of grayscale re-mapping. Lastly, particle swarm optimization is used to correct the mean brightness of the output by virtue of a reference image. Both qualitative and quantitative evaluations implemented on real infrared images demonstrate the superiority of our method when compared with other conventional methods.

[1]  Xavier Maldague,et al.  Total Variation Regularization Term-Based Low-Rank and Sparse Matrix Representation Model for Infrared Moving Target Tracking , 2018, Remote. Sens..

[2]  P Willett,et al.  Development and validation of a genetic algorithm for flexible docking. , 1997, Journal of molecular biology.

[3]  Ashish Ghosh,et al.  Gray-level Image Enhancement By Particle Swarm Optimization , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[4]  Qian Chen,et al.  Image enhancement based on equal area dualistic sub-image histogram equalization method , 1999, IEEE Trans. Consumer Electron..

[5]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[6]  Jun Huang,et al.  Infrared image enhancement algorithm based on adaptive histogram segmentation. , 2017, Applied optics.

[7]  Rui Lai,et al.  A quantitative measure based infrared image enhancement algorithm using plateau histogram , 2010 .

[8]  W. Cleveland LOWESS: A Program for Smoothing Scatterplots by Robust Locally Weighted Regression , 1981 .

[9]  Bingjian Wang,et al.  A real-time contrast enhancement algorithm for infrared images based on plateau histogram , 2006 .

[10]  Hui Wang,et al.  An analytical optimization model for infrared image enhancement via local context , 2017 .

[11]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[12]  László Neumann,et al.  Global Contrast Factor - a New Approach to Image Contrast , 2005, CAe.

[13]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[14]  Xiubao Sui,et al.  Range Limited Bi-Histogram Equalization for image contrast enhancement , 2013 .

[15]  Xu Jun New enhancement algorithm for infrared image based on double plateaus histogram , 2008 .

[16]  Kok-Swee Sim,et al.  Infrared image enhancement using adaptive trilateral contrast enhancement , 2015, Pattern Recognit. Lett..

[17]  Lei Yang,et al.  Adaptive detection for infrared small target under sea-sky complex background , 2004 .

[18]  S.L. Ho,et al.  A particle swarm optimization method with enhanced global search ability for design optimizations of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[19]  Bo Zhou,et al.  A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization , 2012 .

[20]  Xiubao Sui,et al.  Display and detail enhancement for high-dynamic-range infrared images , 2011 .

[21]  M. Ali Akber Dewan,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[22]  Marco Diani,et al.  A Flexible Algorithm for Detecting Challenging Moving Objects in Real-Time within IR Video Sequences , 2017, Remote. Sens..

[23]  Julie Delon,et al.  A Nonparametric Approach for Histogram Segmentation , 2007, IEEE Transactions on Image Processing.

[24]  Guohua Gu,et al.  Infrared small target enhancement: grey level mapping based on improved sigmoid transformation and saliency histogram , 2018 .

[25]  L JayaV.,et al.  IEM: A New Image Enhancement Metric for Contrast and Sharpness Measurements , 2013 .

[26]  Subramaniam Parasuraman,et al.  Contrast enhancement and brightness preserving of digital mammograms using fuzzy clipped contrast-limited adaptive histogram equalization algorithm , 2016, Appl. Soft Comput..

[27]  R. Vidhya,et al.  Satellite Image Contrast Enhancement using Multiwavelets and Singular value Decomposition (SVD) , 2011 .

[28]  Nor Ashidi Mat Isa,et al.  Adaptive Image Enhancement based on Bi-Histogram Equalization with a clipping limit , 2014, Comput. Electr. Eng..

[29]  Qian Chen,et al.  Robust infrared small target detection via non-negativity constraint-based sparse representation. , 2016, Applied optics.

[30]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[31]  Abd. Rahman Ramli,et al.  Minimum mean brightness error bi-histogram equalization in contrast enhancement , 2003, IEEE Trans. Consumer Electron..

[32]  Abd. Rahman Ramli,et al.  Contrast enhancement using recursive mean-separate histogram equalization for scalable brightness preservation , 2003, IEEE Trans. Consumer Electron..

[33]  Virgil E. Vickers,et al.  Plateau equalization algorithm for real-time display of high-quality infrared imagery , 1996 .

[34]  Lixia Chen,et al.  Contrast enhancement using feature-preserving bi-histogram equalization , 2017, Signal, Image and Video Processing.

[35]  Gyu-Hee Park,et al.  A fast contrast enhancement method for forward looking infrared imaging system , 2009, 2009 34th International Conference on Infrared, Millimeter, and Terahertz Waves.

[36]  P. Shanmugavadivu,et al.  Particle swarm optimized bi-histogram equalization for contrast enhancement and brightness preservation of images , 2013, The Visual Computer.

[37]  Xin-She Yang,et al.  Bat algorithm: a novel approach for global engineering optimization , 2012, 1211.6663.

[38]  Chih-Lung Lin,et al.  An approach to adaptive infrared image enhancement for long-range surveillance , 2011 .

[39]  Mohsen Ebrahimi Moghaddam,et al.  An image contrast enhancement method based on genetic algorithm , 2010, Pattern Recognit. Lett..

[40]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[41]  Xiangzhi Bai,et al.  Image enhancement using multi scale image features extracted by top-hat transform , 2012 .

[42]  Y. Y. Tan,et al.  Recursive sub-image histogram equalization applied to gray scale images , 2007, Pattern Recognit. Lett..

[43]  Yi Li,et al.  Infrared image enhancement based on atmospheric scattering model and histogram equalization , 2016 .

[44]  Guohua Gu,et al.  Infrared Small Moving Target Detection via Saliency Histogram and Geometrical Invariability , 2017 .