Infrared Image Enhancement based on Saliency Weight with Adaptive Threshold

Raw infrared images suffer the problem of low contrast. In this paper, a novel saliency weight based infrared image enhancement method is proposed. For the purpose of preserving the relative thermal distribution information, global-mapping enhancement is preferred in this work. To address the problem of under-enhancement on object areas in probability-histogram based methods, the spatial saliency information is utilized to develop a new weight of intensity levels for global-mapping to take the place of occurrence probability, named saliency weight. In the saliency weight, the weight values of objects-related intensity levels are larger than the values of background-related intensity levels, providing the basis to enhance objects. Based on the saliency weight, the concept of object-salient contrast is proposed to measure the contrast between objects and background. Enhancement is modeled as an optimization of maximizing the object-salient contrast. An adaptive threshold is established for the saliency weight to modify the solution of optimization, which prevents the background from being over-suppressed. Image intensities are re-distributed based on the solution through global-mapping. Experimental results demonstrate that the proposed method obtains larger contrast between objects and background than traditional probability histogram based methods after enhancement.

[1]  James W. Davis,et al.  A Two-Stage Template Approach to Person Detection in Thermal Imagery , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[2]  Hui Wang,et al.  An analytical optimization model for infrared image enhancement via local context , 2017 .

[3]  Bo Zhou,et al.  A new adaptive contrast enhancement algorithm for infrared images based on double plateaus histogram equalization , 2012 .

[4]  Xiubao Sui,et al.  Display and detail enhancement for high-dynamic-range infrared images , 2011 .

[5]  Sung-Jea Ko,et al.  Novel contrast enhancement scheme for infrared image using detail-preserving stretching , 2011 .

[6]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[7]  Jun Huang,et al.  Infrared image enhancement algorithm based on adaptive histogram segmentation. , 2017, Applied optics.

[8]  Marco Diani,et al.  Dynamic range compression and contrast enhancement in IR imaging systems , 2007, SPIE Security + Defence.

[9]  Ning Liu,et al.  Detail enhancement for high-dynamic-range infrared images based on guided image filter , 2014 .

[10]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[11]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Qiong Song,et al.  High dynamic range infrared images detail enhancement based on local edge preserving filter , 2016 .

[13]  Ji Zhao,et al.  Non-rigid visible and infrared face registration via regularized Gaussian fields criterion , 2015, Pattern Recognit..

[14]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Lei Xiong,et al.  Dim infrared image enhancement based on convolutional neural network , 2018, Neurocomputing.

[16]  Xiubao Sui,et al.  Range Limited Bi-Histogram Equalization for image contrast enhancement , 2013 .

[17]  Marco Diani,et al.  Dynamic-range compression and contrast enhancement in infrared imaging systems , 2008 .

[18]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[19]  Xiaolin Wu,et al.  A Linear Programming Approach for Optimal Contrast-Tone Mapping , 2011, IEEE Transactions on Image Processing.

[20]  Virgil E. Vickers,et al.  Plateau equalization algorithm for real-time display of high-quality infrared imagery , 1996 .

[21]  Y. Rao,et al.  Generalized Equalization Model for Image Enhancement , 2016 .

[22]  M. Hogervorst,et al.  Progress in color night vision , 2012 .