Dim infrared image enhancement based on convolutional neural network

Abstract Long-range infrared images are always suffering from dim targets and background clutters. To improve the contrast between target and background, we propose a novel infrared image enhancement approach by highlighting target and suppressing background clutters. Predicting the target and background plays a key role in improving the contrast of dim infrared images that targets are embedded by background clutters. Taking full advantage of machine learning on prediction, we design the convolutional neural network (CNN) architecture in our study. To overcome the lack of large training data, the handwritten images in MNIST dataset are employed to simulate the properties of long-rang infrared images including dim targets, background clutters and low contrast. The target and background sub-images are predicted from the original dim infrared image based on the filters in the first layer of the trained CNN. Finally, the dim infrared image is enhanced by amplifying the targets and subtracting background clutters. The results of subjective and quantitative tests prove the performance of the proposed algorithm in contrast improvement.

[1]  Debasis Chaudhuri,et al.  Frequency and Spatial Domains Adaptive-based Enhancement Technique for Thermal Infrared Images , 2014 .

[2]  Qi Li,et al.  A novel method of infrared image denoising and edge enhancement , 2008, Signal Process..

[3]  Xiangzhi Bai,et al.  Analysis of new top-hat transformation and the application for infrared dim small target detection , 2010, Pattern Recognit..

[4]  M. Ravishankar,et al.  Modified Contrast Limited Adaptive Histogram Equalization Based on Local Contrast Enhancement for Mammogram Images , 2013 .

[5]  P. Coppo,et al.  Simulation of fire detection by infrared imagers from geostationary satellites , 2015 .

[6]  X. BAI Morphological enhancement of microscopy mineral image using opening‐ and closing‐based toggle operator , 2014, Journal of microscopy.

[7]  Qi Li,et al.  Infrared image enhancement through saliency feature analysis based on multi-scale decomposition , 2014 .

[8]  Tae-Wuk Bae,et al.  Small target detection using bilateral filter and temporal cross product in infrared images , 2011 .

[9]  Martin A. Riedmiller,et al.  Improving Deep Neural Networks with Probabilistic Maxout Units , 2013, ICLR.

[10]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yanchun Liang,et al.  A Fuzzy-Statistics-Based Principal Component Analysis (FS-PCA) Method for Multispectral Image Enhancement and Display , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Wei Zhang,et al.  A novel image enhancement algorithm based on stationary wavelet transform for infrared thermography to the de-bonding defect in solid rocket motors , 2015 .

[13]  Lei Xiong,et al.  Infrared image enhancement based on novel multiscale feature prior , 2017 .

[14]  Chun-Nian Fan,et al.  Homomorphic filtering based illumination normalization method for face recognition , 2011, Pattern Recognit. Lett..

[15]  Mukund Seshadri,et al.  Manganese-doped near-infrared emitting nanocrystals for in vivo biomedical imaging. , 2016, Optics express.

[16]  Mohan M. Trivedi,et al.  A neural network filter to detect small targets in high clutter backgrounds , 1995, IEEE Trans. Neural Networks.

[17]  Nicholas G. Paulter,et al.  Tasking on Natural Statistics of Infrared Images , 2016, IEEE Transactions on Image Processing.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Shan Gao,et al.  Low-level structure feature extraction for image processing via stacked sparse denoising autoencoder , 2017, Neurocomputing.

[20]  Xin Zhou,et al.  Entropy-based window selection for detecting dim and small infrared targets , 2017, Pattern Recognit..

[21]  Chen Wang,et al.  A Kernel-Based Nonparametric Regression Method for Clutter Removal in Infrared Small-Target Detection Applications , 2010, IEEE Geoscience and Remote Sensing Letters.

[22]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[23]  Eric Moulines,et al.  Detecting aircraft with a low resolution infrared sensor , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Yi Wan,et al.  Joint Exact Histogram Specification and Image Enhancement Through the Wavelet Transform , 2007, IEEE Transactions on Image Processing.

[25]  Duyan Bi,et al.  Adaptive enhancement for infrared image using shearlet frame , 2016 .

[26]  Tae-Seong Kim,et al.  Vessel enhancement filter using directional filter bank , 2009, Comput. Vis. Image Underst..

[27]  Ronald G Driggers,et al.  Performance of infrared systems in swimmer detection for maritime security. , 2007, Optics express.

[28]  Xiangzhi Bai,et al.  Image enhancement using multi scale image features extracted by top-hat transform , 2012 .

[29]  Ezzatollah Salari,et al.  Small dim object tracking using frequency and spatial domain information , 2016, Pattern Recognit..

[30]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[31]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[32]  Jinwen Tian,et al.  Infrared small target detection using directional highpass filters based on LS-SVM , 2009 .

[33]  Duyan Bi,et al.  Noise suppression and details enhancement for infrared image via novel prior , 2016 .