Cross Fusion-Based Low Dynamic and Saturated Image Enhancement for Infrared Search and Tracking Systems

Unmanned aerial vehicles and battleships are equipped with the infrared search and tracking (IRST) systems for its mission to search and detect targets even in low visibility environments. However, infrared sensors are easily affected by diverse types of conditions, therefore most of IRST systems need to apply advanced contrast enhancement (CE) methods to cope with the low dynamic range of sensor output and image saturation. The general histogram equalization for infrared images has unwanted side effects such as low contrast expansion and saturation. Also, the local area processing for saturation reduction has been studied to solve the problems regarding the saturation and non-uniformity. We propose the cross fusion based adaptive contrast enhancement with three counter non-uniformity methods. We evaluate the proposed method and compare it with conventional CE methods using the discrete entropy, PSNR, SSIM, RMSE, and computation time indexes. We present the experimental results for images from various products using several datasets such as infrared, multi-spectral satellite, surveillance, general gray and color images, as well as video sequences. The results are compared using the integrated image quality measurement index and they show that the proposed method maintains its performance on various degraded datasets.

[1]  Eduardo Cabal-Yepez,et al.  A Fast Image Dehazing Algorithm Using Morphological Reconstruction , 2019, IEEE Transactions on Image Processing.

[2]  Xavier Maldague,et al.  Particle swarm optimization-based local entropy weighted histogram equalization for infrared image enhancement , 2018, Infrared Physics & Technology.

[3]  Min Young Kim,et al.  Anti-saturation and contrast enhancement technique using interlaced histogram equalization (IHE) for improving target detection performance of EO/IR images , 2017, 2017 17th International Conference on Control, Automation and Systems (ICCAS).

[4]  Rabab Kreidieh Ward,et al.  Fast Image/Video Contrast Enhancement Based on Weighted Thresholded Histogram Equalization , 2007, IEEE Transactions on Consumer Electronics.

[5]  Shi-Jinn Horng,et al.  Contrast in Haze Removal: Configurable Contrast Enhancement Model Based on Dark Channel Prior , 2019, IEEE Transactions on Image Processing.

[6]  Carlos Saavedra,et al.  Infrared light field imaging system free of fixed-pattern noise , 2017, Scientific Reports.

[7]  Zheng Liu,et al.  Pedestrian detection in thermal images using adaptive fuzzy C-means clustering and convolutional neural networks , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[8]  Shih-Chia Huang,et al.  Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting Distribution , 2013, IEEE Transactions on Image Processing.

[9]  Matej Kristan,et al.  Deformable Parts Correlation Filters for Robust Visual Tracking , 2016, IEEE Transactions on Cybernetics.

[10]  Biao Wang,et al.  Illumination Normalization Based on Weber's Law With Application to Face Recognition , 2011, IEEE Signal Processing Letters.

[11]  Saurabh Maheshwari,et al.  Contrast limited adaptive histogram equalization based enhancement for real time video system , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[12]  Jiri Matas,et al.  CDTB: A Color and Depth Visual Object Tracking Dataset and Benchmark , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Qian Chen,et al.  Image enhancement based on equal area dualistic sub-image histogram equalization method , 1999, IEEE Trans. Consumer Electron..

[15]  Yeong-Taeg Kim,et al.  Contrast enhancement using brightness preserving bi-histogram equalization , 1997 .

[16]  Haidi Ibrahim,et al.  Brightness Preserving Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[17]  Gholamreza Anbarjafari,et al.  Satellite Image Contrast Enhancement Using Discrete Wavelet Transform and Singular Value Decomposition , 2010, IEEE Geoscience and Remote Sensing Letters.

[18]  Shanto Rahman,et al.  An adaptive gamma correction for image enhancement , 2016, EURASIP J. Image Video Process..

[19]  Min Young Kim,et al.  Background Registration-Based Adaptive Noise Filtering of LWIR/MWIR Imaging Sensors for UAV Applications , 2017, Sensors.

[20]  Joseph D. Bronzino,et al.  Medical Infrared Imaging : Principles and Practices , 2012 .

[21]  Soon Ki Jung,et al.  Handcrafted and Deep Trackers: A Review of Recent Object Tracking Approaches , 2018, ArXiv.

[22]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Chung-Cheng Chiu,et al.  Contrast Enhancement Algorithm Based on Gap Adjustment for Histogram Equalization , 2016, Sensors.

[24]  D. Jayas,et al.  Applications of Thermal Imaging in Agriculture and Food Industry—A Review , 2011 .

[25]  Kan Ren,et al.  Unmanned Aerial Vehicle Video-Based Target Tracking Algorithm Using Sparse Representation , 2019, IEEE Internet of Things Journal.

[26]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.