LWIR and MWIR Images Fusion Method Based on the TV Model and Saliency Analysis

Medium and Long wave infrared images are widely used in maritime target detection. However, the target detection effect is seriously affected by noise due to the incompleteness and blurry edges of the target in the image. Combined with the total variation model and significance analysis, we proposed a NSCT-based LWIR and MWIR image fusion method, to improve the salience of the target and detail information in the fusion image. The TV model maintains the same LWIR grayscale and preserve the coarse texture of MWIR in fusion images. Saliency analysis construct the weight map which retains the significant fine details of LWIR and MWIR images in the final result. Experimental results indicate that our method outperform other three commonly used method both in visual and evaluation metric aspects.

[1]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[2]  Kishore Rajendiran,et al.  Infrared and visible image fusion using discrete cosine transform and swarm intelligence for surveillance applications , 2018 .

[3]  Fangyu Hu,et al.  Multi-scale decomposition based fusion of infrared and visible image via total variation and saliency analysis , 2018, Infrared Physics & Technology.

[4]  Sannyuya Liu,et al.  RISIR: Rapid Infrared Spectral Imaging Restoration Model for Industrial Material Detection in Intelligent Video Systems , 2019, IEEE Transactions on Industrial Informatics.

[5]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[6]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[7]  Javad Alirezaie,et al.  Pixel level jointed sparse representation with RPCA image fusion algorithm , 2015, 2015 38th International Conference on Telecommunications and Signal Processing (TSP).

[8]  Chunming Wu,et al.  Infrared and visible image fusion method of dual NSCT and PCNN , 2020, PloS one.

[9]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[10]  Wanlin Gao,et al.  A novel multi-source image fusion method for pig-body multi-feature detection in NSCT domain , 2020, Multimedia Tools and Applications.

[11]  T. Jayakumar,et al.  Medical applications of infrared thermography: A review , 2012, Infrared Physics & Technology.

[12]  Shaowen Yao,et al.  A survey of infrared and visual image fusion methods , 2017 .

[13]  Baohua Zhang,et al.  A fusion algorithm for infrared and visible images based on saliency analysis and non-subsampled Shearlet transform , 2015 .

[14]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[15]  Yuejin Zhao,et al.  Short-wave infrared, medium-wave infrared, and long-wave infrared imaging study for optical readout microcantilever array infrared sensing system , 2013 .

[16]  Wei Huang,et al.  An improved fusion algorithm for infrared and visible images based on multi-scale transform , 2016 .

[17]  J.F. Head,et al.  Infrared imaging: making progress in fulfilling its medical promise , 2002, IEEE Engineering in Medicine and Biology Magazine.

[18]  Yang Lei,et al.  Fusion method for infrared and visible images based on improved quantum theory model , 2016, Neurocomputing.

[19]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[20]  Quan Wang,et al.  Multifocus Color Image Fusion Based on NSST and PCNN , 2016, J. Sensors.

[21]  E. Smidt,et al.  Classification of waste materials using Fourier transform infrared spectroscopy and soft independent modeling of class analogy. , 2008, Waste management.

[22]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[23]  Eleuterio F. Toro,et al.  A weighted average flux method for hyperbolic conservation laws , 1989, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[24]  Fuad E. Alsaadi,et al.  Dynamic event-triggered mechanism for H∞ non-fragile state estimation of complex networks under randomly occurring sensor saturations , 2020, Inf. Sci..

[25]  OsherStanley,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[26]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[27]  Xiangzhi Bai,et al.  High frequency assisted fusion for infrared and visible images through sparse representation , 2019, Infrared Physics & Technology.

[28]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .