Airborne Infrared and Visible Image Fusion for Target Perception Based on Target Region Segmentation and Discrete Wavelet Transform

Infrared and visible image fusion is an important precondition of realizing target perception for unmanned aerial vehicles (UAVs), then UAV can perform various given missions. Information of texture and color in visible images are abundant, while target information in infrared images is more outstanding. The conventional fusion methods are mostly based on region segmentation; as a result, the fused image for target recognition could not be actually acquired. In this paper, a novel fusion method of airborne infrared and visible image based on target region segmentation and discrete wavelet transform (DWT) is proposed, which can gain more target information and preserve more background information. The fusion experiments are done on condition that the target is unmoving and observable both in visible and infrared images, targets are moving and observable both in visible and infrared images, and the target is observable only in an infrared image. Experimental results show that the proposed method can generate better fused image for airborne target perception.

[1]  X. Rong Li,et al.  UAV Route Planning for Joint Search and Track Missions—An Information-Value Approach , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Liu Kun,et al.  Fusion of Infrared and Visible Light Images Based on Region Segmentation , 2009 .

[3]  Tao Men,et al.  Comparison of fusion methods for the infrared and color visible images , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[4]  Yi Shen,et al.  Comparisons of Several Pixel-Level Image Fusion Schemes for Infrared and Visible Light Images , 2005, 2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.

[5]  Guofan Jin,et al.  One color contrast enhanced infrared and visible image fusion method , 2010 .

[6]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[7]  Jianwei Zhang,et al.  A Hierarchical Model Incorporating Segmented Regions and Pixel Descriptors for Video Background Subtraction , 2012, IEEE Transactions on Industrial Informatics.

[8]  Shengyong Chen,et al.  Information and Modeling in Complexity , 2012 .

[9]  Qiang Zhang,et al.  Region-based fusion of infrared and visible images using nonsubsampled contourlet transform , 2008 .

[10]  Shao Zhenfeng,et al.  Fusion of infrared and visible images based on focus measure operators in the curvelet domain. , 2012, Applied optics.

[11]  Carlo Cattani,et al.  On the Discrete Harmonic Wavelet Transform , 2008 .

[12]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[13]  Shengyong Chen,et al.  Normalized weighted shape context and its application in feature-based matching , 2008 .

[14]  Fenghui Yao,et al.  Multi-source Airborne IR and Optical Image Fusion and Its Application to Target Detection , 2008, ISVC.

[15]  Karim Faez,et al.  Infrared and visible image fusion using fuzzy logic and population-based optimization , 2012, Appl. Soft Comput..

[16]  Liang Hong,et al.  Fusion of Infrared and Visible Image Based on Genetic Algorithm and Data Assimilation , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[17]  Benkang Chang,et al.  Objective quality evaluation of visible and infrared color fusion image , 2011 .

[18]  Mohan Malkani,et al.  Real-Time Multiple Moving Targets Detection from Airborne IR Imagery by Dynamic Gabor Filter and Dynamic Gaussian Detector , 2010, EURASIP J. Image Video Process..

[19]  Mohan Malkani,et al.  A novel method for real-time multiple moving targets detection from moving IR camera , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[21]  Shengyong Chen,et al.  Key Issues in Modeling of Complex 3D Structures from Video Sequences , 2012 .