Image fusion based on non-negative matrix factorization and infrared feature extraction

A new effective fusion method based on non-negative matrix factorization (NMF) and infrared target extraction is presented for infrared and visible images fusion. The two source images are taken as original data in NMF analysis, from which the feature base containing the global features of the source images can be extracted. The feature base image is replaced by the adjusted visible image, which is histogram matched with the raw feature base. As non-negative matrix factorization image fusion algorithm lacks details, we introduce a local gradient as an active measure, and combine weighting and selection methods to fuse the visible image with the feature base image. Then the target regions from infrared image are segmented through edge detection, region growing and morphological processing methods. The segmented target regions are fused with the background regions of the feature base image. Experiment indicates that the proposed method is simple in calculation. And it can retain texture details of visible image, highlight the thermal target of infrared image and enhance the readability of source images.

[1]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[2]  Zheng Jian-rong Multi-spectral Image and Panchromatic Image Fusion Method Based on Non-negative Matrix Factorization , 2007 .

[3]  Xia Li-min Non-sampled Contourlet transform based fusion method for infrared and visible images , 2009 .

[4]  Alexandrina Rogozan,et al.  Visible-infrared fusion in the frame of an obstacle recognition system , 2010, 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR).

[5]  Liu Gui-xi,et al.  Multi-resolution Scheme Appropriate to Fusing Infrared and Visible LightImages , 2004 .

[6]  Chen Juan A Image Fusion Method Based on Non-negative Matrix Factorization and Infrared Feature , 2008 .

[7]  Luo Changgeng A Kind Algorithm of Infrared and Visible Images Fusion Based on Feature of Image , 2009 .

[8]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[9]  Liu Kun,et al.  Fusion of Infrared and Visible Light Images Based on Region Segmentation , 2009 .

[10]  Ma Miao Fusion Algorithm for Infrared and Visible Light Image Based on Object Extraction , 2010 .

[11]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[12]  Zhang Zeng-fang,et al.  Decision tree algorithm using attribute frequency splitting and information entropy discretization , 2009 .

[13]  Wu Jian-jun Analysis on image fusion rules based on wavelet transform , 2010 .