Infrared and visible images registration using BEMD and MI

Enhanced vision especially in poor weather conditions can be achieved by image fusion between the infrared and visible images. Image registration is a crucial step in image fusion. In order to register the infrared and visible images captured in poor weather conditions, the registration method combing the Bidimensional Empirical Model Decomposition (BEMD) with mutual information is proposed in this paper. After the infrared and visible images are decomposed into a set of Intrinsic Mode Functions (IMFs) and residue respectively by BEMD, the parameters of affine transform can be obtained through using the maximum mutual information registration between IMFs images. Then, the transform matrix defined by these parameters is used to the source infrared image and the final registered image can be obtained through interpolation and resampling for the transformed image. This method is used to register two video sequences captured in dense fog. Experimental results show that this method gives better performance compared to other two methods.

[1]  Wang Xiaotong,et al.  Neighborhood Limited Empirical Mode Decomposition and Application in Image Processing , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[2]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[3]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[4]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[5]  Lihua Yang,et al.  Signal period analysis based on Hilbert-Huang transform and its application to texture analysis , 2004, Third International Conference on Image and Graphics (ICIG'04).

[6]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[7]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[8]  Jianguo Chen,et al.  Fusion of the Infrared and Color Visible Images Using Bidimensional EMD , 2008, 2008 International Conference on MultiMedia and Information Technology.

[9]  Andreas Koschan,et al.  Image Fusion and Enhancement via Empirical Mode Decomposition , 2006 .

[10]  A. Linderhed.  Image Compression based on Empirical Mode Decomposition , .

[11]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..