Infrared and visible image registration using feature and area for image fusion

An image registration method is proposed in this paper for accurately aligning two images of the same scene captured simultaneously by visible CCD and IR (infrared) cameras. In image fusion systems, CCD and IR sensors are physically aligned as closely as possible and yet significant image mis-alignment remains due to differences in field of view, lens distortion and other camera characteristics. So, affine transformation is considered for aligning two images. At first, the corresponding feature point pairs are selected manually and that are used to calculate transform coefficients. Then, the value of the transform coefficients are optimized further by MI (mutual information) in global image. After the unregistered image is transformed by optimal transform coefficients, the accurately registered image can be obtained. The experimental results demonstrate that this method can provide highly accurate registered images for image fusion.

[1]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[2]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[3]  J.P. Heather,et al.  Multimodal image registration with applications to image fusion , 2005, 2005 7th International Conference on Information Fusion.

[4]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[5]  P. Varshney,et al.  Automatic two-stage IR and MMW image registration algorithm for concealed weapons detection , 2001 .

[6]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.