A grayscale weight with window algorithm for infrared and visible image registration

Abstract The registration of Infrared (IR) and visible images is an important prerequisite for image processing tasks such as image fusion, target detection and tracking, and remote sensing. The registration task of the IR and visible images usually involves two problems: (1) extracting consistent features from multi-sensor images is difficult and (2) similarity measurement methods such as normalized mutual information (NMI) algorithms are prone to falling into local extremities. To solve these complications, this study proposes a grayscale weight with window algorithm (GWW) to extract common strong edge features from IR and visible images, reduce the joint entropy values and local extreme values of NMI, and improve the performance of NMI to calculate IR and visible images for registration. Qualitative and quantitative experiments demonstrate that the GWW can effectively extract the common features of IR and visible image pairs, improve the performance of the surface peak, increase the ratio of primary and secondary peaks, and effectively reduce the local extremum. The performance of NMI combined with the GWW algorithm is better than the traditional MI, NMI, and ECC, and has better matching accuracy and higher matching probability. The registration of IR and visible images can be fully realized by NMI combined with the GWW algorithm.

[1]  Yantao Wei,et al.  An infrared small target detection method based on multiscale local homogeneity measure , 2018 .

[2]  K. W. Cattermole.  The Fourier Transform and its Applications , 1965 .

[3]  X. Li,et al.  Efficient fusion for infrared and visible images based on compressive sensing principle , 2011 .

[4]  Wen Gang Qin,et al.  Real-Time Registration Architecture for Far Infrared and Visible Image Using Mutual Information , 2010 .

[5]  Giorgio Panin,et al.  Mutual Information for Multi-modal, Discontinuity-Preserving Image Registration , 2012, ISVC.

[6]  Euntai Kim,et al.  Autonomous vehicle detection system using visible and infrared camera , 2012, 2012 12th International Conference on Control, Automation and Systems.

[7]  Xu Chen,et al.  Target detection via HSV color model and edge gradient information in infrared and visible image sequences under complicated background , 2018 .

[8]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[9]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[10]  Umesh Chandra Pati,et al.  Remote Sensing Optical Image Registration Using Modified Uniform Robust SIFT , 2016, IEEE Geoscience and Remote Sensing Letters.

[11]  Yue Qi,et al.  Infrared and visible image fusion method based on saliency detection in sparse domain , 2017 .

[12]  R. Bracewell.  The Fourier Transform and Its Applications , 1966 .

[13]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[14]  Jong Beom Ra,et al.  Robust multi-sensor image registration by enhancing statistical correlation , 2005, 2005 7th International Conference on Information Fusion.

[15]  LI Liang-fu.  Canny edge based registration algorithm of IR and visible images , 2009 .

[16]  Zhang Tian-wen.  Fusion and tracking for IR and visible images , 2005 .

[17]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[18]  Xing Zhang,et al.  Salient Feature Region: A New Method for Retinal Image Registration , 2011, IEEE Transactions on Information Technology in Biomedicine.

[19]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[21]  Fangyu Hu,et al.  Multi-scale decomposition based fusion of infrared and visible image via total variation and saliency analysis , 2018, Infrared Physics & Technology.

[22]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Sheng Li,et al.  Remote sensing image registration approach based on a retrofitted SIFT algorithm and Lissajous-curve trajectories. , 2010, Optics express.

[24]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[25]  Peter J. Gawthrop,et al.  Data compression for estimation of the physical parameters of stable and unstable linear systems , 2005, Autom..

[26]  Dongdong Yu,et al.  Fast Rotation-Free Feature-Based Image Registration Using Improved N-SIFT and GMM-Based Parallel Optimization , 2016, IEEE Transactions on Biomedical Engineering.