Oriented Edge-Based Feature Descriptor for Multi-Sensor Image Alignment and Enhancement

In this paper, we present an efficient image alignment and enhancement method for multi-sensor images. The shape of the object captured in a multi-sensor images can be determined by comparing variability of contrast using corresponding edges across multi-sensor image. Using this cue, we construct a robust feature descriptor based on the magnitudes of the oriented edges. Our proposed method enables fast image alignment by identifying matching features in multi-sensor images. We enhance the aligned multi-sensor images through the fusion of the salient regions from each image. The results of stitching the multi-sensor images and their enhancement demonstrate that our proposed method can align and enhance multi-sensor images more efficiently than previous methods.

[1]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[2]  Sabine Süsstrunk,et al.  Color image dehazing using the near-infrared , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ravi K. Sharma,et al.  Registration of video sequences from multiple sensors , 1997 .

[5]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Xiaopeng Zhang,et al.  Enhancing photographs with Near Infra-Red images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[9]  Cheng-Chang Lu,et al.  Multi-modality Image Registration Using Mutual Information Based on Gradient Vector Flow , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Xiuqiong Zhang.  Comparison of EMD Based Image Fusion Methods , 2009, 2009 International Conference on Computer and Automation Engineering.

[13]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[14]  Albert C. S. Chung,et al.  Multi-dimensional Mutual Information Based Robust Image Registration Using Maximum Distance-Gradient-Magnitude , 2005, IPMI.

[15]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[16]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.