A hierarchical graph matching based key point correspondence method for large distance rover localization

Key point correspondence plays a critical role in large distance lunar rover localization and navigation, which can decrease accumulative errors and facilitate the rover to approach probing target accurately. Lunar surface images often contain similar patterns, noisy points and obvious illumination changes, especially along with large distance movement, overlapping regions of image pairs have large deformations and sorely different scales. Traditional appearance based matching methods fail in such conditions as local appearance features become less distinctive. In this paper, we proposed a novel hierarchical graph matching strategy to fully utilize structure property of key points. For vertexes in bigger scale, their neighborhood graphs in smaller scale are regarded as vertex labels and the differences of neighborhood graphs are regarded as differences of vertexes. Based on the new strategy, both global and local constraint are considered such that the dependency on local appearance is alleviated. Furthermore, an active key point detection method is proposed to serve the graph matching method for better performance. Finally, several experiments are conducted on lunar surface images collected by Chang'E-3 rover, which demonstrates the robustness and effectiveness of the proposed method.

[1]  Larry H. Matthies,et al.  Visual odometry on the Mars Exploration Rovers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Kun Dai,et al.  Introducing projective transformations into lunar image correspondence for positioning large distance rover , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[3]  David A. Clausi,et al.  AISIR: Automated inter-sensor/inter-band satellite image registration using robust complex wavelet feature representations , 2010, Pattern Recognit. Lett..

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Jing Li,et al.  A positioning method of Chang'E-3 Rover in large-span states based on cylindrical projection of images , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[6]  Amir Averbuch,et al.  Multisensor image registration via implicit similarity , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[8]  Marios S. Pattichis,et al.  Robust Multispectral Image Registration Using Mutual-Information Models , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[10]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  Timothy D. Barfoot,et al.  VISUAL MOTION ESTIMATION AND TERRAIN MODELING FOR PLANETARY ROVERS , 2005 .

[12]  Hong Qiao,et al.  Introducing locally affine-invariance constraints into lunar surface image correspondence , 2016, Neurocomputing.

[13]  Eli Saber,et al.  A Spatial-Feature-Enhanced MMI Algorithm for Multimodal Airborne Image Registration , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Larry H. Matthies,et al.  Two years of Visual Odometry on the Mars Exploration Rovers , 2007, J. Field Robotics.

[15]  Kaichang Di,et al.  Photogrammetric processing of rover imagery of the 2003 Mars Exploration Rover mission , 2008 .

[16]  Siamak Khorram,et al.  A feature-based image registration algorithm using improved chain-code representation combined with invariant moments , 1999, IEEE Trans. Geosci. Remote. Sens..

[17]  Ian Dowman,et al.  An improved model for automatic feature-based registration of SAR and SPOT images , 2001 .