Extracting and Matching Lines of Low-Textured Region in Close-Range Navigation for Tethered Space Robot

When dealing with lines in regions with sparse texture, such as satellite's brackets, some existing line matching methods do not work well due to the incorrect location of line endpoints and line fragments. In this paper, we study how to automatically match low-textured lines. The designed feature only uses their neighborhood appearance and there are no any other prior knowledge or constraints needed. We combine point and line features to propose a novel line matching method. It includes the following three main steps. First, line extraction based on pixel gradient is adopted and we design a mergence strategy to ensure continuity. Then, line-point invariant and center-symmetric local binary pattern descriptor are combined together to represent lines. Last, two corresponding criterions are designed to measure the similarities between each pair images. Extensive experiments on real and synthetic images show that our proposed method exceeds the reference methods in performance under scale, illumination, and dynamic cases.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Alper Yilmaz,et al.  Line Matching in Wide-Baseline Stereo: A Top-Down Approach , 2014, IEEE Transactions on Image Processing.

[3]  Kuk-Jin Yoon,et al.  Real-time line matching from stereo images using a nonparametric transform of spatial relations and texture information , 2015 .

[4]  Manolis I. A. Lourakis,et al.  Matching disparate views of planar surfaces using projective invariants , 2000, Image Vis. Comput..

[5]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[6]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[7]  Horst Bischof,et al.  Efficient 3D scene abstraction using line segments , 2017, Comput. Vis. Image Underst..

[8]  Yu Liu,et al.  Autonomous target capturing of free-floating space robot: Theory and experiments , 2009, Robotica.

[9]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  Gaurav Gupta,et al.  Region growing stereo matching method for 3D building reconstruction , 2011, Int. J. Comput. Vis. Robotics.

[11]  Xinwu Liang,et al.  Visual Servoing of Soft Robot Manipulator in Constrained Environments With an Adaptive Controller , 2017, IEEE/ASME Transactions on Mechatronics.

[12]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jia Liu,et al.  Movement Control and Attitude Adjustment of Climbing Robot on Flexible Surfaces , 2018, IEEE Transactions on Industrial Electronics.

[14]  Zhanyi Hu,et al.  Robust line matching through line-point invariants , 2012, Pattern Recognit..

[15]  Raj Gupta,et al.  Robust order-based methods for feature description , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Cordelia Schmid,et al.  The Geometry and Matching of Lines and Curves Over Multiple Views , 2000, International Journal of Computer Vision.

[17]  Zhongli Wang,et al.  A New Approach to Dynamic Eye-in-Hand Visual Tracking Using Nonlinear Observers , 2011, IEEE/ASME Transactions on Mechatronics.

[18]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[20]  Heng Yang,et al.  A line matching method based on local and global appearance , 2011, 2011 4th International Congress on Image and Signal Processing.

[21]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[22]  Hesheng Wang,et al.  Visual servoing of robots with uncalibrated robot and camera parameters , 2012 .

[23]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[24]  Luc Van Gool,et al.  3D from Line Segments in Two Poorly-Textured, Uncalibrated Images , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[25]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Qiong Yan,et al.  Cascade Residual Learning: A Two-Stage Convolutional Neural Network for Stereo Matching , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[27]  Gangqi Dong,et al.  Position-based visual servo control of autonomous robotic manipulators , 2015 .

[28]  Alexander M. Bronstein,et al.  Are MSER Features Really Interesting? , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Éric Marchand,et al.  3-D Model-Based Tracking for UAV Indoor Localization , 2015, IEEE Transactions on Cybernetics.

[30]  Michael Werman,et al.  A Linear Time Histogram Metric for Improved SIFT Matching , 2008, ECCV.

[31]  Panfeng Huang,et al.  Novel Method of Monocular Real-Time Feature Point Tracking for Tethered Space Robots , 2014 .

[32]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[33]  Lu Wang,et al.  Wide-baseline image matching using Line Signatures , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Xinyu Wu,et al.  Multi-stream deep networks for human action classification with sequential tensor decomposition , 2017, Signal Process..

[35]  C. Schmid,et al.  Description of Interest Regions with Center-Symmetric Local Binary Patterns , 2006, ICVGIP.

[36]  Ana Cristina Murillo,et al.  SURF features for efficient robot localization with omnidirectional images , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[37]  Bin Zhang,et al.  A TSR Visual Servoing System Based on a Novel Dynamic Template Matching Method † , 2015, Sensors.

[38]  Haibin Ling,et al.  An Efficient Earth Mover's Distance Algorithm for Robust Histogram Comparison , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Xuelong Li,et al.  Local Feature Based Geometric-Resistant Image Information Hiding , 2010, Cognitive Computation.

[40]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Reinhard Koch,et al.  An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency , 2013, J. Vis. Commun. Image Represent..

[42]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.