Hand-Held Monocular SLAM Based on Line Segments

This paper presents an approach of visual SLAM using line segments as primitives. We choose Plucker lines to represent spatial lines and derive a novel fast line projection function based on the relationship between Pl̈ucker line and Plucker matrix. During normal SLAM procedure, the Near by Line Tracking (NLT) method is adopted to track lines and an Extended Kalman Filter (EKF) is used to predict and update the state of the camera and line landmarks. After each update step, a robust spatial line reconstruction algorithm is used to find new line landmarks and to add them into the map. The SLAM procedure is under supervision and when failure is detected, a recovery method based on the angle histogram of key frames is adopted to relocalize the camera and re-start the SLAM procedure. We demonstrate that our monocular SLAM system is robust to illumination change, partial occlusion and fast camera motion.

[1]  Mongi A. Abidi,et al.  Pose and motion estimation from vision using dual quaternion-based extended kalman filtering , 1997 .

[2]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michel Dhome,et al.  Monocular Vision Based SLAM for Mobile Robots , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Simon Lacroix,et al.  Monocular-vision based SLAM using Line Segments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Tom Drummond,et al.  Edge landmarks in monocular SLAM , 2009, Image Vis. Comput..

[6]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  David W. Murray,et al.  Improving the Agility of Keyframe-Based SLAM , 2008, ECCV.

[8]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[9]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  H. Opower Multiple view geometry in computer vision , 2002 .

[11]  Dewen Hu,et al.  Strapdown inertial navigation system algorithms based on dual quaternions , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Ian D. Reid,et al.  Real-Time SLAM Relocalisation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Manuel Menezes de Oliveira Neto,et al.  Real-time line detection through an improved Hough transform voting scheme , 2008, Pattern Recognit..

[14]  Gabriele Bleser,et al.  Towards visual-inertial SLAM for mobile augmented reality , 2009 .

[15]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Walterio W. Mayol-Cuevas,et al.  Real-Time Model-Based SLAM Using Line Segments , 2006, ISVC.

[18]  Ian D. Reid,et al.  Real-Time Monocular SLAM with Straight Lines , 2006, BMVC.