Sensor Fusion of Monocular Cameras and Laser Rangefinders for Line-Based Simultaneous Localization and Mapping (SLAM) Tasks in Autonomous Mobile Robots

This paper presents a sensor fusion strategy applied for Simultaneous Localization and Mapping (SLAM) in dynamic environments. The designed approach consists of two features: (i) the first one is a fusion module which synthesizes line segments obtained from laser rangefinder and line features extracted from monocular camera. This policy eliminates any pseudo segments that appear from any momentary pause of dynamic objects in laser data. (ii) The second characteristic is a modified multi-sensor point estimation fusion SLAM (MPEF-SLAM) that incorporates two individual Extended Kalman Filter (EKF) based SLAM algorithms: monocular and laser SLAM. The error of the localization in fused SLAM is reduced compared with those of individual SLAM. Additionally, a new data association technique based on the homography transformation matrix is developed for monocular SLAM. This data association method relaxes the pleonastic computation. The experimental results validate the performance of the proposed sensor fusion and data association method.

[1]  Kai-Yuan Cai,et al.  Multisensor Decision And Estimation Fusion , 2003, The International Series on Asian Studies in Computer and Information Science.

[2]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[3]  Wan Kyun Chung,et al.  Data Association Using Visual Object Recognition for EKF-SLAM in Home Environment , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[5]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[6]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Martin David Adams,et al.  Toward multidimensional assignment data association in robot localization and mapping , 2006, IEEE Transactions on Robotics.

[8]  Andrew J. Davison,et al.  Active matching for visual tracking , 2009, Robotics Auton. Syst..

[9]  G. Dissanayake,et al.  Vision-based SLAM using natural features in indoor environments , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[10]  Ben J. A. Kröse,et al.  Efficient data association for view based SLAM using connected dominating sets , 2009, Robotics Auton. Syst..

[11]  Teresa A. Vidal-Calleja,et al.  Undelayed initialization of line segments in monocular SLAM , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Kyoung Mu Lee,et al.  Visual SLAM with Line and Corner Features , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Simon Lacroix,et al.  Monocular-vision based SLAM using Line Segments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Lindsay Kleeman,et al.  Advanced sonar and laser range finder fusion for simultaneous localization and mapping , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[15]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[19]  Wolfram Burgard,et al.  Improving Data Association in Vision-based SLAM , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Tom Drummond,et al.  Scalable Monocular SLAM , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Walterio W. Mayol-Cuevas,et al.  Appearance Based Indexing for Relocalisation in Real-Time Visual SLAM , 2008, BMVC.

[22]  Tom Drummond,et al.  Edge landmarks in monocular SLAM , 2009, Image Vis. Comput..

[23]  Xinzheng Zhang,et al.  A Robust Regression Model for Simultaneous Localization and Mapping in Autonomous Mobile Robot , 2008, J. Intell. Robotic Syst..

[24]  Il Hong Suh,et al.  Building a partial 3D line-based map using a monocular SLAM , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Walterio W. Mayol-Cuevas,et al.  Real-Time Model-Based SLAM Using Line Segments , 2006, ISVC.

[26]  Ian D. Reid,et al.  Real-Time Monocular SLAM with Straight Lines , 2006, BMVC.

[27]  Javier Civera,et al.  Inverse Depth to Depth Conversion for Monocular SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[29]  Henrik I. Christensen,et al.  Vision SLAM in the Measurement Subspace , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  Kyoung Mu Lee,et al.  Monocular SLAM with locally planar landmarks via geometric rao-blackwellized particle filtering on Lie groups , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Frank Dellaert,et al.  Probabilistic structure matching for visual SLAM with a multi-camera rig , 2010, Comput. Vis. Image Underst..

[32]  James J. Little,et al.  Vision-based SLAM using the Rao-Blackwellised Particle Filter , 2005 .