Real-Time Monocular SLAM With Low Memory Requirements

The localization of a vehicle in an unknown environment is often solved using simultaneous localization and mapping (SLAM) techniques. Many methods have been developed, each requiring a different amount of landmarks (map size), and thus of memory, to work efficiently. Similarly, the required computational time is quite variable from one approach to another. In this paper, we focus on a monocular SLAM problem and propose a new method called MSLAM, which is based on an extended Kalman filter (EKF). The aim is to provide a solution that has low memory and processing time requirements and that can achieve good localization results while benefiting from EKF advantages (i.e., direct access to the covariance matrix, no conversion required for the measures or the state, etc.). To do so, a minimal Cartesian representation (three parameters for three dimensions) is used. However, linearization errors are likely to happen with such a representation. New methods allowing to avoid or hugely decrease the impact of the linearization failures are presented. The first contribution proposed here computes a proper projection of a 3-D uncertainty in the image plane, allowing to track landmarks during longer periods of time. A corrective factor of the Kalman gain is also introduced. It allows to detect wrong updates and correct them, thus reducing the impact of the linearization on the whole system. Our approach is compared with a classic SLAM implementation over different data sets and conditions to illustrate the efficiency of the proposed contributions. The quality of the map built is tested by using it with another vehicle for localization purposes. Finally, a public data set presenting a long trajectory (1.3 km) is also used in order to compare MSLAM with a state-of-the-art monocular EKF-SLAM algorithm, both in terms of accuracy and computational needs.

[1]  Kostas E. Bekris,et al.  Evaluation of algorithms for bearing-only SLAM , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[3]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[4]  Walterio W. Mayol-Cuevas,et al.  Real-Time and Robust Monocular SLAM Using Predictive Multi-resolution Descriptors , 2006, ISVC.

[5]  N. Nathan Self and will , 1997 .

[6]  Tim Bailey Constrained initialisation for bearing-only SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[8]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[9]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[10]  Simon J. Julier,et al.  Avoiding negative depth in inverse depth bearing-only SLAM , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Gamini Dissanayake,et al.  Convergence and Consistency Analysis for Extended Kalman Filter Based SLAM , 2007, IEEE Transactions on Robotics.

[12]  Michel Devy,et al.  Undelayed initialization in bearing only SLAM , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Michel Dhome,et al.  Real Time Localization and 3D Reconstruction , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Matthew R. Walter,et al.  Exactly Sparse Extended Information Filters for Feature-based SLAM , 2007, Int. J. Robotics Res..

[15]  Lina María Paz,et al.  Divide and Conquer: EKF SLAM in O(n) , 2008, IEEE Trans. Robotics.

[16]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[18]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Teresa A. Vidal-Calleja,et al.  Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines , 2011, International Journal of Computer Vision.

[20]  Hauke Strasdat,et al.  Visual SLAM: Why filter? , 2012, Image Vis. Comput..

[21]  Romuald Aufrère,et al.  Improving results of rational non-linear observation functions using a Kalman filter correction , 2011, 14th International Conference on Information Fusion.

[22]  Michel Dhome,et al.  Localization in urban environments: monocular vision compared to a differential GPS sensor , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Gamini Dissanayake,et al.  An efficient multiple hypothesis filter for bearing-only SLAM , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[24]  Javier Civera,et al.  Inverse Depth to Depth Conversion for Monocular SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[25]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[26]  Romuald Aufrère,et al.  Parsimonious real time monocular SLAM , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[27]  Tom Drummond,et al.  Scalable Monocular SLAM , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[29]  A. Davison,et al.  1-Point RANSAC for EKF Filtering . Application to Real-Time Structure from Motion and Visual Odometry , 2010 .