Monocular Obstacle Detection for Real-World Environments

In this paper, we present a feature based approach for monocular scene reconstruction based on extended Kaiman filters (EKF). Our method processes a sequence of images taken by a single camera mounted in front of a mobile robot. Using various techniques we are able to produce a precise reconstruction that is almost free from outliers and therefore can be used for reliable obstacle detection and avoidance. In real-world field tests we show that the presented approach is able to detect obstacles that can not be seen by other sensors, such as laser range finders. Furthermore, we show that visual obstacle detection combined with a laser range finder can increase the detection rate of obstacles considerably, allowing the autonomous use of mobile robots in complex public and home environments.

[1]  Jean-Michel Jolion,et al.  Stereo Vision for Obstacle Detection: A Graph-Based Approach , 2007, GbRPR.

[2]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[4]  Kin Hong Wong,et al.  A fast recursive 3D model reconstruction algorithm for multimedia applications , 2004, ICPR 2004.

[5]  Horst-Michael Groß,et al.  ShopBot: Progress in developing an interactive mobile shopping assistant for everyday use , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[6]  Rüdiger Dillmann,et al.  Obstacle detection with a Photonic Mixing Device-camera in autonomous vehicles , 2008, Int. J. Intell. Syst. Technol. Appl..

[7]  Horst-Michael Groß,et al.  A Hybrid Kalman Filter Based Algorithm for Real-time Visual Obstacle Detection , 2007, EMCR.

[8]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[9]  Tom Drummond,et al.  Unified Loop Closing and Recovery for Real Time Monocular SLAM , 2008, BMVC.

[10]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[11]  Daniel Cremers,et al.  Realtime Depth Estimation and Obstacle Detection from Monocular Video , 2006, DAGM-Symposium.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Dariu Gavrila,et al.  Real-time dense stereo for intelligent vehicles , 2006, IEEE Transactions on Intelligent Transportation Systems.

[14]  Tom Drummond,et al.  Monocular SLAM as a Graph of Coalesced Observations , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.