On the real-time modelling of a robotic scene perception and estimation system

In this paper a real-time machine vision system for robotic scene perception and estimation is proposed. Its goal is to determine the 3D structure of the imaged scene together with the relative position and orientation of the robot with respect to the environment. Mainly, the vision system is composed of two basic elements: a 3D camera-scene depth computation method and a camera egomotion estimator. The image processing operations have been implemented into a sequential machine vision pipeline. A performance evaluation of the proposed approach is given through experimental results within an indoor environment.

[1]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[2]  S. Hussmann,et al.  Robot Vision System based on a 3D-TOF Camera , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[3]  Andrew J. Davison,et al.  Guest Editorial Special Issue on Visual SLAM , 2008 .

[4]  Heiko Wersing,et al.  Active 3D Object Localization Using a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[7]  Tom Drummond,et al.  Edge landmarks in monocular SLAM , 2009, Image Vis. Comput..

[8]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[10]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[11]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[12]  Special Issue on Visual SLAM , 2008 .

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Lina María Paz,et al.  Large-Scale 6-DOF SLAM With Stereo-in-Hand , 2008, IEEE Transactions on Robotics.

[15]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..