Vision-based self-localization of a mobile robot using a virtual environment

This paper presents a method for position estimation of mobile robots based on the comparison of real camera snapshots taken by an on-board camera and images taken by a virtual camera in a virtual environment. We propose a technique for texturing planar walls of a 3D model of the operating environment and make use of this model for improving operator situation awareness as well as robot self-localization. By applying texture created from camera snapshots a more realistic impression of the environment can be obtained, so that the virtual environment could even be used for inspection tasks. Furthermore, the texture provides additional structure which is especially useful in hallways that contain only few hints for robot navigation.

[1]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[2]  Butler Hine,et al.  VEVI: A Virtual Reality Tool For Robotic Planetary Explorations , 1994 .

[3]  Yehezkel Yeshurun,et al.  Cepstral Filtering on a Columnar Image Architecture: A Fast Algorithm for Binocular Stereo Segmentation , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Reinhard Koch,et al.  Flexible 3D acquisition with a monocular camera , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[5]  Michael Pauly.  Ferninspektion mit mobiler Sensorik , 1999, Künstliche Intell..

[6]  Javier González,et al.  Two-dimensional landmark-based position estimation from a single image , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[7]  K.-F. Kraiss,et al.  A mobile robot control centre for mission and data management , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[8]  U. Zimmermann,et al.  Detection and handling of moving objects , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).