Localization of Mobile Robots Using Odometry and an External Vision Sensor

This paper presents a sensor system for robot localization based on the information obtained from a single camera attached in a fixed place external to the robot. Our approach firstly obtains the 3D geometrical model of the robot based on the projection of its natural appearance in the camera while the robot performs an initialization trajectory. This paper proposes a structure-from-motion solution that uses the odometry sensors inside the robot as a metric reference. Secondly, an online localization method based on a sequential Bayesian inference is proposed, which uses the geometrical model of the robot as a link between image measurements and pose estimation. The online approach is resistant to hard occlusions and the experimental setup proposed in this paper shows its effectiveness in real situations. The proposed approach has many applications in both the industrial and service robot fields.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[3]  Rüdiger Dillmann,et al.  MEPHISTO: A Modular and Existensible Path Planning System Using Observation , 1999, ICVS.

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[6]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Kunikatsu Takase,et al.  Trajectory tracking control of a nonholonomic mobile robot using iGPS and odometry , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[9]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[10]  Manuel Mazo,et al.  Mobile Robot Geometry Initialization from Single Camera , 2007, FSR.

[11]  Axel Pinz,et al.  Globally Optimal O(n) Solution to the PnP Problem for General Camera Models , 2008, BMVC.

[12]  Friedrich M. Wahl,et al.  Camera-based observation of obstacle motions to derive statistical data for mobile robot motion planning , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  Joo-Ho Lee,et al.  Intelligent Space — concept and contents , 2002, Adv. Robotics.

[14]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[15]  Namgyu Kim,et al.  POSTRACK: a low cost real-time motion tracking system for VR application , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[16]  Hideki Hashimoto,et al.  Global Color Model Based Object Matching in the Multi-Camera Environment , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Vincent Lepetit,et al.  Accurate Non-Iterative O(n) Solution to the PnP Problem , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  José Luis Lázaro,et al.  Guidance of a mobile robot using an array of static cameras located in the environment , 2007, Auton. Robots.

[19]  John J. Leonard,et al.  Cooperative AUV Navigation Using a Single Surface Craft , 2009, FSR.

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[22]  David W. Murray,et al.  Simultaneous Localization and Map-Building Using Active Vision , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Hiroshi Ishiguro,et al.  Acquisition of Qualitative Spatial Representation by Visual Observation , 1999, IJCAI.

[24]  Adam W. Hoover,et al.  Sensor network perception for mobile robotics , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).