An Omnidirectional Vision-Based Moving Obstacle Detection in Mobile Robot

This paper presents a new moving obstacle detection method using an optical flow in mobile robot with an omnidirectional camera. Because an omnidirectional camera consists of a nonlinear mirror and CCD camera, the optical flow pattern in omnidirectional image is different from the pattern in perspective camera. The geometry characteristic of an omnidirectional camera has influence on the optical flow in omnidirectional image. When a mobile robot with an omnidirectional camera moves, the optical flow is not only theoretically calculated in omnidirectional image, but also investigated in omnidirectional and panoramic images. In this paper, the panoramic image is generalized from an omnidirectional image using the geometry of an omnidirectional camera. In particular, Focus of expansion (FOE) and focus of contraction (FOC) vectors are defined from the estimated optical flow in omnidirectional and panoramic images. FOE and FOC vectors are used as reference vectors for the relative evaluation of optical flow. The moving obstacle is turned out through the relative evaluation of optical flows. The proposed algorithm is tested in four motions of a mobile robot including straight forward, left turn, right turn and rotation. The effectiveness of the proposed method is shown by the experimental results.

[1]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Hans J. Schneebeli,et al.  A general approach for egomotion estimation with omnidirectional images , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[3]  J. Gaspar,et al.  Omni-directional vision for robot navigation , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[4]  Sang Woo Kim,et al.  PID Control Design with Exhaustive Dynamic Encoding Algorithm for Searches (eDEAS) , 2007 .

[5]  S. Shankar Sastry,et al.  Infinitesimal motion estimation from multiple central panoramic views , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[6]  Seul Jung,et al.  Kinematics Analysis and Implementation of a Motion-Following Task for a Humanoid Slave Robot Controlled by an Exoskeleton Master Robot , 2007 .

[7]  Yasushi Yagi,et al.  Omnidirectional imaging with hyperboloidal projection , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[8]  Wolfram Burgard,et al.  Robust vision-based localization by combining an image-retrieval system with Monte Carlo localization , 2005, IEEE Transactions on Robotics.

[9]  K. Uchimura,et al.  Motion detection from a moving observer using pure feature matching , 2000 .

[10]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[11]  Manolis I. A. Lourakis,et al.  Independent 3D motion detection using residual parallax normal flow fields , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Rajeev Sharma,et al.  Early detection of independent motion from active control of normal image flow patterns , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Yasushi Yagi,et al.  Obstacle detection with omnidirectional image sensor HyperOmni Vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[14]  Kostas Daniilidis,et al.  Omnidirectional vision: theory and algorithms , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[15]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[16]  Harpreet S. Sawhney,et al.  Independent motion detection in 3D scenes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Irem Stratmann,et al.  Omnidirectional Vision and Inertial Clues for Robot Navigation , 2004, J. Field Robotics.

[18]  Laurent Delahoche,et al.  Mobile robot localization based on an omnidirectional stereoscopic vision perception system , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Emanuele Menegatti,et al.  A New Omnidirectional Vision Sensor for Monte-Carlo Localization , 2004, RoboCup.

[21]  Jongcheol Kim,et al.  Omnidirectional vision-based ego-pose estimation for an autonomous in-pipe mobile robot , 2007, Adv. Robotics.

[22]  Mutsumi Watanabe,et al.  Moving obstacle detection and recognition by optical flow pattern analysis for mobile robots , 1997, Adv. Robotics.

[23]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Yasushi Yagi,et al.  Iconic memory-based omnidirectional route panorama navigation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  U. Neumann,et al.  Large motion estimation for omnidirectional vision , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[26]  Yoshiaki Shirai,et al.  Mobile robot navigation in dynamic environments using omnidirectional stereo , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[27]  Irem Stratmann,et al.  Omnidirectional Vision and Inertial Clues for Robot Navigation , 2004 .

[28]  Larry H. Matthies,et al.  Real-time detection of moving objects in a dynamic scene from moving robotic vehicles , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[29]  Larry S. Davis,et al.  What can projections of flow fields tell us about the visual motion , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[30]  Tarak Gandhi,et al.  Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera , 2005, Machine Vision and Applications.