Robust ground plane detection for obstacle avoidance of mobile robots using a monocular camera

This paper presents a vision-based obstacle avoidance design using a monocular camera onboard a mobile robot. An image processing procedure is developed to estimate distances between the robot and obstacles based-on inverse perspective transformation (IPT) in image plane. A robust image processing solution is proposed to detect and segment navigatable ground plane area within the camera view. The proposed method integrate robust feature matching with adaptive color segmentation for plane estimation and tracking to cope with variations in illumination and camera view. After IPT and ground region segmentation, a result similar to the occupancy grid map is obtained for mobile robot obstacle avoidance and navigation. Practical experimental results of a wheeled mobile robot show that the proposed imaging system successfully estimates distance of objects and avoid obstacles in an indoor environment.

[1]  Kai-Tai Song,et al.  Behavior Fusion of Robot Navigation Using a Fuzzy Neural Network , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Dorin Comaniciu,et al.  The Variable Bandwidth Mean Shift and Data-Driven Scale Selection , 2001, ICCV.

[3]  Ashutosh Saxena,et al.  High speed obstacle avoidance using monocular vision and reinforcement learning , 2005, ICML.

[4]  Markus Vincze,et al.  Towards detection of orthogonal planes in monocular images of indoor environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Manuela M. Veloso,et al.  Visual sonar: fast obstacle avoidance using monocular vision , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[6]  Li Hong,et al.  Segment-based stereo matching using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Atsushi Imiya,et al.  Dominant plane detection from optical flow for robot navigation , 2006, Pattern Recognit. Lett..

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Detecting coplanar feature points in handheld image sequences , 2007, VISAPP.

[10]  Toshiaki Kakinami,et al.  Improving backing-up manoeuvre safety with vision-based movement detection , 2007 .

[11]  Nicolas Simond,et al.  Obstacle detection from IPM and super-homography , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Baoxin Li,et al.  Robust Ground Plane Detection with Normalized Homography in Monocular Sequences from a Robot Platform , 2006, 2006 International Conference on Image Processing.

[13]  Zezhi Chen,et al.  Affine height landscapes for monocular mobile robot obstacle avoidance , 2003 .

[14]  Alberto Ortiz,et al.  Building a qualitative local occupancy grid in a new vision-based reactive navigation strategy for mobile robots , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[15]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[16]  Takashi Naito,et al.  Road region estimation using a sequence of monocular images , 2008, 2008 19th International Conference on Pattern Recognition.

[17]  Chung-Hao Chen,et al.  A Moving Object Tracked by A Mobile Robot with Real-Time Obstacles Avoidance Capacity , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Shin'ichi Yuta,et al.  Development of ultra-small lightweight optical range sensor system , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Baoxin Li,et al.  Homography-based ground detection for a mobile robot platform using a single camera , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[20]  John K. Tsotsos,et al.  Region Classification for Robust Floor Detection in Indoor Environments , 2009, ICIAR.

[21]  Hakil Kim,et al.  Layered ground floor detection for vision-based mobile robot navigation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.