Vision-based obstacle detection and avoidance for autonomous land vehicle navigation in outdoor roads

Abstract An effective approach to obstacle detection and avoidance for autonomous land vehicle (ALV) navigation in outdoor road environments using computer vision and image sequence techniques is proposed. To judge whether an object newly appearing in the image of the current cycle taken by the ALV is an obstacle, the object shape boundary is first extracted from the image. After the translation from the ALV location in the current cycle to that in the next cycle is estimated, the position of the object shape in the image of the next cycle is predicted, using coordinate transformation techniques based on the assumption that the height of the object is zero. The predicted object shape is then matched with the extracted shape of the object in the image of the next cycle to decide whether the object is an obstacle. We use a reasonable distance measure to compute the correlation measure between two shapes for shape matching. Finally, a safe navigation point is determined, and a turn angle is computed to guide the ALV toward the navigation point for obstacle avoidance. Successful navigation tests show that the proposed approach is effective for obstacle detection and avoidance in outdoor road environments.

[1]  Anthony Stentz,et al.  The CMU system for mobile robot navigation , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[2]  Yue Feng Wan,et al.  A new edge detector for obstacle detection with a linear stereo vision system , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[3]  Charles E. Thorpe,et al.  Outdoor visual navigation for autonomous robots , 1989, Robotics Auton. Syst..

[4]  Larry S. Davis.  Visual navigation at the University of Maryland , 1991, Robotics Auton. Syst..

[5]  B. Ulmer.  VITA-an autonomous road vehicle (ARV) for collision avoidance in traffic , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[6]  Takeo Kanade,et al.  Toward autonomous driving: the CMU Navlab. Part II - Architecture and Systems , 1991, IEEE Expert.

[7]  Dirk Dickmanns,et al.  Multiple object recognition and scene interpretation for autonomous road vehicle guidance , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[8]  Bir Bhanu,et al.  Inertial navigation sensor integrated motion analysis for autonomous vehicle navigation , 1992, J. Field Robotics.

[9]  W. von Seelen,et al.  Vision-based car-following: detection, tracking, and identification , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[10]  Michael Schmid.  An approach to model-based 3-D recognition of vehicles in real time by machine vision , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[11]  M. Campani,et al.  Detection of lane boundaries, intersections and obstacles , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[12]  Wen-Hsiang Tsai,et al.  Model-based guidance by the longest common subsequence algorithm for indoor autonomous vehicle navigation using computer vision , 1993 .

[13]  Darwin T. Kuan,et al.  Autonomous Robotic Vehicle Road Following , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Allen R. Hanson,et al.  Obstacle Detection Based on Qualitative and Quantitative 3D Reconstruction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  J.-G. Postaire,et al.  Disparity analysis for real time obstacle detection by linear stereovision , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[16]  Sanjiv Singh,et al.  Obstacle detection for high speed autonomous navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  W. Ritter,et al.  Obstacle detection based on color blob flow , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[18]  Wilfried Enkelmann,et al.  Obstacle detection by evaluation of optical flow fields from image sequences , 1990, Image Vis. Comput..

[19]  Martial Hebert,et al.  Vision and navigation for the Carnegie-Mellon Navlab , 1988 .

[20]  K. E. Olin,et al.  Autonomous cross-country navigation: an integrated perception and planning system , 1991, IEEE Expert.

[21]  Stephen Warshall,et al.  A Theorem on Boolean Matrices , 1962, JACM.

[22]  Wen-Hsiang Tsai,et al.  Autonomous land vehicle guidance for navigation in buildings by computer vision, radio, and photoelectric sensing techniques , 1994 .

[23]  Wen-Hsiang Tsai,et al.  Automatic Chinese seal identification , 1984, Comput. Vis. Graph. Image Process..

[24]  Volker Graefe,et al.  Automatic recognition of vehicles approaching from behind , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[25]  Volker Graefe,et al.  Visual recognition of obstacles on roads , 1994, IEEE/RJS International Conference on Intelligent RObots and Systems.

[26]  Minoru Asada,et al.  Scene Interpretation Using 3-D Information Extracted From Monocular Color Images , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Jean-Luc Bruyelle,et al.  Direct range measurement by linear stereovision for real-time obstacle detection in road traffic , 1993, Robotics Auton. Syst..

[28]  Matthew Turk,et al.  VITS-A Vision System for Autonomous Land Vehicle Navigation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Wen-Hsiang Tsai,et al.  Vision-based autonomous land vehicle guidance in outdoor road environments using combined line and road following techniques , 1997 .

[30]  Takeo Kanade,et al.  Toward autonomous driving: the CMU Navlab. Part I - Perception , 1991, IEEE Expert.

[31]  J. M. Brady,et al.  A scene segmenter; visual tracking of moving vehicles , 1994 .

[32]  Charles E. Thorpe,et al.  SCARF: a color vision system that tracks roads and intersections , 1993, IEEE Trans. Robotics Autom..

[33]  Nasser Kehtarnavaz,et al.  Visual control of an autonomous vehicle (BART)-the vehicle-following problem , 1991 .

[34]  Enrico Grosso,et al.  Active/Dynamic Stereo Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Charles E. Thorpe,et al.  UNSCARF-a color vision system for the detection of unstructured roads , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[36]  C. Goerick,et al.  Towards all around automatic visual obstacle sensing for cars , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[37]  Larry S. Davis,et al.  A visual navigation system for autonomous land vehicles , 1987, IEEE J. Robotics Autom..