Road detection and tracking for autonomous mobile robots

As part of the Army's Demo III project, a sensor-based system has been developed to identify roads and to enable a mobile robot to drive along them. A ladar sensor, which produces range images, and a color camera are used in conjunction to locate the road surface and its boundaries. Sensing is used to constantly update an internal world model of the road surface. The world model is used to predict the future position of the road and to focus the attention of the sensors on the relevant regions in their respective images. The world model also determines the most suitable algorithm for locating and tracking road features in the images based on the current task and sensing information. The planner uses information from the world model to determine the best path for the vehicle along the road. Several different algorithms have been developed and tested on a diverse set of road sequences. The road types include some paved roads with lanes, but most of the sequences are of unpaved roads, including dirt and gravel roads. The algorithms compute various features of the road images including smoothness in the world model map and in the range domain, and color features and texture in the color domain. Performance in road detection and tracking are described and examples are shown of the system in action.

[1]  Andrew H. Jazwinski,et al.  Adaptive filtering , 1969, Autom..

[2]  G. Bierman.  Factorization methods for discrete sequential estimation , 1977 .

[3]  S. Ullman.  Visual routines , 1984, Cognition.

[4]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[5]  Larry S. Davis,et al.  Road Boundary Detection For Autonomous Vehicle Navigation , 1986 .

[6]  Ernest L. Hall,et al.  Intelligent Robots and Computer Vision VI , 1987 .

[7]  Clifford A. Shaffer,et al.  Real-time algorithms and data structures for underwater mapping , 1990, IEEE Trans. Syst. Man Cybern..

[8]  Charles E. Thorpe,et al.  UNSCARF-a color vision system for the detection of unstructured roads , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Xueyin Lin,et al.  Color image segmentation using modified HSI system for road following , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Gérard G. Medioni,et al.  Finding Waldo, or focus of attention using local color information , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Henry Schneiderman,et al.  A discriminating feature tracker for vision-based autonomous driving , 1994, IEEE Trans. Robotics Autom..

[12]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[13]  Carl-Fredrik Westin,et al.  Attention control for robot vision , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jan-Olof Eklundh,et al.  Issues in Active Vision: Attention and Cue Integration/selection , 1996 .

[16]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision , 1997, IJCAI.

[17]  C. M. Shoemaker,et al.  The Demo III UGV program: a testbed for autonomous navigation research , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[18]  James S. Albus,et al.  4-D/RCS: a reference model architecture for Demo III , 1997, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[19]  Roger V. Bostelman,et al.  Industrial Autonomous Vehicle Project Report | NIST , 2001 .

[20]  James S. Albus,et al.  Engineering of Mind: An Introduction to the Science of Intelligent Systems , 2001 .

[21]  Marilyn N. Abrams,et al.  An Intelligent World Model for Autonomous Off-Road Driving , 2001 .

[22]  Roger V. Bostelman,et al.  Industrial autonomous vehicle project report , 2001 .

[23]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[24]  Carla E. Brodley,et al.  Focusing attention on objects of interest using multiple matched filters , 2001, IEEE Trans. Image Process..

[25]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[26]  Gregory D. Hager,et al.  Incremental Focus of Attention for Robust Vision-Based Tracking , 1999, International Journal of Computer Vision.

[27]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.