Global Map Long Range Vision ( FAROD ) Cameras Vehicle Map Global planner Route to goal Global Map Goal Local candidates

Vision-based navigation and obstacle detection must be sophisticated in order to perform well in complicated and diverse terrain, but that complexity comes at the expense of increased system latency between image capture and actuator signals. Increased latency, or a longer control loop, degrades the reactivity of the robot. We present a navigational framework that uses a self-supervised, learningbased obstacle detector without paying a price in latency and reactivity. A long-range obstacle detector uses online learning to accurately see paths and obstacles at ranges up to 30 meters, while a fast, short-range obstacle detector avoids obstacles at up to 5 meters. The learning-based long-range module is discussed in detail, and field experiments are described which demonstrate the success of the overall system.

[1]  Martial Hebert,et al.  Mapping and positioning for a prototype lunar rover , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  Erann Gat,et al.  Mars microrover navigation: Performance evaluation and enhancement , 1995, Auton. Robots.

[3]  Tommy Chang,et al.  Road detection and tracking for autonomous mobile robots , 2002, SPIE Defense + Commercial Sensing.

[4]  Sebastian Thrun,et al.  Adaptive Road Following using Self-Supervised Learning and Reverse Optical Flow , 2005, Robotics: Science and Systems.

[5]  Ben Southall,et al.  Stereo perception on an off-road vehicle , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[6]  Reid G. Simmons,et al.  Recent progress in local and global traversability for planetary rovers , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  Sebastian Thrun,et al.  A Self-Supervised Terrain Roughness Estimator for Off-Road Autonomous Driving , 2006, UAI.

[8]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[9]  Yann LeCun,et al.  Off-Road Obstacle Avoidance through End-to-End Learning , 2005, NIPS.

[10]  J. Baird,et al.  The locus of environmental attention , 1981 .

[11]  Dean A. Pomerleau,et al.  Knowledge-Based Training of Artificial Neural Networks for Autonomous Robot Driving , 1993 .

[12]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[13]  Anthony Stentz,et al.  Online adaptive rough-terrain navigation vegetation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Alonzo Kelly,et al.  Stereo Vision Enhancements for Low-Cost Outdoor Autonomous Vehicles , 1998 .

[15]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[16]  D.J. Kriegman,et al.  Stereo vision and navigation in buildings for mobile robots , 1989, IEEE Trans. Robotics Autom..

[17]  Larry H. Matthies,et al.  Stereo-Based Tree Traversability Analysis for Autonomous Off-Road Navigation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[18]  Martial Hebert,et al.  Natural terrain classification using 3-d ladar data , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  Pierrick Grandjean,et al.  Fast cross-country navigation on fair terrains , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[20]  J. Andrew Bagnell,et al.  Improving Robot Navigation Through Self-Supervised Online Learning , 2006, Robotics: Science and Systems.

[21]  Charles E. Thorpe,et al.  Vision-based neural network road and intersection detection and traversal , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[22]  Illah R. Nourbakhsh,et al.  Appearance-Based Obstacle Detection with Monocular Color Vision , 2000, AAAI/IAAI.

[23]  Larry Matthies,et al.  Stereo vision and rover navigation software for planetary exploration , 2002, Proceedings, IEEE Aerospace Conference.