Vision‐based navigation through urban canyons

We address the problem of navigating unmanned vehicles safely through urban canyons in two dimensions using only vision-based techniques. Two commonly used vision-based obstacle avoidance techniques (namely stereo vision and optic flow) are implemented on an aerial and a ground-based robotic platform and evaluated for urban canyon navigation. Optic flow is evaluated for its ability to produce a centering response between obstacles, and stereo vision is evaluated for detecting obstacles to the front. We also evaluate a combination of these two techniques, which allows a vehicle to detect obstacles to the front while remaining centered between obstacles to the side. Through experiments on an unmanned ground vehicle and in simulation, this combination is shown to be beneficial for navigating urban canyons, including T-junctions and 90-deg bends. Experiments on a rotorcraft unmanned aerial vehicle, which was constrained to two-dimensional flight, demonstrate that stereo vision allowed it to detect an obstacle to the front, and optic flow allowed it to turn away from obstacles to the side. We discuss the theory behind these techniques, our experience in implementing them on the robotic platforms, and their suitability to the urban canyon navigation problem. C © 2009 Wiley Periodicals, Inc.

[1]  Dale D. Rowley,et al.  Real-time Evaluation of Vision-based Navigation for Autonomous Landing of a Rotorcraft Unmanned Aerial Vehicle in a Non-cooperative Environment , 2005 .

[2]  Ta Camus.  Calculating time-to-collision with real-time optical flow , 1994, Other Conferences.

[3]  Matthew Garratt,et al.  Biologically inspired climbing with a hexapedal robot , 2008 .

[4]  Jitendra Malik,et al.  An integrated stereo-based approach to automatic vehicle guidance , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Larry H. Matthies,et al.  Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  S. Sastry,et al.  Autonomous Exploration in Unknown Urban Environments for Unmanned Aerial Vehicles , 2005 .

[8]  Dario Floreano,et al.  Toward 30-gram Autonomous Indoor Aircraft: Vision-based Obstacle Avoidance and Altitude Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  M. Srinivasan,et al.  Range perception through apparent image speed in freely flying honeybees , 1991, Visual Neuroscience.

[10]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[11]  Peter I. Corke,et al.  Low-cost flight control system for a small autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Gaurav S. Sukhatme,et al.  A comparison of two camera configurations for optic-flow based navigation of a UAV through urban canyons , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[13]  Bruce A. Draper,et al.  A practical obstacle detection and avoidance system , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[14]  Antonis A. Argyros,et al.  Biomimetic centering behavior [mobile robots with panoramic sensors] , 2004, IEEE Robotics & Automation Magazine.

[15]  Bruce A. Francis,et al.  Stabilizing a linear system by switching control with dwell time , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[16]  A. Morse,et al.  Applications of hysteresis switching in parameter adaptive control , 1992 .

[17]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  A. Morse,et al.  Applications of hysteresis switching in parameter adaptive control , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[19]  Gaurav S. Sukhatme,et al.  Optimum Camera Angle for Optic Flow-Based Centering Response , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Paul F. M. J. Verschure,et al.  A fly-locust based neuronal control system applied to an unmanned aerial vehicle: the invertebrate neuronal principles for course stabilization, altitude control and collision avoidance , 2007, Int. J. Robotics Res..

[21]  Geoffrey L. Barrows,et al.  Flying insect inspired vision for autonomous aerial robot maneuvers in near-earth environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[22]  Clark N. Taylor,et al.  Obstacle Avoidance For Unmanned Air Vehicles Using Image Feature Tracking , 2006 .

[23]  Svetha Venkatesh,et al.  Robot navigation inspired by principles of insect vision , 1999, Robotics Auton. Syst..

[24]  Antonis A. Argyros,et al.  Corridor Following by Nonholonomic Mobile Robots Equipped with Panoramic Cameras , 2000 .

[25]  Anthony J. Calise,et al.  Vision-Based Obstacle Avoidance for UAVs , 2007 .

[26]  A. Stephen Morse,et al.  Control Using Logic-Based Switching , 1997 .

[27]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[29]  Peter I. Corke,et al.  Robust pose estimation for a car-like vehicle , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[30]  Eric N. Johnson,et al.  Real-Time Vision-Based Relative Aircraft Navigation , 2007, J. Aerosp. Comput. Inf. Commun..

[31]  Jeffrey Byrne,et al.  Stereo based obstacle detection for an unmanned air vehicle , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..