R‐ADVANCE: Rapid Adaptive Prediction for Vision‐based Autonomous Navigation, Control, and Evasion

In this article, we present a monocular visual reactive navigation system capable of navigating at high speeds, without GPS, in unknown complex cluttered environments. The system, called R-ADVANCE (Rapid Adaptive Prediction for Vision-based Autonomous Navigation, Control, and Evasion), consists of a set of biologically inspired visual perception and reactive control algorithms that provide low-computation reactive obstacle avoidance while navigating at high speeds in search of a goal object. These algorithms, along with basic planning, and augmented with low-precision visual odometry, were implemented on a micro unmanned aerial vehicle and tested in a number of challenging environments. While each of the individual algorithmic and hardware elements has been previously studied in limited environments, this work is the first time that these novel components have been integrated and flight-tested. To achieve fast flight, an NVIDIA Tegra TK1 was used as the main processor, allowing us to parallelize the system to process 1280 × 720 video streams at 40 fps, reaching flight speeds up to 19 m/s (≈68 km/h) or 42 mph.

[1]  Nicolas H. Franceschini,et al.  Optic Flow Based Autopilots: Speed Control and Obstacle Avoidance , 2009, Flying Insects and Robots.

[2]  Camillo J. Taylor,et al.  Expansion segmentation for visual collision detection and estimation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  N. Andrew Browning,et al.  A Neural Circuit for Robust Time-to-Contact Estimation Based on Primate MST , 2012, Neural Computation.

[4]  Charles Richter,et al.  Towards high-speed autonomous navigation of unknown environments , 2015, Defense + Security Symposium.

[5]  In-So Kweon,et al.  Auto-adjusting camera exposure for outdoor robotics using gradient information , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Leslie Pack Kaelbling,et al.  A Dynamical Model of Visually-Guided Steering, Obstacle Avoidance, and Route Selection , 2003, International Journal of Computer Vision.

[7]  Russ Tedrake,et al.  Pushbroom stereo for high-speed navigation in cluttered environments , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Marc Pollefeys,et al.  Reactive avoidance using embedded stereo vision for MAV flight , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Martin Herman,et al.  Real-time single-workstation obstacle avoidance using only wide-field flow divergence , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Nicholas Roy,et al.  State estimation for aggressive flight in GPS-denied environments using onboard sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Guido C. H. E. de Croon,et al.  Autonomous flight of a 20-gram Flapping Wing MAV with a 4-gram onboard stereo vision system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Stephen Grossberg,et al.  A neural model of visually guided steering, obstacle avoidance, and route selection. , 2009, Journal of experimental psychology. Human perception and performance.

[14]  Stephen Grossberg,et al.  Cortical dynamics of navigation and steering in natural scenes: Motion-based object segmentation, heading, and obstacle avoidance , 2009, Neural Networks.

[15]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[16]  Vijay Kumar,et al.  Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor , 2013, Robotics: Science and Systems.

[17]  Florian Raudies,et al.  Visual Navigation in a Cluttered World , 2015 .

[18]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[19]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[20]  Larry H. Matthies,et al.  Stereo vision-based obstacle avoidance for micro air vehicles using disparity space , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Dario Floreano,et al.  A 10-gram vision-based flying robot , 2007, Adv. Robotics.

[22]  James Sean Humbert,et al.  Bioinspired Visuomotor Convergence , 2010, IEEE Transactions on Robotics.