Learning robust failure response for autonomous vision based flight

The ability of autonomous mobile robots to react to and recover from potential failures of on-board systems is an important area of ongoing robotics research. With increasing emphasis on robust systems and long-term autonomy, mobile robots must be able to respond safely and intelligently to dangerous situations. Recent developments in computer vision have made autonomous vision based navigation possible. However, vision systems are known to be imperfect and prone to failure due to variable lighting, terrain changes, and other environmental variables. We describe a system for learning simple failure recovery maneuvers based on experience. This involves both recognizing when the vision system is prone to failure, and associating failures with appropriate responses that will most likely help the robot recover. We implement this system on an autonomous quadrotor and demonstrate that behaviors learned with our system are effective in recovering from situational perception failure, thereby improving reliability in cluttered and uncertain environments.

[1]  Geoffrey E. Hinton,et al.  Zero-shot Learning with Semantic Output Codes , 2009, NIPS.

[2]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[3]  Alonzo Kelly,et al.  Optimal Sampling In the Space of Paths: Preliminary Results , 2006 .

[4]  Rudolph Triebel,et al.  Driven Learning for Driving: How Introspection Improves Semantic Mapping , 2016, ISRR.

[5]  Robin R. Murphy,et al.  Classifying and Recovering from Sensing Failures in Autonomous Mobile Robots , 1996, AAAI/IAAI, Vol. 2.

[6]  Martial Hebert,et al.  Semi-Dense Visual Odometry for Monocular Navigation in Clutt ered Environment , 2015 .

[7]  K. Madhava Krishna,et al.  Learning to Prevent Monocular SLAM Failure using Reinforcement Learning , 2018, ICVGIP.

[8]  Rudolph Triebel,et al.  Knowing when we don't know: Introspective classification for mission-critical decision making , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  William Whittaker,et al.  Robotic introspection for exploration and mapping of subterranean environments , 2007 .

[11]  Ali Farhadi,et al.  Predicting Failures of Vision Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[13]  Russ Tedrake,et al.  Pushbroom stereo for high-speed navigation in cluttered environments , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  H. Kohut,et al.  Introspection, Empathy, and Psychoanalysis An Examination of the Relationship between Mode of Observation and Theory , 1959, Journal of the American Psychoanalytic Association.

[15]  Yichuan Tang,et al.  Deep Learning using Support Vector Machines , 2013, ArXiv.

[16]  Martial Hebert,et al.  Robust Monocular Flight in Cluttered Outdoor Environments , 2016, ArXiv.

[17]  Sebastian Thrun,et al.  Real-time fault diagnosis [robot fault diagnosis] , 2004, IEEE Robotics & Automation Magazine.

[18]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[19]  Manuela M. Veloso,et al.  Online Learning of Robot Soccer Free Kick Plans Using a Bandit Approach , 2016, ICAPS.

[20]  Brett Browning,et al.  Learning to Prevent Failure States for a Dynamically Balancing Robot , 2005, AAAI.

[21]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[23]  Rudolph Triebel,et al.  Introspective classification for robot perception , 2016, Int. J. Robotics Res..

[24]  Paul Newman,et al.  Illumination Invariant Imaging : Applications in Robust Vision-based Localisation , Mapping and Classification for Autonomous Vehicles , 2014 .

[25]  Martial Hebert,et al.  Introspective perception: Learning to predict failures in vision systems , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Vijay Kumar,et al.  Planning Dynamically Feasible Trajectories for Quadrotors Using Safe Flight Corridors in 3-D Complex Environments , 2017, IEEE Robotics and Automation Letters.

[27]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.