Learning Steering Bounds for Parallel Autonomous Systems

Deep learning has been successfully applied to “end-to-end” learning of the autonomous driving task, where a deep neural network learns to predict steering control commands from camera data input. However, the learned representations do not support higher-level decision making required for autonomous navigation, nor the uncertainty estimates required for parallel autonomy, where vehicle control is shared between human and robot. This paper tackles the problem of learning a representation to predict a continuous control probability distribution, and thus steering control options and bounds for those options, which can be used for autonomous navigation. Each mode of the distribution encodes a possible macro-action that the system could execute at that instant, and the covariances of the modes place bounds on safe steering control values. Our approach has the added advantage of being trained on unlabeled data collected from inexpensive cameras. The deep neural network based algorithm generates a probability distribution over the space of steering angles, from which we leverage Variational Bayesian methods to extract a mixture model and compute the different possible actions in the environment. A bound, which the autonomous vehicle must respect in our parallel autonomy setting, is then computed for each of these actions. We evaluate our approach on a challenging dataset containing a wide variety of driving conditions, and show that our algorithm is capable of parameterizing Gaussian Mixture Models for possible actions, and extract steering bounds with a mean error of only 2 degrees. Additionally, we demonstrate our system working on a full scale autonomous vehicle and evaluate its ability to successful handle various different parallel autonomy situations.

[1]  J. Christian Gerdes,et al.  Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability , 2016, IEEE Transactions on Intelligent Transportation Systems.

[2]  Hajime Asama,et al.  Inevitable collision states. A step towards safer robots? , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[3]  Zoubin Ghahramani,et al.  A Theoretically Grounded Application of Dropout in Recurrent Neural Networks , 2015, NIPS.

[4]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[5]  Kyunghyun Cho,et al.  Query-Efficient Imitation Learning for End-to-End Autonomous Driving , 2016, ArXiv.

[6]  Paul A. Beardsley,et al.  Shared control of autonomous vehicles based on velocity space optimization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Javier Alonso-Mora,et al.  A parallel autonomy research platform , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[8]  Vidya N. Murali,et al.  DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Pascal Vasseur,et al.  Local path planning in a complex environment for self-driving car , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[10]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[11]  C. Bishop.  Mixture density networks , 1994 .

[12]  Wolfram Burgard,et al.  Deep reinforcement learning with successor features for navigation across similar environments , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Mykel J. Kochenderfer,et al.  Imitating driver behavior with generative adversarial networks , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[14]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[15]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[16]  Csaba Szepesvári,et al.  Apprenticeship Learning using Inverse Reinforcement Learning and Gradient Methods , 2007, UAI.

[17]  Rudolph Triebel,et al.  Introspective classification for robot perception , 2016, Int. J. Robotics Res..

[18]  Francesco Borrelli,et al.  Predictive Active Steering Control for Autonomous Vehicle Systems , 2007, IEEE Transactions on Control Systems Technology.

[19]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[20]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[21]  Charles Richter,et al.  Bayesian Learning for Safe High-Speed Navigation in Unknown Environments , 2015, ISRR.

[22]  Domitilla Del Vecchio,et al.  Robust Supervisors for Intersection Collision Avoidance in the Presence of Uncontrolled Vehicles , 2016, ArXiv.

[23]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[24]  Domitilla Del Vecchio,et al.  Design of a lane departure driver-assist system under safety specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Domitilla Del Vecchio,et al.  Design of Driver-Assist Systems Under Probabilistic Safety Specifications Near Stop Signs , 2016, IEEE Transactions on Automation Science and Engineering.

[27]  S. Khan,et al.  Real time lane detection for autonomous vehicles , 2008, 2008 International Conference on Computer and Communication Engineering.

[28]  Francesco Borrelli,et al.  Robust nonlinear predictive control for semiautonomous ground vehicles , 2014, 2014 American Control Conference.

[29]  R. Verma,et al.  Semiautonomous Multivehicle Safety , 2011, IEEE Robotics & Automation Magazine.

[30]  Alan Edelman,et al.  Accelerated Convolutions for Efficient Multi-Scale Time to Contact Computation in Julia , 2016, ArXiv.

[31]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[32]  Sterling J. Anderson,et al.  The intelligent copilot: A constraint-based approach to shared-adaptive control of ground vehicles , 2013, IEEE Intelligent Transportation Systems Magazine.

[33]  Stefano Ermon,et al.  Generative Adversarial Imitation Learning , 2016, NIPS.

[34]  Yang Gao,et al.  End-to-End Learning of Driving Models from Large-Scale Video Datasets , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Sterling J. Anderson,et al.  Constraint-based planning and control for safe, semi-autonomous operation of vehicles , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[36]  Zoubin Ghahramani,et al.  Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference , 2015, ArXiv.