Robust, Informative Human-in-the-Loop Predictions via Empirical Reachable Sets

In order to develop safe autonomous systems, accurate and precise models of human behavior must be developed. For intelligent vehicles, one can imagine the need for predicting driver behavior to develop minimally invasive active safety systems or to safely interact with human drivers on the road. We present an optimization-based method for approximating the stochastic reachable set for human-in-the-loop systems. This method identifies the most precise subset of states that a human driven vehicle may enter, given some data set of observed trajectories. We phrase this problem as a mixed integer linear program, solved via branch and bound methods. The resulting model uncovers the most representative set that encapsulates the likely trajectories, up to some probability threshold, by optimally rejecting outliers in the data set. This tool provides set predictions consisting of trajectories observed from the nonlinear dynamics and behaviors of the human driven car, and can account for modes of behavior, like the driver state or intent. This method is applied to predict lane changing behavior, achieving $\sim$90% accuracy over long time horizons. This flexible algorithm is to handle realistic complex human driving data and provide a robust and informative prediction of driver behavior.

[1]  Ulrich Kressel,et al.  Probabilistic trajectory prediction with Gaussian mixture models , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[2]  Claire J. Tomlin,et al.  Guaranteed Safe Online Learning via Reachability: tracking a ground target using a quadrotor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[4]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[5]  Ruzena Bajcsy,et al.  Probabilistic driver modeling to characterize human behavior for semiautonomous framework , 2013 .

[6]  M. R. Rao,et al.  Combinatorial Optimization , 1992, NATO ASI Series.

[7]  S. Shankar Sastry,et al.  Experimental Design for Human-in-the-Loop Driving Simulations , 2014, ArXiv.

[8]  Mohan M. Trivedi,et al.  On-road prediction of driver's intent with multimodal sensory cues , 2011, IEEE Pervasive Computing.

[9]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[10]  Ruzena Bajcsy,et al.  Integrating Intuitive Driver Models in Autonomous Planning for Interactive Maneuvers , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Ruzena Bajcsy,et al.  Semiautonomous Vehicular Control Using Driver Modeling , 2014, IEEE Transactions on Intelligent Transportation Systems.

[12]  Ruzena Bajcsy,et al.  Communicating intent on the road through human-inspired control schemes , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Rüdiger Dillmann,et al.  A probabilistic model for estimating driver behaviors and vehicle trajectories in traffic environments , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[14]  Julius Ziegler,et al.  Optimal trajectories for time-critical street scenarios using discretized terminal manifolds , 2012, Int. J. Robotics Res..

[15]  Ruzena Bajcsy,et al.  Identifying Modes of Intent from Driver Behaviors in Dynamic Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[16]  Lotta Jakobsson,et al.  Collision Warning with Auto Brake - A Real-Life Safety Perspective , 2007 .

[17]  Ruzena Bajcsy,et al.  Safe semi-autonomous control with enhanced driver modeling , 2012, 2012 American Control Conference (ACC).

[18]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[19]  Ruzena Bajcsy,et al.  Improved driver modeling for human-in-the-loop vehicular control , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Tomohiro Yamamura,et al.  A Driver Behavior Recognition Method Based on a Driver Model Framework , 2000 .

[21]  Sterling J. Anderson,et al.  An optimal-control-based framework for trajectory planning, threat assessment, and semi-autonomous control of passenger vehicles in hazard avoidance scenarios , 2010 .

[22]  Allen Y. Yang,et al.  Improving human-in-the-loop decision making in multi-mode driver assistance systems using hidden mode stochastic hybrid systems , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Claire J. Tomlin,et al.  Reducing Conservativeness in Safety Guarantees by Learning Disturbances Online: Iterated Guaranteed Safe Online Learning , 2012, Robotics: Science and Systems.

[24]  Véronique Berge-Cherfaoui,et al.  Vehicle trajectory prediction based on motion model and maneuver recognition , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Jaime F. Fisac,et al.  Reachability-based safe learning with Gaussian processes , 2014, 53rd IEEE Conference on Decision and Control.

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Hanseok Ko,et al.  5. Probabilistic driver modeling Characterizing human behavior for semiautonomous vehicles , 2017 .