Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions

Abstract Currently autonomous or self-driving vehicles are at the heart of academia and industry research because of its multi-faceted advantages that includes improved safety, reduced congestion, lower emissions and greater mobility. Software is the key driving factor underpinning autonomy within which planning algorithms that are responsible for mission-critical decision making hold a significant position. While transporting passengers or goods from a given origin to a given destination, motion planning methods incorporate searching for a path to follow, avoiding obstacles and generating the best trajectory that ensures safety, comfort and efficiency. A range of different planning approaches have been proposed in the literature. The purpose of this paper is to review existing approaches and then compare and contrast different methods employed for the motion planning of autonomous on-road driving that consists of (1) finding a path, (2) searching for the safest manoeuvre and (3) determining the most feasible trajectory. Methods developed by researchers in each of these three levels exhibit varying levels of complexity and performance accuracy. This paper presents a critical evaluation of each of these methods, in terms of their advantages/disadvantages, inherent limitations, feasibility, optimality, handling of obstacles and testing operational environments. Based on a critical review of existing methods, research challenges to address current limitations are identified and future research directions are suggested so as to enhance the performance of planning algorithms at all three levels. Some promising areas of future focus have been identified as the use of vehicular communications (V2V and V2I) and the incorporation of transport engineering aspects in order to improve the look-ahead horizon of current sensing technologies that are essential for planning with the aim of reducing the total cost of driverless vehicles. This critical review on planning techniques presented in this paper, along with the associated discussions on their constraints and limitations, seek to assist researchers in accelerating development in the emerging field of autonomous vehicle research.

[1]  Jing Yang,et al.  A Two-level Path Planning Method for On-road Autonomous Driving , 2012, 2012 Second International Conference on Intelligent System Design and Engineering Application.

[2]  Jonathan P. How,et al.  Motion planning for urban driving using RRT , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Michael Himmelsbach,et al.  Team MuCAR-3 at C-ELROB 2009 , 2009 .

[4]  Zuduo Zheng,et al.  Incorporating human-factors in car-following models : a review of recent developments and research needs , 2014 .

[5]  Jean-Paul Laumond,et al.  Robot Motion Planning and Control , 1998 .

[6]  Wen-Hua Chen,et al.  Experimental tests of autonomous ground vehicles with preview , 2010, Int. J. Autom. Comput..

[7]  Jonathan P. How,et al.  Sampling-Based Threat Assessment Algorithms for Intersection Collisions Involving Errant Drivers , 2010 .

[8]  Weiwen Deng,et al.  Trajectory planning for vehicle autonomous driving with uncertainties , 2014, Proceedings 2014 International Conference on Informative and Cybernetics for Computational Social Systems (ICCSS).

[9]  Zhizhou Wu,et al.  Study on the Collision Avoidance Strategy at Unsignalized Intersection based on PreScan Simulation , 2013 .

[10]  Julius Ziegler,et al.  Spatiotemporal state lattices for fast trajectory planning in dynamic on-road driving scenarios , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Jordi Casas,et al.  Development of a new microscopic passing maneuver model for two-lane rural roads , 2015 .

[12]  Bernhard Rumpe,et al.  Caroline: An autonomously driving vehicle for urban environments , 2008 .

[13]  S. Ilgin Guler,et al.  Using connected vehicle technology to improve the efficiency of intersections , 2014 .

[14]  Jin-Woo Lee,et al.  Motion planning for autonomous driving with a conformal spatiotemporal lattice , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  L. Burns.  Sustainable mobility: A vision of our transport future , 2013, Nature.

[16]  Weiwen Deng,et al.  Dynamic Trajectory Planning for Vehicle Autonomous Driving , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[17]  Martin V. Butz,et al.  Incorporating environmental knowledge into Bayesian filtering using attractor functions , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[18]  John M. Dolan,et al.  Toward human-like motion planning in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[19]  Cristina Olaverri-Monreal,et al.  Road detection with thermal cameras through 3D information , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[20]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[21]  Markus Maurer,et al.  Stadtpilot: Driving autonomously on Braunschweig's inner ring road , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[22]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[23]  Peter King,et al.  Odin: Team VictorTango's entry in the DARPA Urban Challenge , 2008, J. Field Robotics.

[24]  Miguel Angel Sotelo,et al.  Autonomous Navigation and Obstacle Avoidance of a Micro-Bus , 2013 .

[25]  Marcelo H. Ang,et al.  Cooperative perception for autonomous vehicle control on the road: Motivation and experimental results , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  J.M. Wille,et al.  Realizing complex autonomous driving maneuvers the approach taken by team CarOLO at the DARPA urban challenge , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[27]  Oliver Sawodny,et al.  Motion planning for an autonomous vehicle driving on motorways by using flatness properties , 2010, 2010 IEEE International Conference on Control Applications.

[28]  John M. Dolan,et al.  A behavioral planning framework for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[29]  A. Kelly,et al.  Adaptive model-predictive motion planning for navigation in complex environments , 2009 .

[30]  John C. Harsanyi,et al.  Games with Incomplete Information Played by "Bayesian" Players, I-III: Part I. The Basic Model& , 2004, Manag. Sci..

[31]  Alberto Broggi,et al.  Autonomous vehicles control in the VisLab Intercontinental Autonomous Challenge , 2012, Annu. Rev. Control..

[32]  Darren Liccardo,et al.  Automatic collision avoidance using model-predictive online optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[33]  Raúl Rojas,et al.  Action annotated trajectory generation for autonomous maneuvers on structured road networks , 2011, The 5th International Conference on Automation, Robotics and Applications.

[34]  Christian Laugier,et al.  Evaluating risk at road intersections by detecting conflicting intentions , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Luis Martínez,et al.  Real-time trajectory generation for car-like vehicles navigating dynamic environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[36]  Emilio Frazzoli,et al.  Optimal motion planning with the half-car dynamical model for autonomous high-speed driving , 2013, 2013 American Control Conference.

[37]  John M. Dolan,et al.  On-Road Motion Planning for Autonomous Vehicles , 2012, ICIRA.

[38]  Jonas Sjöberg,et al.  Predictive manoeuvre generation for automated driving , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[39]  Emilio Frazzoli,et al.  Incremental sampling-based algorithm for minimum-violation motion planning , 2013, 52nd IEEE Conference on Decision and Control.

[40]  Alonzo Kelly,et al.  Efficient Constrained Path Planning via Search in State Lattices , 2005 .

[41]  Jeff G. Schneider,et al.  Game Theoretic Control for Robot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[42]  Andreas Eidehall,et al.  On path planning methods for automotive collision avoidance , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[43]  Wolfgang Schuster,et al.  Trajectory prediction for future air traffic management – complex manoeuvres and taxiing , 2015, The Aeronautical Journal.

[44]  Jonathan P. How,et al.  Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns , 2013, Auton. Robots.

[45]  Xiaohui Li,et al.  A unified approach to local trajectory planning and control for autonomous driving along a reference path , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[46]  Emilio Frazzoli,et al.  Intention-Aware Motion Planning , 2013, WAFR.

[47]  John W. Polak,et al.  Autonomous cars: The tension between occupant experience and intersection capacity , 2015 .

[48]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[49]  Wen-Hua Chen,et al.  Road Network Based Vehicle Navigation Using an Improved IMM Particle Filter , 2013 .

[50]  Wen-Hua Chen,et al.  Hierarchical path planning and flight control of small autonomous helicopters using MPC techniques , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[51]  Hui Chen,et al.  A Behavior-Based Path Planning for Autonomous Vehicle , 2010, ICIRA.

[52]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[53]  Paul Newman,et al.  LAPS-II: 6-DoF day and night visual localisation with prior 3D structure for autonomous road vehicles , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[54]  Martin Buss,et al.  Safety assessment of trajectories for navigation in uncertain and dynamic environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[55]  Kyoung-Dae Kim.  Collision free autonomous ground traffic: A model predictive control approach , 2013, 2013 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[56]  Julius Ziegler,et al.  Trajectory planning for Bertha — A local, continuous method , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[57]  Gereon Meyer,et al.  Elements of a European Roadmap on Smart Systems for Automated Driving , 2015 .

[58]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[59]  John M. Dolan,et al.  Motion planning under uncertainty for on-road autonomous driving , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Luca Gatti,et al.  The VisLab Intercontinental Autonomous Challenge: 13,000 km, 3 months,… no driver , 2010 .

[61]  Michael Himmelsbach,et al.  Driving with tentacles: Integral structures for sensing and motion , 2008 .

[62]  Emilio Frazzoli,et al.  Differential flatness of a front-steered vehicle with tire force control , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Markus Maurer,et al.  Comprehensive treated sections in a trajectory planner for realizing autonomous driving in Braunschweig'S urban traffic , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[64]  Stéphanie Lefèvre,et al.  Estimation du risque aux intersections pour applications sécuritaires avec véhicules communicants. (Risk estimation at road intersections for connected vehicle safety applications) , 2012 .

[65]  Sebastian Thrun,et al.  Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments , 2010, Int. J. Robotics Res..

[66]  Roland Siegwart,et al.  On the design of deformable input- / state-lattice graphs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[67]  R. Dillmann,et al.  Path planning for cognitive vehicles using risk maps , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[68]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[69]  Rodrigo Benenson,et al.  Integrating Perception and Planning for Autonomous Navigation of Urban Vehicles , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Sebastian Thrun,et al.  Toward robotic cars , 2010, CACM.

[71]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[72]  Peter Hidas,et al.  MODELLING LANE CHANGING AND MERGING IN MICROSCOPIC TRAFFIC SIMULATION , 2002 .

[73]  M. Abdel-Aty,et al.  A correlated random parameter approach to investigate the effects of weather conditions on crash risk for a mountainous freeway , 2014 .

[74]  Pascal Vasseur,et al.  Local path planning in a complex environment for self-driving car , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[75]  Rüdiger Dillmann,et al.  Learning Driver Behavior Models from Traffic Observations for Decision Making and Planning , 2015, IEEE Intelligent Transportation Systems Magazine.

[76]  Daniel D. Lee,et al.  Little Ben: The Ben Franklin Racing Team's entry in the 2007 DARPA Urban Challenge , 2008, J. Field Robotics.

[77]  Stewart Worrall,et al.  Extending Time to Collision for probabilistic reasoning in general traffic scenarios , 2015 .

[78]  A. Kelly,et al.  Fast and Feasible Deliberative Motion Planner for Dynamic Environments , 2009 .

[79]  Jonathan P. How,et al.  Threat-aware path planning in uncertain urban environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[80]  Vijay Gadepally,et al.  Estimation of Driver Behavior for Autonomous Vehicle Applications , 2013 .

[81]  Oliver Brock,et al.  Planning Long Dynamically-Feasible Maneuvers for Autonomous Vehicles , 2009 .

[82]  David Hsu,et al.  Planning under Uncertainty for Robotic Tasks with Mixed Observability , 2010, Int. J. Robotics Res..

[83]  Stewart Worrall,et al.  Vehicle collision probability calculation for general traffic scenarios under uncertainty , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[84]  Wen-Hua Chen,et al.  Moving object tracking in support of unmanned vehicle opeartion , 2013, 2013 19th International Conference on Automation and Computing.

[85]  Hesham A. Rakha,et al.  Eco-driving at signalized intersections using V2I communication , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[86]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[87]  John M. Dolan,et al.  Focused Trajectory Planning for autonomous on-road driving , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[88]  Gereon Meyer,et al.  European Roadmap Smart Systems for Automated Driving , 2015 .

[89]  Roland Siegwart,et al.  Motion Planning for Car-Like Vehicles in Dynamic Urban Scenarios , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[90]  Paul Newman,et al.  Risky planning: Path planning over costmaps with a probabilistically bounded speed-accuracy tradeoff , 2011, 2011 IEEE International Conference on Robotics and Automation.

[91]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[92]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[93]  Ross A. Knepper,et al.  Differentially constrained mobile robot motion planning in state lattices , 2009 .

[94]  R. Siegwart,et al.  Autonomous Driving in Structured and Unstructured Environments , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[95]  Maxim Likhachev,et al.  Time-bounded lattice for efficient planning in dynamic environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[96]  Azim Eskandarian,et al.  Handbook of Intelligent Vehicles , 2012 .

[97]  S. Shankar Sastry,et al.  Pursuit-evasion strategies for teams of multiple agents with incomplete information , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[98]  Zhixia Li,et al.  Development of Next Generation Intersection Control , 2013 .

[99]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[100]  Alexandrina Rogozan,et al.  Pedestrian Detection in Far-Infrared Daytime Images Using a Hierarchical Codebook of SURF , 2015, Sensors.

[101]  Anne Spalanzani,et al.  Understanding human interaction for probabilistic autonomous navigation using Risk-RRT approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[102]  Hongbin Zha,et al.  A real-time motion planner with trajectory optimization for autonomous vehicles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[103]  Andrei Furda,et al.  Enabling Safe Autonomous Driving in Real-World City Traffic Using Multiple Criteria Decision Making , 2011, IEEE Intelligent Transportation Systems Magazine.

[104]  Mark E. Campbell,et al.  Contingency Planning Over Probabilistic Obstacle Predictions for Autonomous Road Vehicles , 2013, IEEE Transactions on Robotics.

[105]  Tao Mei,et al.  Dynamic motion planning for autonomous vehicle in unknown environments , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[106]  John Andrews,et al.  Optimisation based control framework for autonomous vehicles: Algorithm and experiment , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[107]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[108]  David Filliat,et al.  Ontology-based context awareness for driving assistance systems , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[109]  Wen-Hua Chen,et al.  A multiple target tracking strategy using moving horizon estimation approach , 2015 .

[110]  Shiho Kim,et al.  Path generation and tracking based on a Bézier curve for a steering rate controller of autonomous vehicles , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[111]  David González,et al.  Continuous curvature planning with obstacle avoidance capabilities in urban scenarios , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[112]  Joshué Pérez,et al.  Trajectory generator for autonomous vehicles in urban environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[113]  Andrea Martin.  Interactive Motion Prediction using Game Theory , 2013 .

[114]  Christian Berger,et al.  Caroline: An autonomously driving vehicle for urban environments , 2008, J. Field Robotics.

[115]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[116]  Julius Ziegler,et al.  Optimal trajectories for time-critical street scenarios using discretized terminal manifolds , 2012, Int. J. Robotics Res..

[117]  Matthias Althoff,et al.  Model-Based Probabilistic Collision Detection in Autonomous Driving , 2009, IEEE Transactions on Intelligent Transportation Systems.

[118]  Cristiano Premebida,et al.  An RRT-based navigation approach for mobile robots and automated vehicles , 2014, 2014 12th IEEE International Conference on Industrial Informatics (INDIN).

[119]  Christian Laugier,et al.  Risk assessment at road intersections: Comparing intention and expectation , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[120]  Julius Ziegler,et al.  Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge , 2008, J. Field Robotics.

[121]  Luke Fletcher,et al.  The MIT - Cornell Collision and Why It Happened , 2009, The DARPA Urban Challenge.

[122]  Saul A. Kripke,et al.  Semantical Considerations on Modal Logic , 2012 .

[123]  Dirk Haehnel,et al.  Junior: The Stanford entry in the Urban Challenge , 2008 .

[124]  Maxim Likhachev,et al.  Efficiently Using Cost Maps For Planning Complex Maneuvers , 2008 .

[125]  Michael Himmelsbach,et al.  Driving with Tentacles - Integral Structures for Sensing and Motion , 2008, The DARPA Urban Challenge.

[126]  Thierry Fraichard,et al.  Collision-free and continuous-curvature path planning for car-like robots , 1997, Proceedings of International Conference on Robotics and Automation.

[127]  Osamu Takahashi,et al.  Motion planning in a plane using generalized Voronoi diagrams , 1989, IEEE Trans. Robotics Autom..

[128]  S. LaValle.  Rapidly-exploring random trees : a new tool for path planning , 1998 .

[129]  S. Zucker,et al.  Differential Geometry from the Frenet Point of View: Boundary Detection, Stereo, Texture and Color , 2006, Handbook of Mathematical Models in Computer Vision.

[130]  Kevin Warwick,et al.  Motion planning of autonomous vehicles in a non-autonomous vehicle environment without speed lanes , 2013, Eng. Appl. Artif. Intell..

[131]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[132]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[133]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008 .