Perception, Planning, Control, and Coordination for Autonomous Vehicles

Autonomous vehicles are expected to play a key role in the future of urban transportation systems, as they offer potential for additional safety, increased productivity, greater accessibility, better road efficiency, and positive impact on the environment. Research in autonomous systems has seen dramatic advances in recent years, due to the increases in available computing power and reduced cost in sensing and computing technologies, resulting in maturing technological readiness level of fully autonomous vehicles. The objective of this paper is to provide a general overview of the recent developments in the realm of autonomous vehicle software systems. Fundamental components of autonomous vehicle software are reviewed, and recent developments in each area are discussed.

[1]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[2]  J. Levy,et al.  Evaluation of the Public Health Impacts of Traffic Congestion: A Health Risk Assessment , 2010 .

[3]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[4]  Alessandro Corrêa Victorino,et al.  Comprehensive performance analysis of road detection algorithms using the common urban Kitti-road benchmark , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[5]  Prabir K. Pal,et al.  Segmentation of point cloud from a 3D LIDAR using range difference between neighbouring beams , 2015, AIR '15.

[6]  Marcelo H. Ang,et al.  Cooperative perception for autonomous vehicle control on the road: Motivation and experimental results , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Prasanna Velagapudi,et al.  Decentralized prioritized planning in large multirobot teams , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[9]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[10]  Mark E. Campbell,et al.  Segmentation of dense range information in complex urban scenes , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Florentin Wörgötter,et al.  Stochastic Lane Shape Estimation Using Local Image Descriptors , 2013, IEEE Transactions on Intelligent Transportation Systems.

[12]  Liang Xiao,et al.  CRF based road detection with multi-sensor fusion , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[13]  Jerome Douret,et al.  A multi-model lane detector that handles road singularities , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[14]  Edwin Olson,et al.  Finding multiple lanes in urban road networks with vision and lidar , 2009, Auton. Robots.

[15]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[16]  Reid G. Simmons,et al.  Approaches for heuristically biasing RRT growth , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  Hongbin Zha,et al.  A real-time motion planner with trajectory optimization for autonomous vehicles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Yi Guo,et al.  A distributed and optimal motion planning approach for multiple mobile robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Franz Kummert,et al.  Spatial ray features for real-time ego-lane extraction , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[20]  Edwin Olson,et al.  Inference on networks of mixtures for robust robot mapping , 2013, Int. J. Robotics Res..

[21]  Marcelo H. Ang,et al.  Autonomous vehicle planning system design under perception limitation in pedestrian environment , 2015, 2015 IEEE 7th International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[22]  Andrei Furda,et al.  Enabling Safe Autonomous Driving in Real-World City Traffic Using Multiple Criteria Decision Making , 2011, IEEE Intelligent Transportation Systems Magazine.

[23]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[24]  Kok Kiong Tan,et al.  Autonomous Reverse Parking System Based on Robust Path Generation and Improved Sliding Mode Control , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  H.E. Tseng,et al.  A model predictive control approach for combined braking and steering in autonomous vehicles , 2007, 2007 Mediterranean Conference on Control & Automation.

[26]  John H. Reif,et al.  Complexity of the mover's problem and generalizations , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[27]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[28]  C.J. Tomlin,et al.  Autonomous Automobile Trajectory Tracking for Off-Road Driving: Controller Design, Experimental Validation and Racing , 2007, 2007 American Control Conference.

[29]  Masahiro Ono,et al.  Chance-Constrained Optimal Path Planning With Obstacles , 2011, IEEE Transactions on Robotics.

[30]  Stefan F. Campbell.  Steering control of an autonomous ground vehicle with application to the DARPA Urban Challenge , 2007 .

[31]  Dong Joong Kang,et al.  Road lane segmentation using dynamic programming for active safety vehicles , 2003, Pattern Recognit. Lett..

[32]  Ivan Petrovic,et al.  Dynamic window based approach to mobile robot motion control in the presence of moving obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[33]  Paulo Peixoto,et al.  Two-Stage Static/Dynamic Environment Modeling Using Voxel Representation , 2015, ROBOT.

[34]  Ryan M. Eustice,et al.  Cooperative localization by factor composition over a faulty low-bandwidth communication channel , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Sanja Fidler,et al.  Monocular 3D Object Detection for Autonomous Driving , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Emilio Frazzoli,et al.  Intention-Aware Pedestrian Avoidance , 2012, ISER.

[37]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[38]  Paulo Dias,et al.  Scene Representations for Autonomous Driving: An Approach Based on Polygonal Primitives , 2015, ROBOT.

[39]  Andrew V. Goldberg,et al.  Route Planning in Transportation Networks , 2015, Algorithm Engineering.

[40]  Jonathan P. How,et al.  Motion Planning in Complex Environments using Closed-loop Prediction , 2008 .

[41]  Maxim Likhachev,et al.  Using state dominance for path planning in dynamic environments with moving obstacles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[42]  Shigang Wang,et al.  New Lane Model and Distance Transform for Lane Detection and Tracking , 2009, CAIP.

[43]  Karl Berntorp,et al.  Hierarchical predictive control for ground-vehicle maneuvering , 2015, 2015 American Control Conference (ACC).

[44]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[45]  J. Christian Gerdes,et al.  Prioritizing collision avoidance and vehicle stabilization for autonomous vehicles , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[46]  Guilherme V. Raffo,et al.  A Predictive Controller for Autonomous Vehicle Path Tracking , 2009, IEEE Transactions on Intelligent Transportation Systems.

[47]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[48]  Emilio Frazzoli,et al.  Incremental minimum-violation control synthesis for robots interacting with external agents , 2014, 2014 American Control Conference.

[49]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[50]  S. Zucker,et al.  Toward Efficient Trajectory Planning: The Path-Velocity Decomposition , 1986 .

[51]  Bisheng Yang,et al.  A shape-based segmentation method for mobile laser scanning point clouds , 2013 .

[52]  Vincent Frémont,et al.  Exploiting fully convolutional neural networks for fast road detection , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[53]  Yasir Latif,et al.  Robust Loop Closing Over Time , 2012, Robotics: Science and Systems.

[54]  James J. Kuffner,et al.  Multipartite RRTs for Rapid Replanning in Dynamic Environments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[55]  Rolf Findeisen,et al.  Nonlinear Model Predictive Control for Constrained Output Path Following , 2015, IEEE Transactions on Automatic Control.

[56]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[57]  Rahul Mohan,et al.  Deep Deconvolutional Networks for Scene Parsing , 2014, ArXiv.

[58]  Tania Landes,et al.  AUTOMATIC SEGMENTATION OF BUILDING FACADES USING TERRESTRIAL LASER DATA , 2007 .

[59]  Aníbal Ollero,et al.  Stability analysis of mobile robot path tracking , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[60]  Y. Tseng,et al.  Incremental segmentation of lidar point clouds with an octree‐structured voxel space , 2011 .

[61]  Nidhi Kalra,et al.  Replanning with RRTs , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[62]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[63]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[64]  Thomas A. Funkhouser,et al.  Min-cut based segmentation of point clouds , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[65]  Franz Kummert,et al.  Monocular Road Terrain Detection by Combining Visual and Spatial Information , 2014, IEEE Transactions on Intelligent Transportation Systems.

[66]  Nanning Zheng,et al.  An adaptive approach to lane markings detection , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[67]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[68]  Jonathan P. How,et al.  Threat-aware path planning in uncertain urban environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[69]  Guoyan Xu,et al.  Computer vision-based multiple-lane detection on straight road and in a curve , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[70]  Michael Bosse,et al.  An Atlas framework for scalable mapping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[71]  Paulo Peixoto,et al.  A Lidar and Vision-based Approach for Pedestrian and Vehicle Detection and Tracking , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[72]  Emilio Frazzoli,et al.  Revisiting Street Intersections Using Slot-Based Systems , 2016, PloS one.

[73]  Francesco Borrelli,et al.  Linear time‐varying model predictive control and its application to active steering systems: Stability analysis and experimental validation , 2008 .

[74]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Zhidong Deng,et al.  Detection of Road Obstacles Using 3D Lidar Data via Road Plane Fitting , 2015 .

[76]  Mike Stilman,et al.  Time-Optimal Trajectory Generation for Path Following with Bounded Acceleration and Velocity , 2012, Robotics: Science and Systems.

[77]  Kwanghoon Sohn,et al.  Gradient-Enhancing Conversion for Illumination-Robust Lane Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[78]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[79]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[80]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Philip H. S. Torr,et al.  Automatic dense visual semantic mapping from street-level imagery , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[82]  João P. Hespanha,et al.  Trajectory-Tracking and Path-Following of Underactuated Autonomous Vehicles With Parametric Modeling Uncertainty , 2007, IEEE Transactions on Automatic Control.

[83]  Roland Siegwart,et al.  Optimal Reciprocal Collision Avoidance for Multiple Non-Holonomic Robots , 2013 .

[84]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[85]  Sang-Woo Lee,et al.  Development of lateral control system for autonomous vehicle based on adaptive pure pursuit algorithm , 2014, 2014 14th International Conference on Control, Automation and Systems (ICCAS 2014).

[86]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[87]  Mario Zanon,et al.  Towards time-optimal race car driving using nonlinear MPC in real-time , 2014, 53rd IEEE Conference on Decision and Control.

[88]  Wolfram Burgard,et al.  Coastal navigation-mobile robot navigation with uncertainty in dynamic environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[89]  Giuseppe Oriolo,et al.  Feedback control of a nonholonomic car-like robot , 1998 .

[90]  Kirstin L. R. Talvala,et al.  Pushing the limits: From lanekeeping to autonomous racing , 2011, Annu. Rev. Control..

[91]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[92]  Matthew R. Walter,et al.  Reachability-guided sampling for planning under differential constraints , 2009, 2009 IEEE International Conference on Robotics and Automation.

[93]  Paulo Peixoto,et al.  3D Lidar-based static and moving obstacle detection in driving environments: An approach based on voxels and multi-region ground planes , 2016, Robotics Auton. Syst..

[94]  Christoph Stiller,et al.  Efficient Road Scene Understanding for Intelligent Vehicles Using Compositional Hierarchical Models , 2015, IEEE Transactions on Intelligent Transportation Systems.

[95]  Mario Gerla,et al.  Vehicular networks and the future of the mobile internet , 2011, Comput. Networks.

[96]  Kok Kiong Tan,et al.  Vision-based approach towards lane line detection and vehicle localization , 2015, Machine Vision and Applications.

[97]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[98]  Andreas Nüchter,et al.  Automatic Appearance-Based Loop Detection from 3 D Laser Data Using the Normal Distributions Transform , 2009 .

[99]  John J. Leonard,et al.  Decentralized cooperative trajectory estimation for autonomous underwater vehicles , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[100]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[101]  Alonzo Kelly,et al.  Receding Horizon Model-Predictive Control for Mobile Robot Navigation of Intricate Paths , 2009, FSR.

[102]  P. Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2011 .

[103]  Paul Newman,et al.  Road vehicle localization with 2D push-broom LIDAR and 3D priors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[104]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[105]  David Hsu,et al.  Planning under Uncertainty for Robotic Tasks with Mixed Observability , 2010, Int. J. Robotics Res..

[106]  Marcelo H. Ang,et al.  Metric mapping and topo-metric graph learning of urban road network , 2013, 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[107]  Mark H. Overmars,et al.  Prioritized motion planning for multiple robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[108]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[109]  Wolfram Burgard,et al.  A comparison of methods for line extraction from range data , 2004 .

[110]  Christian Laugier,et al.  Navigation Among Moving Obstacles Using the NLVO: Principles and Applications to Intelligent Vehicles , 2005, Auton. Robots.

[111]  Miguel Torres-Torriti,et al.  A comparison of gradient versus color and texture analysis for lane detection and tracking , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[112]  Marco Pavone,et al.  Optimal sampling-based motion planning under differential constraints: The driftless case , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[113]  Junsong Yuan,et al.  Fusion of 3D-LIDAR and camera data for scene parsing , 2014, J. Vis. Commun. Image Represent..

[114]  Andrei Furda,et al.  Towards increased road safety: Real-time decision making for driverless city vehicles , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[115]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[116]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[117]  Matthew R. Walter,et al.  Exactly Sparse Extended Information Filters for Feature-based SLAM , 2007, Int. J. Robotics Res..

[118]  Xiangguo Lin,et al.  SVM-Based Classification of Segmented Airborne LiDAR Point Clouds in Urban Areas , 2013, Remote. Sens..

[119]  Udo Frese,et al.  Closing a Million-Landmarks Loop , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[120]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[121]  Whoi-Yul Kim,et al.  Lane detection system with around view monitoring for intelligent vehicle , 2013, 2013 International SoC Design Conference (ISOCC).

[122]  Yongjun Zhang,et al.  Fast Filtering of LiDAR Point Cloud in Urban Areas Based on Scan Line Segmentation and GPU Acceleration , 2013, IEEE Geoscience and Remote Sensing Letters.

[123]  Emilio Frazzoli,et al.  Intention-Aware Motion Planning , 2013, WAFR.

[124]  Marcelo H. Ang,et al.  Multi-vehicle motion coordination using V2V communication , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[125]  Emilio Frazzoli,et al.  Optimal sampling-based Feedback Motion Trees among obstacles for controllable linear systems with linear constraints , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[126]  Maxim Likhachev,et al.  Anytime Safe Interval Path Planning for dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[127]  Anh Nguyen,et al.  3D point cloud segmentation: A survey , 2013, 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[128]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[129]  Alberto Bemporad,et al.  An MPC/hybrid system approach to traction control , 2006, IEEE Transactions on Control Systems Technology.

[130]  Roland Siegwart,et al.  Bayesian space conceptualization and place classification for semantic maps in mobile robotics , 2008, Robotics Auton. Syst..

[131]  Henrik I. Christensen,et al.  2D mapping of cluttered indoor environments by means of 3D perception , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[132]  Jur P. van den Berg,et al.  Kinodynamic RRT*: Asymptotically optimal motion planning for robots with linear dynamics , 2013, 2013 IEEE International Conference on Robotics and Automation.

[133]  Joan Serrat,et al.  Robust lane markings detection and road geometry computation , 2010 .

[134]  Steven M. LaValle,et al.  Optimal motion planning for multiple robots having independent goals , 1998, IEEE Trans. Robotics Autom..

[135]  Ankit Laddha,et al.  Map-supervised road detection , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[136]  Dinesh Manocha,et al.  Reciprocal collision avoidance with acceleration-velocity obstacles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[137]  Bernardo Wagner,et al.  Robust Self-Localization in Industrial Environments based on 3D Ceiling Structures , 2006, IROS.

[138]  Dan Wang,et al.  A Fast and Accurate Segmentation Method for Ordered LiDAR Point Cloud of Large-Scale Scenes , 2014, IEEE Geoscience and Remote Sensing Letters.

[139]  Tong Boon Tang,et al.  Vehicle Detection Techniques for Collision Avoidance Systems: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[140]  Carl D. Crane,et al.  Vector pursuit path tracking for autonomous ground vehicles , 2000 .

[141]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[142]  Richard M. Murray,et al.  Steering nonholonomic systems in chained form , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[143]  Paul Newman,et al.  Outdoor SLAM using visual appearance and laser ranging , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[144]  Emilio Frazzoli,et al.  Teleoperation of On-Road Vehicles via Immersive Telepresence Using Off-the-shelf Components , 2014, IAS.

[145]  Emilio Frazzoli,et al.  Synthesis of provably correct controllers for autonomous vehicles in urban environments , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[146]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[147]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[148]  Manuela M. Veloso,et al.  Real-Time Randomized Path Planning for Robot Navigation , 2002, RoboCup.

[149]  Ryan M. Eustice,et al.  Decentralized Extended Information Filter for Single-Beacon Cooperative Acoustic Navigation: Theory and Experiments , 2013, IEEE Transactions on Robotics.

[150]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[151]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[152]  Wolfram Burgard,et al.  Multimodal deep learning for robust RGB-D object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[153]  Michael Fleming,et al.  Team Cornell's Skynet: Robust perception and planning in an urban environment , 2008 .

[154]  Lynne E. Parker,et al.  Distributed heterogeneous outdoor multi-robot localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[155]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[156]  Changchun Liu,et al.  Stochastic predictive control for lane keeping assistance systems using a linear time-varying model , 2015, 2015 American Control Conference (ACC).

[157]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[158]  Joel W. Burdick,et al.  Robotic motion planning in dynamic, cluttered, uncertain environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[159]  Fawzi Nashashibi,et al.  Cooperative Multi-Vehicle Localization Using Split Covariance Intersection Filter , 2013, IEEE Intelligent Transportation Systems Magazine.

[160]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[161]  Luc Van Gool,et al.  3D all the way: Semantic segmentation of urban scenes from start to end in 3D , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[162]  W. F. Clocksin,et al.  Joint Optimization for Object Class Segmentation and Dense Stereo Reconstruction , 2012, International Journal of Computer Vision.

[163]  Wolfram Burgard,et al.  Nonlinear Constraint Network Optimization for Efficient Map Learning , 2009, IEEE Transactions on Intelligent Transportation Systems.

[164]  L. Dubins.  On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[165]  Wolfram Burgard,et al.  Collaborative Multi-Robot Localization , 1999, DAGM-Symposium.

[166]  Stefano Di Cairano,et al.  The development of Model Predictive Control in automotive industry: A survey , 2012, 2012 IEEE International Conference on Control Applications.

[167]  Emilio Frazzoli,et al.  Incremental sampling-based algorithm for minimum-violation motion planning , 2013, 52nd IEEE Conference on Decision and Control.

[168]  Daniel Cremers,et al.  B-Spline Modeling of Road Surfaces With an Application to Free-Space Estimation , 2009, IEEE Transactions on Intelligent Transportation Systems.

[169]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[170]  Thierry Fraichard,et al.  Collision avoidance in dynamic environments: An ICS-based solution and its comparative evaluation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[171]  Maan El Badaoui El Najjar,et al.  A Road-Matching Method for Precise Vehicle Localization Using Belief Theory and Kalman Filtering , 2005, Auton. Robots.

[172]  Minoru Okada,et al.  A Road Extraction Method by an Active Contour Model with Inertia and Differential Features , 2006, IEICE Trans. Inf. Syst..

[173]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[174]  Wolfram Burgard,et al.  A Probabilistic Approach to Collaborative Multi-Robot Localization , 2000, Auton. Robots.

[175]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[176]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[177]  Paul Newman,et al.  Online generation of scene descriptions in urban environments , 2008, Robotics Auton. Syst..

[178]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[179]  Jerome Douret,et al.  A Reliable and Robust Lane Detection System based on the Parallel Use of Three Algorithms for Driving Safety Assistance , 2006, MVA.

[180]  Marcelo H. Ang,et al.  Probabilistic road context inference for autonomous vehicles , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[181]  Jean-Claude Latombe,et al.  Motion planning for multiple mobile robots using dynamic networks , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[182]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[183]  Maxim Likhachev,et al.  Motion planning in urban environments , 2008 .

[184]  L. Shepp,et al.  OPTIMAL PATHS FOR A CAR THAT GOES BOTH FORWARDS AND BACKWARDS , 1990 .

[185]  José Luis Lerma,et al.  Unsupervised robust planar segmentation of terrestrial laser scanner point clouds based on fuzzy clustering methods , 2008 .

[186]  Jean-Claude Latombe,et al.  Randomized Kinodynamic Motion Planning with Moving Obstacles , 2002, Int. J. Robotics Res..

[187]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[188]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[189]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[190]  Silvio Savarese,et al.  Subcategory-Aware Convolutional Neural Networks for Object Proposals and Detection , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[191]  Bernardo Wagner,et al.  Localization in a wide range of industrial environments using relative 3D ceiling features , 2008, 2008 IEEE International Conference on Emerging Technologies and Factory Automation.

[192]  G. Vosselman.  Point cloud segmentation for urban scene classification , 2013 .

[193]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[194]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[195]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[196]  Christoph Stiller,et al.  The Role of Machine Vision for Intelligent Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[197]  Marco Pavone,et al.  A machine learning approach for real-time reachability analysis , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[198]  Carlos Holguin,et al.  CityMobil2: Challenges and Opportunities of Fully Automated Mobility , 2014 .

[199]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[200]  Seiichi Mita,et al.  Stereovision-based road boundary detection for intelligent vehicles in challenging scenarios , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[201]  S. LaValle.  Rapidly-exploring random trees : a new tool for path planning , 1998 .

[202]  Wolfram Burgard,et al.  Robust place recognition for 3D range data based on point features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[203]  Emilio Frazzoli,et al.  Multivehicle Cooperative Driving Using Cooperative Perception: Design and Experimental Validation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[204]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[205]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[206]  Keith Yu Kit Leung,et al.  Decentralized Localization of Sparsely-Communicating Robot Networks: A Centralized-Equivalent Approach , 2010, IEEE Transactions on Robotics.

[207]  Martial Hebert,et al.  Vision and navigation for the Carnegie-Mellon Navlab , 1988 .

[208]  Thierry Fraichard,et al.  Benchmarking Collision Avoidance Schemes for Dynamic Environments , 2009 .

[209]  Alberto Broggi,et al.  A full-3D voxel-based dynamic obstacle detection for urban scenario using stereo vision , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[210]  Niko Sünderhauf,et al.  Switchable constraints for robust pose graph SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[211]  Marco Pavone,et al.  Fast marching tree: A fast marching sampling-based method for optimal motion planning in many dimensions , 2013, ISRR.

[212]  Fawzi Nashashibi,et al.  Multi-vehicle cooperative localization using indirect vehicle-to-vehicle relative pose estimation , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[213]  Song-Chun Zhu,et al.  Inferring "Dark Matter" and "Dark Energy" from Videos , 2013, 2013 IEEE International Conference on Computer Vision.

[214]  Wolfram Burgard,et al.  Optimizing schedules for prioritized path planning of multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[215]  Zsolt Kira,et al.  Fusing LIDAR and images for pedestrian detection using convolutional neural networks , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[216]  Kok Kiong Tan,et al.  Comprehensive and Practical Vision System for Self-Driving Vehicle Lane-Level Localization , 2016, IEEE Transactions on Image Processing.

[217]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[218]  Roland Siegwart,et al.  Toward automated driving in cities using close-to-market sensors: An overview of the V-Charge Project , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[219]  Bing-Fei Wu,et al.  The Heterogeneous Systems Integration Design and Implementation for Lane Keeping on a Vehicle , 2008, IEEE Transactions on Intelligent Transportation Systems.

[220]  J. Christian Gerdes,et al.  Autonomous vehicle control for emergency maneuvers: The effect of topography , 2015, 2015 American Control Conference (ACC).

[221]  Mark H. Overmars,et al.  Planning Time-Minimal Safe Paths Amidst Unpredictably Moving Obstacles , 2008, Int. J. Robotics Res..

[222]  Luc Van Gool,et al.  Learning Where to Classify in Multi-view Semantic Segmentation , 2014, ECCV.

[223]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[224]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[225]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[226]  Babak Taati,et al.  Difference of Normals as a Multi-scale Operator in Unorganized Point Clouds , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[227]  Karl Granström,et al.  Learning to detect loop closure from range data , 2009, 2009 IEEE International Conference on Robotics and Automation.

[228]  Prabir Barooah,et al.  Distributed collaborative localization of multiple vehicles from relative pose measurements , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[229]  Magnus Egerstedt,et al.  Autonomous driving in urban environments: approaches, lessons and challenges , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[230]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[231]  Gernot Riegler,et al.  OctNet: Learning Deep 3D Representations at High Resolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[232]  Takashi Uozumi,et al.  Precise position estimation of autonomous vehicle based on map-matching , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[233]  Emilio Frazzoli,et al.  Least-violating control strategy synthesis with safety rules , 2013, HSCC '13.

[234]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[235]  Kenji Shimada,et al.  Surface mesh segmentation and smooth surface extraction through region growing , 2005, Comput. Aided Geom. Des..

[236]  Wang Shigang,et al.  Lane detection and tracking using a new lane model and distance transform , 2011, Machine Vision and Applications.

[237]  Jing Li,et al.  Robust multilane detection and tracking in urban scenarios based on LIDAR and mono-vision , 2014, IET Image Process..

[238]  Rama Chellappa,et al.  A Learning Approach Towards Detection and Tracking of Lane Markings , 2012, IEEE Transactions on Intelligent Transportation Systems.

[239]  Emilio Frazzoli,et al.  Sampling-based optimal motion planning for non-holonomic dynamical systems , 2013, 2013 IEEE International Conference on Robotics and Automation.

[240]  Cristiano Premebida,et al.  Pedestrian detection combining RGB and dense LIDAR data , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[241]  E. Kim,et al.  Model predictive control strategy for smooth path tracking of autonomous vehicles with steering actuator dynamics , 2014 .

[242]  Ephrahim Garcia,et al.  Team Cornell's Skynet: Robust perception and planning in an urban environment , 2008 .

[243]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[244]  José E. Guivant,et al.  Global urban localization based on road maps , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[245]  Alois Knoll,et al.  Kinodynamic motion planning with Space-Time Exploration Guided Heuristic Search for car-like robots in dynamic environments , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[246]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[247]  David Hsu,et al.  Integrated perception and planning in the continuous space: A POMDP approach , 2013, Int. J. Robotics Res..

[248]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[249]  George Chryssolouris,et al.  Virtual testing based type approval procedures for the assessment of pedestrian protection developed within the EU-Project IMVITER , 2013 .

[250]  Zhidong Deng,et al.  Road curb detection using 3D lidar and integral laser points for intelligent vehicles , 2012, The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems.

[251]  Emilio Frazzoli,et al.  Probabilistically-sound and asymptotically-optimal algorithm for stochastic control with trajectory constraints , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).