Virtual Lane Boundary Generation for Human-Compatible Autonomous Driving: A Tight Coupling between Perception and Planning

Existing autonomous vehicle (AV) navigation algorithms treat lane recognition, obstacle avoidance, local path planning, and lane following as separate functional modules which result in driving behavior that is incompatible with human drivers. It is imperative to design human-compatible navigation algorithms to ensure transportation safety. We develop a new tightly-coupled perception-planning framework that combines all these functionalities to ensure human-compatibility. Using GPS-camera-lidar sensor fusion, we detect actual lane boundaries (ALBs) and propose availability-reasonability-feasibility (ARF) threefold tests to determine if we should generate virtual lane boundaries (VLBs) or follow ALBs. If needed, VLBs are generated using a dynamically adjustable multi-objective optimization framework that considers obstacle avoidance, trajectory smoothness (to satisfy vehicle kinodynamic constraints), trajectory continuity (to avoid sudden movements), GPS following quality (to execute global plan), and lane following or partial direction following (to meeting human expectation). Consequently, vehicle motion is more human compatible than existing approaches. We have implemented our algorithm and tested under open source data with satisfying results.

[1]  Alonzo Kelly,et al.  State space sampling of feasible motions for high‐performance mobile robot navigation in complex environments , 2008, J. Field Robotics.

[2]  Sebastian Thrun,et al.  Anytime Dynamic A*: An Anytime, Replanning Algorithm , 2005, ICAPS.

[3]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[4]  Renato Zaccaria,et al.  Planning and obstacle avoidance in mobile robotics , 2012, Robotics Auton. Syst..

[5]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[6]  Bongsob Song,et al.  A Lidar-Based Decision-Making Method for Road Boundary Detection Using Multiple Kalman Filters , 2012, IEEE Transactions on Industrial Electronics.

[7]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[8]  Fernando Santos Osório,et al.  Robust curb detection and vehicle localization in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[9]  Xiaohui Li,et al.  Real-Time Trajectory Planning for Autonomous Urban Driving: Framework, Algorithms, and Verifications , 2016, IEEE/ASME Transactions on Mechatronics.

[10]  Nanning Zheng,et al.  Efficient Sampling-Based Motion Planning for On-Road Autonomous Driving , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Kahlouche Souhila,et al.  Optical Flow Based Robot Obstacle Avoidance , 2007 .

[12]  Sergio Okida,et al.  A Novel Strategy for Road Lane Detection and Tracking Based on a Vehicle’s Forward Monocular Camera , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[15]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Jin-Woo Lee,et al.  Tunable and stable real-time trajectory planning for urban autonomous driving , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Dayal R. Parhi,et al.  Mobile Robot Navigation and Obstacle Avoidance Techniques: A Review , 2017, ICRA 2017.

[18]  Rosalina Abdul Salam,et al.  Traffic Surveillance : A Review of Vision Based Vehicle Detection , Recognition and Tracking , 2016 .

[19]  Sergiu Nedevschi,et al.  A stereovision based approach for detecting and tracking lane and forward obstacles on mobile devices , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[20]  Haifeng Li,et al.  Lane Marking Quality Assessment for Autonomous Driving , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[22]  Michael R. James,et al.  Generation of Accurate Lane-Level Maps from Coarse Prior Maps and Lidar , 2015, IEEE Intelligent Transportation Systems Magazine.

[23]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[24]  Edwin Olson,et al.  Finding multiple lanes in urban road networks with vision and lidar , 2009, Auton. Robots.

[25]  Stefan Gumhold,et al.  Feature Extraction From Point Clouds , 2001, IMR.

[26]  Nicholas R. Gans,et al.  Predictive RANSAC: Effective model fitting and tracking approach under heavy noise and outliers , 2017, Comput. Vis. Image Underst..

[27]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[28]  Myoungho Sunwoo,et al.  Local Path Planning for Off-Road Autonomous Driving With Avoidance of Static Obstacles , 2012, IEEE Transactions on Intelligent Transportation Systems.

[29]  Tong Boon Tang,et al.  Vehicle Detection Techniques for Collision Avoidance Systems: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[30]  Markus Vincze,et al.  Modeling connected regions in arbitrary planar point clouds by robust B-spline approximation , 2016, Robotics Auton. Syst..

[31]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[32]  Dezhen Song,et al.  Vision-based motion planning for an autonomous motorcycle on ill-structured roads , 2007, Auton. Robots.

[33]  G. Farin Curves and Surfaces for Cagd: A Practical Guide , 2001 .