A flexible modeling approach for robust multi-lane road estimation

A robust estimation of road course and traffic lanes is an essential part of environment perception for next generations of Advanced Driver Assistance Systems and development of self-driving vehicles. In this paper, a flexible method for modeling multiple lanes in a vehicle in real time is presented. Information about traffic lanes, derived by cameras and other environmental sensors, that is represented as features, serves as input for an iterative expectation-maximization method to estimate a lane model. The generic and modular concept of the approach allows to freely choose the mathematical functions for the geometrical description of lanes. In addition to the current measurement data, the previously estimated result as well as additional constraints to reflect parallelism and continuity of traffic lanes, are considered in the optimization process. As evaluation of the lane estimation method, its performance is showcased using cubic splines for the geometric representation of lanes in simulated scenarios and measurements recorded using a development vehicle. In a comparison to ground truth data, robustness and precision of the lanes estimated up to a distance of 120 m are demonstrated. As a part of the environmental modeling, the presented method can be utilized for longitudinal and lateral control of autonomous vehicles.

[1]  Christopher Bayer,et al.  Multi-lane perception using feature fusion based on GraphSLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  S. Nash,et al.  Linear and Nonlinear Optimization , 2008 .

[3]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.

[4]  Edwin Olson,et al.  Finding multiple lanes in urban road networks with vision and lidar , 2009, Auton. Robots.

[5]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[6]  Sridhar Lakshmanan,et al.  A Deformable Template Approach to Detecting Straight Edges in Radar Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Christoph Wiedemann,et al.  A new method for robust far-distance road course estimation in advanced driver assistance systems , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[10]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[11]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.