Redundant Perception and State Estimation for Reliable Autonomous Racing

In autonomous racing, vehicles operate close to the limits of handling and a sensor failure can have critical consequences. To limit the impact of such failures, this paper presents the redundant perception and state estimation approaches developed for an autonomous race car. Redundancy in perception is achieved by estimating the color and position of the track delimiting objects using two sensor modalities independently. Specifically, learning-based approaches are used to generate color and pose estimates, from LiDAR and camera data respectively. The redundant perception inputs are fused by a particle filter based SLAM algorithm that operates in real-time. Velocity is estimated using slip dynamics, with reliability being ensured through a probabilistic failure detection algorithm. The sub-modules are extensively evaluated in real-world racing conditions using the autonomous race car gotthard driverless, achieving lateral accelerations up to 1. 7G and a top speed of 90km/h.

[1]  Hans B. Pacejka,et al.  Tire and Vehicle Dynamics , 1982 .

[2]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Michael Himmelsbach,et al.  Fast segmentation of 3D point clouds for ground vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[4]  Insup Lee,et al.  Attack resilient state estimation for autonomous robotic systems , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Renaud Dubé,et al.  Design of an Autonomous Racecar: Perception, State Estimation and System Integration , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Cristiano Premebida,et al.  Pedestrian detection combining RGB and dense LIDAR data , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Sebastian Thrun,et al.  FastSLAM: A Scalable Method for the Simultaneous Localization and Mapping Problem in Robotics , 2007 .

[8]  Eduardo Mario Nebot,et al.  Real time data association for FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Dirk Langer,et al.  Up to the limits: Autonomous Audi TTS , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[10]  Renaud Dubé,et al.  SegMatch: Segment based place recognition in 3D point clouds , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[13]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[14]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[15]  Bertrand Douillard,et al.  On the segmentation of 3D LIDAR point clouds , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Howard Schwartz,et al.  A comparison of several nonlinear filters for mobile robot pose estimation , 2013, 2013 IEEE International Conference on Mechatronics and Automation.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Junku Yuh,et al.  Fault-tolerant System Design of an Autonomous Underwater Vehicle Odin: an Experimental Study , 1999, Int. J. Syst. Sci..

[19]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[20]  T. Minka.  Bayesian inference, entropy, and the multinomial distribution , 2003 .

[21]  Tahsin Koroglu,et al.  A comprehensive review on estimation strategies used in hybrid and battery electric vehicles , 2015 .

[22]  Manfred Morari,et al.  Optimization‐based autonomous racing of 1:43 scale RC cars , 2015, ArXiv.

[23]  Paul J.Th. Venhovens,et al.  Vehicle Dynamics Estimation Using Kalman Filters , 1999 .

[24]  Hugh F. Durrant-Whyte,et al.  An experiment in autonomous navigation of an underground mining vehicle , 1999, IEEE Trans. Robotics Autom..

[25]  B. V. K. Vijaya Kumar,et al.  A multi-sensor fusion system for moving object detection and tracking in urban driving environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).