Autoware on Board: Enabling Autonomous Vehicles with Embedded Systems

This paper presents Autoware on Board, a new profile of Autoware, especially designed to enable autonomous vehicles with embedded systems. Autoware is a popular open-source software project that provides a complete set of self-driving modules, including localization, detection, prediction, planning, and control. We customize and extend the software stack of Autoware to accommodate embedded computing capabilities. In particular, we use DRIVE PX2 as a reference computing platform, which is manufactured by NVIDIA Corporation for development of autonomous vehicles, and evaluate the performance of Autoware on ARM-based embedded processing cores and Tegra-based embedded graphics processing units (GPUs). Given that low-power CPUs are often preferred over high-performance GPUs, from the functional safety point of view, this paper focuses on the application of Autoware on ARM cores rather than Tegra ones. However, some Autoware modules still need to be executed on the Tegra cores to achieve load balancing and real-time processing. The experimental results show that the execution latency imposed on the DRIVE PX2 platform is capped at about three times as much as that on a high-end laptop computer. We believe that this observed computing performance is even acceptable for real-world production of autonomous vehicles in certain scenarios.

[1]  R. C. Coulter,et al.  Implementation of the Pure Pursuit Path Tracking Algorithm , 1992 .

[2]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[3]  Shinpei Kato,et al.  An Open Approach to Autonomous Vehicles , 2015, IEEE Micro.

[4]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[5]  Shinpei Kato,et al.  Open Source Integrated Planner for Autonomous Navigation in Highly Dynamic Environments , 2017, J. Robotics Mechatronics.

[6]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[7]  Sebastian Thrun,et al.  Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments , 2010, Int. J. Robotics Res..

[8]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[9]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Shinpei Kato,et al.  Exploring Scalable Data Allocation and Parallel Computing on NoC-Based Embedded Many Cores , 2017, 2017 IEEE International Conference on Computer Design (ICCD).

[11]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  A. Kelly,et al.  TRAJECTORY GENERATION FOR CAR-LIKE ROBOTS USING CUBIC CURVATURE POLYNOMIALS , 2001 .

[14]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .

[15]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Chris Sanders,et al.  Team MIT Urban Challenge Technical Report , 2007 .

[18]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[19]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[20]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[21]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jin-Woo Lee,et al.  Motion planning for autonomous driving with a conformal spatiotemporal lattice , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Ross A. Knepper,et al.  Differentially constrained mobile robot motion planning in state lattices , 2009 .