Oops! It's Too Late. Your Autonomous Driving System Needs a Faster Middleware

Autonomous Driving (AD) has entered a period of rapid development in recent years. With the amount of sensors and control logics installed increasing tremendously to guarantee robustness, a big challenge is posed for AD middleware. Both the academia and the industry are eager for an investigation of the performance of middlewares in Autonomous Driving Vehicles (AVs). To fill this gap, we summarize typical communication scenarios of AVs and evaluate different communication mechanisms of three popular open-source middlewares comprehensively. Besides, we construct a benchmark pack named ComP which consists of a perception communication scenario and a group of real AD applications for researchers to assess middleware performance. Our findings provide useful guidelines for researchers and insightful optimization advice for designing middlewares.

[1]  Yifan Gong,et al.  A Robotic Communication Middleware Combining High Performance and High Reliability , 2020, 2020 IEEE 32nd International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD).

[2]  V. M. Turner.  Apollo , 2009, The Classical Review.

[3]  Alexander Ferrein,et al.  A Self-Driving Car Architecture in ROS2 , 2020, 2020 International SAUPEC/RobMech/PRASA Conference.

[4]  Ingo Lütkebohle,et al.  Response-Time Analysis of ROS 2 Processing Chains Under Reservation-Based Scheduling , 2019, ECRTS.

[5]  Shinpei Kato,et al.  Exploring the performance of ROS2 , 2016, 2016 International Conference on Embedded Software (EMSOFT).

[6]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[7]  Joseph Walsh,et al.  A Review of Multi-Sensor Fusion System for Large Heavy Vehicles Off Road in Industrial Environments , 2020, 2020 31st Irish Signals and Systems Conference (ISSC).

[8]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[9]  Shinpei Kato,et al.  An Open Approach to Autonomous Vehicles , 2015, IEEE Micro.

[10]  Weisong Shi,et al.  Edge Computing for Autonomous Driving: Opportunities and Challenges , 2019, Proceedings of the IEEE.

[11]  Siddharth Agarwal,et al.  Ford Multi-AV Seasonal Dataset , 2020, ArXiv.

[12]  Takeo Kanade,et al.  Autonomous land vehicle project at CMU , 1986, CSC '86.

[13]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Sherali Zeadally,et al.  Autonomous Cars: Research Results, Issues, and Future Challenges , 2019, IEEE Communications Surveys & Tutorials.

[15]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[16]  Peter Gliwa.  AUTOSAR , 2021, Embedded Software Timing.

[17]  Niall O' Mahony,et al.  Deep Learning vs. Traditional Computer Vision , 2019, CVC.

[18]  Jie Yao,et al.  ROS , 2018, ACM Transactions on Storage.

[19]  Lingjia Tang,et al.  The Architectural Implications of Autonomous Driving: Constraints and Acceleration , 2018, ASPLOS.

[20]  Ramakrishnan Rajamony,et al.  An updated performance comparison of virtual machines and Linux containers , 2015, 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[21]  Gerhard Fettweis,et al.  Latency Overhead of ROS2 for Modular Time-Critical Systems , 2021, ArXiv.

[22]  Steve Vinoski,et al.  Where is Middleware? , 2002, IEEE Internet Comput..

[23]  Amy W. Apon,et al.  Middleware , 2001, 2006 ACS/IEEE International Conference on Pervasive Services.

[24]  Weisong Shi,et al.  Computing Systems for Autonomous Driving: State of the Art and Challenges , 2021, IEEE Internet of Things Journal.

[25]  Allen Newell,et al.  The Prospects for Psychological Science in Human-Computer Interaction , 1985, Hum. Comput. Interact..

[26]  Dinesh Manocha,et al.  TZC: Efficient Inter-Process Communication for Robotics Middleware with Partial Serialization , 2018, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Weisong Shi,et al.  PI-Edge: A Low-Power Edge Computing System for Real-Time Autonomous Driving Services , 2018, ArXiv.

[28]  Michael Lang,et al.  TCASM: An asynchronous shared memory interface for high-performance application composition , 2017, Parallel Comput..

[29]  Bo Yu,et al.  Building the Computing System for Autonomous Micromobility Vehicles: Design Constraints and Architectural Optimizations , 2020, 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[30]  Gerardo Pardo-Castellote,et al.  OMG Data-Distribution Service: architectural overview , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..