TruPercept: Trust Modelling for Autonomous Vehicle Cooperative Perception from Synthetic Data

Inter-vehicle communication for autonomous vehicles (AVs) stands to provide significant benefits in terms of perception robustness. We propose a novel approach for AVs to communicate perceptual observations, tempered by trust modelling of peers providing reports. Based on the accuracy of reported object detections as verified locally, communicated messages can be fused to augment perception performance beyond line of sight and at great distance from the ego vehicle. Also presented is a new synthetic dataset which can be used to test cooperative perception. The TruPercept dataset includes unreliable and malicious behaviour scenarios to experiment with some challenges cooperative perception introduces. The TruPercept runtime and evaluation framework allows modular component replacement to facilitate ablation studies as well as the creation of new trust scenarios we are able to show.

[1]  Jie Zhang,et al.  A Multifaceted Approach to Modeling Agent Trust for Effective Communication in the Application of Mobile Ad Hoc Vehicular Networks , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Krzysztof Czarnecki,et al.  Precise Synthetic Image and LiDAR (PreSIL) Dataset for Autonomous Vehicle Perception , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[3]  Miguel Sepulcre,et al.  Infrastructure Support for Cooperative Maneuvers in Connected and Automated Driving , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[4]  Matthew Johnson-Roberson,et al.  Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks? , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Panagiotis Papadimitratos,et al.  On Data-Centric Trust Establishment in Ephemeral Ad Hoc Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[6]  Gerd Wanielik,et al.  Alignment of Perception Information for Cooperative Perception , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[7]  Marcus Obst,et al.  Multi-sensor data fusion for checking plausibility of V2V communications by vision-based multiple-object tracking , 2014, 2014 IEEE Vehicular Networking Conference (VNC).

[8]  Marcelo H. Ang,et al.  Cooperative perception for autonomous vehicle control on the road: Motivation and experimental results , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Alberto L. Sangiovanni-Vincentelli,et al.  A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving , 2018, ICMR.

[10]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[11]  Tim Leinmüller,et al.  Trustworthiness Estimation of Entities within Collective Perception , 2019, 2019 IEEE Vehicular Networking Conference (VNC).

[12]  Klaus C. J. Dietmayer,et al.  Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  András Kovács,et al.  Enhancements of V2X communication in support of cooperative autonomous driving , 2015, IEEE Communications Magazine.

[14]  Vijay Varadharajan,et al.  Subjective logic based trust model for mobile ad hoc networks , 2008, SecureComm.

[15]  Franz Andert,et al.  Towards Collaborative Perception for Automated Vehicles in Heterogeneous Traffic , 2018 .

[16]  Jie Zhang,et al.  Intelligent Agents in Mobile Vehicular Ad-Hoc Networks: Leveraging Trust Modeling Based on Direct Experience with Incentives for Honesty , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[17]  A. Varga,et al.  THE OMNET++ DISCRETE EVENT SIMULATION SYSTEM , 2003 .

[18]  Daniel Krajzewicz,et al.  SUMO - Simulation of Urban MObility An Overview , 2011 .

[19]  Jie Zhang,et al.  POMDP-Based Decision Making for Fast Event Handling in VANETs , 2018, AAAI.

[20]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[21]  Steven L. Waslander,et al.  BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectors , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Takashi Bando,et al.  ReLaDec: Reliable Latency Decision Algorithm for Connected Vehicle Applications , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[23]  Qin Li,et al.  A Reputation-Based Announcement Scheme for VANETs , 2012, IEEE Transactions on Vehicular Technology.

[24]  Nsw Roads and Maritime Services.  Intelligent Transport Systems (ITS) , 2016 .

[25]  Fawzi Nashashibi,et al.  Cooperative Perception: Application in the Context of Outdoor Intelligent Vehicle Systems , 2012 .

[26]  J. Ramiro Martinez de Dios,et al.  An Integrated Testbed for Cooperative Perception with Heterogeneous Mobile and Static Sensors , 2011, Sensors.

[27]  Pin-Han Ho,et al.  A Trust Modeling Framework for Message Propagation and Evaluation in VANETs , 2010, 2010 2nd International Conference on Information Technology Convergence and Services.

[28]  Chen Chen,et al.  Trust modeling for message relay control and local action decision making in VANETs , 2013, Secur. Commun. Networks.

[29]  Nadia Ben Azzouna,et al.  Towards a Self-adaptive Trust Management Model for VANETs , 2017, SECRYPT.

[30]  Raja Sengupta,et al.  Vehicle-to-vehicle safety messaging in DSRC , 2004, VANET '04.

[31]  Steven Lake Waslander,et al.  Joint 3D Proposal Generation and Object Detection from View Aggregation , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Omar Y. Al-Jarrah,et al.  Cooperative Object Classification for Driving Applications , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[33]  Qing Yang,et al.  Cooper: Cooperative Perception for Connected Autonomous Vehicles Based on 3D Point Clouds , 2019, 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS).

[34]  Markus Lienkamp,et al.  Road Network Coverage Models for Cloud-based Automotive Applications: A Case Study in the City of Munich , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[35]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Onn Shehory,et al.  Distributed Trust in Open Multi-agent Systems , 2000, Trust in Cyber-societies.