Deep learning based image processing for proactive data collecting system for autonomous vehicle

Autonomous vehicle is the topic that gains a lot of attentions in recent years. To enable autonomous vehicle, a huge amount of data needs to be collected and processed. One of the most promising method to improve the accuracy of data collection is using vehicle communication. With the help of vehicle communication, controlling and warning signal can be transmitted between vehicles. Consequently, necessary information such as identity, position, speed, moving direction, future behavior can be obtained with higher accuracy. This paper focuses on a type of vehicle communication system called optical camera communication. One of the most important components of optical camera communication system is image processing. In this paper, a deep learning-based image processing algorithm is proposed for optical camera communication used for proactive data collecting system for autonomous vehicle. The experiment results show that the proposed algorithm can achieve much higher performance compared to its counterparts.

[1]  Nahid Shahmehri,et al.  A peer-to-peer approach to vehicular communication for the support of traffic safety applications , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[2]  William Whittaker,et al.  Self-Driving Cars and the Urban Challenge , 2008, IEEE Intelligent Systems.

[3]  Panagiotis Papadimitratos,et al.  Vehicular communication systems: Enabling technologies, applications, and future outlook on intelligent transportation , 2009, IEEE Communications Magazine.

[4]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Tim Leinmüller,et al.  Survey on Misbehavior Detection in Cooperative Intelligent Transportation Systems , 2016, IEEE Communications Surveys & Tutorials.

[6]  Alberto Ferreira de Souza,et al.  Self-Driving Cars: A Survey , 2019, Expert Syst. Appl..

[7]  Serdar Yilmaz,et al.  An overview of visible light communication systems , 2015, ArXiv.

[8]  Shoji Kawahito,et al.  A New Automotive VLC System Using Optical Communication Image Sensor , 2016, IEEE Photonics Journal.

[9]  Shoji Kawahito,et al.  Image-sensor-based visible light communication for automotive applications , 2014, IEEE Communications Magazine.

[10]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Amnon Shashua,et al.  On a Formal Model of Safe and Scalable Self-driving Cars , 2017, ArXiv.

[12]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Paolo Santi,et al.  Vehicle-to-Vehicle Communication: Fair Transmit Power Control for Safety-Critical Information , 2009, IEEE Transactions on Vehicular Technology.

[14]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Subir Biswas,et al.  Vehicle-to-vehicle wireless communication protocols for enhancing highway traffic safety , 2006, IEEE Communications Magazine.

[16]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shoji Kawahito,et al.  Optical Vehicle-to-Vehicle Communication System Using LED Transmitter and Camera Receiver , 2014, IEEE Photonics Journal.