Real Time Traffic Light Detection and Classification using Deep Learning

Traffic light detection and classification represent a major issue for autonomous driving. Although a number of works have been published on this topic, providing a real-time processing solution is still a challenging task. In this paper, we show, by experimenting three models, namely “Faster R-CNN”, “R-FCN” and “SSD” on and two datasets, namely “Bosch Small Traffic Light Dataset” and “Lisa Traffic Light Dataset”, that we can achieve a higher accuracy while reducing the detection and recognition time. In order to improve the overall performance and take the best score of the trained models, we used the ensembling modeling technique. The obtained results outperform the state-of-the-art.

[1]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Mohan M. Trivedi,et al.  Traffic Light Detection at Night: Comparison of a Learning-Based Detector and Three Model-Based Detectors , 2015, ISVC.

[4]  Steven L. Waslander,et al.  A Hierarchical Deep Architecture and Mini-batch Selection Method for Joint Traffic Sign and Light Detection , 2018, 2018 15th Conference on Computer and Robot Vision (CRV).

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Xiaoping Du,et al.  Vision-Based Traffic Light Detection for Intelligent Vehicles , 2017, 2017 4th International Conference on Information Science and Control Engineering (ICISCE).

[7]  Krishna Reddy Konda,et al.  An efficient vision-based traffic light detection and state recognition for autonomous vehicles , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[8]  Ju H. Park,et al.  Effective Traffic Lights Recognition Method for Real Time Driving Assistance Systemin the Daytime , 2011 .

[9]  Yair Moshe,et al.  Real-time Pedestrian Traffic Light Detection , 2018, 2018 IEEE International Conference on the Science of Electrical Engineering in Israel (ICSEE).

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Xinming Huang,et al.  Accurate and Reliable Detection of Traffic Lights Using Multiclass Learning and Multiobject Tracking , 2016, IEEE Intelligent Transportation Systems Magazine.

[12]  Senem Velipasalar,et al.  Mobile Standards-Based Traffic Light Detection in Assistive Devices for Individuals with Color-Vision Deficiency , 2015, IEEE Transactions on Intelligent Transportation Systems.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Evangeline Pollard,et al.  Tracking both pose and status of a traffic light via an Interacting Multiple Model filter , 2014, 17th International Conference on Information Fusion (FUSION).

[15]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[16]  Pietro Cerri,et al.  Robust real-time traffic light detection and distance estimation using a single camera , 2015, Expert Syst. Appl..

[17]  Karsten Behrendt,et al.  A deep learning approach to traffic lights: Detection, tracking, and classification , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Xinming Huang,et al.  Automatic detection of traffic lights using support vector machine , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[19]  Johann Marius Zöllner,et al.  DeepTLR: A single deep convolutional network for detection and classification of traffic lights , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[20]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[23]  Mohan M. Trivedi,et al.  Traffic Light Detection: A Learning Algorithm and Evaluations on Challenging Dataset , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[24]  Slobodan Ilic,et al.  Semantic Segmentation Based Traffic Light Detection at Day and at Night , 2015, GCPR.

[25]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[26]  Ming Yang,et al.  Integrating visual selective attention model with HOG features for traffic light detection and recognition , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).