D-patches: effective traffic sign detection with occlusion handling

In advanced driver assistance systems, accurate detection of traffic signs plays an important role in extracting information about the road ahead. However, traffic signs are persistently occluded by vehicles, trees, and other structures on road. Performance of a detector decreases drastically when occlusions are encountered especially when it is trained using full object templates. Therefore, we propose a new method called discriminative patches (d-patches), which is a traffic sign detection (TSD) framework with occlusion handling capability. D-patches are those regions of an object that possess the most discriminative features than their surroundings. They are mined during training and are used for classification instead of the full object templates. Furthermore, we observe that the distribution of redundant-detections around a true-positive is different from that around a false-positive. Based on this observation, we propose a novel hypothesis generation scheme that uses a voting and penalisation mechanism to accurately select a true-positive candidate. We also introduce a new Korean TSD (KTSD) dataset with several evaluation settings to facilitate detector's evaluation under different conditions. The proposed method achieves 100% detection accuracy on German TSD benchmark and achieves 4.0% better detection accuracy, when compared with other well-known methods (under partially occluded settings), on KTSD dataset.

[1]  Andrew Zisserman,et al.  Efficient Additive Kernels via Explicit Feature Maps , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Tao Chen,et al.  Accurate and Efficient Traffic Sign Detection Using Discriminative AdaBoost and Support Vector Regression , 2016, IEEE Transactions on Vehicular Technology.

[3]  Cheng Wang,et al.  Bag-of-visual-phrases and hierarchical deep models for traffic sign detection and recognition in mobile laser scanning data , 2016 .

[4]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[5]  Domenec Puig,et al.  A practical approach for detection and classification of traffic signs using Convolutional Neural Networks , 2016, Robotics Auton. Syst..

[6]  Xiaolin Hu,et al.  Traffic sign detection by ROI extraction and histogram features-based recognition , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[7]  Thomas Werner,et al.  Future Computer Vision Algorithms for Traffic Sign Recognition Systems , 2016 .

[8]  Mohamed El Ansari,et al.  Traffic sign detection and recognition based on random forests , 2016, Appl. Soft Comput..

[9]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Andreas Møgelmose,et al.  Detection of U.S. Traffic Signs , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Michael Felsberg,et al.  Using Fourier Descriptors and Spatial Models for Traffic Sign Recognition , 2011, SCIA.

[13]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fatih Murat Porikli,et al.  Fast Detection of Multiple Objects in Traffic Scenes With a Common Detection Framework , 2015, IEEE Transactions on Intelligent Transportation Systems.

[15]  Teng Yu,et al.  Rendering high dynamic range images by using integrated global and local processing , 2011 .

[16]  Zhilu Wu,et al.  A robust, coarse-to-fine traffic sign detection method , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Faliang Chang,et al.  Fast Traffic Sign Recognition via High-Contrast Region Extraction and Extended Sparse Representation , 2016, IEEE Transactions on Intelligent Transportation Systems.

[19]  Christophe Cudel,et al.  Multi-ROI Association and Tracking With Belief Functions: Application to Traffic Sign Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[20]  Cuneyt Akinlar,et al.  On circular traffic sign detection and recognition , 2016, Expert Syst. Appl..

[21]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Pedro Arias,et al.  Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory , 2016 .

[23]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[25]  Anjan Gudigar,et al.  Multiple thresholding and subspace based approach for detection and recognition of traffic sign , 2017, Multimedia Tools and Applications.

[26]  Faliang Chang,et al.  Occlusion-robust Traffic Sign Detection via Cascaded Colour Cubic Feature , 2016 .

[27]  Teng Yu,et al.  Detecting partially occluded vehicles with geometric and likelihood reasoning , 2015, IET Comput. Vis..