From corners to rectangles — Directional road sign detection using learned corner representations

In this work we adopt a novel approach for the detection of rectangular directional road signs in single frames captured from a moving car. These signs exhibit wide variations in sizes and aspect ratios and may contain arbitrary information, thus making their detection a challenging task with applications in traffic sign recognition systems and vision-based localization. Our proposed approach was originally presented for additional traffic sign detection in small image regions and is generalized to full image frames in this work. Sign corner areas are detected by four ACF-detectors (Aggregated Channel Features) on a single scale. The resulting corner detections are subsequently used to generate quadrangle hypotheses, followed by an aggressive pruning strategy. A comparative evaluation on a database of 1500 German road signs shows that our proposed detector outperforms other methods significantly at close to real-time runtimes and yields thrice the very low error-rate of the recent MS-CNN framework while being two orders of magnitude faster.

[1]  Luis Miguel Bergasa,et al.  Traffic panels detection using visual appearance , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[2]  Luis Miguel Bergasa,et al.  Text recognition on traffic panels from street-level imagery , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[3]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[4]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bernt Schiele,et al.  Filtered channel features for pedestrian detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  A. Vázquez Reina,et al.  Adaptive traffic road sign panels text extraction , 2006 .

[7]  C. Bahlmann,et al.  Real-time recognition of U.S. speed signs , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[8]  Majid Mirmehdi,et al.  Recognizing Text-Based Traffic Signs , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Joon Hee Han,et al.  Local Decorrelation For Improved Pedestrian Detection , 2014, NIPS.

[10]  Wolfgang Heiden,et al.  Vision-Based Road Sign Detection , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[11]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[12]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[13]  Andreas Møgelmose,et al.  Detection of U.S. Traffic Signs , 2015, IEEE Transactions on Intelligent Transportation Systems.

[14]  Joachim Denzler,et al.  Additional traffic sign detection using learned corner representations , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[17]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.