A Framework for Real-time Traffic Sign Detection and Recognition using Grassmann Manifolds

We propose a novel, real-time framework for traffic sign detection and recognition using a camera mounted on the dashboard of a moving vehicle. Traffic sign detection and recognition plays an important role in Advanced Driver Assistance Systems (ADAS) as it helps increase driving safety. However, it is very challenging to detect and recognize traffic signs because of challenges such as perspective distortion, illumination variation, occlusion and motion blur from moving vehicle. In our framework, we use Hue Saturation Value (HSV) color filtering for traffic sign detection. In our Grassmann manifold based traffic sign recognition framework, we create subspaces of each unique traffic sign. These subspaces accommodate the uncertainties that occur during detection and variations in different instances of the same traffic sign. These subspaces lie on a Grassmann manifold and we use discriminant analysis on Grassmann manifolds for recognising them. We have carried out extensive experiments on multiple publicly available traffic sign datasets and compared our proposed framework with multiple state-of-the-art methods. Experimental results show that our system is robust and has a high degree of accuracy.

[1]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[2]  Qi Wang,et al.  An Incremental Framework for Video-Based Traffic Sign Detection, Tracking, and Recognition , 2017, IEEE Transactions on Intelligent Transportation Systems.

[3]  Mohan M. Trivedi,et al.  Traffic sign detection for U.S. roads: Remaining challenges and a case for tracking , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[4]  Zhidong Deng,et al.  LIDAR and vision-based real-time traffic sign detection and recognition algorithm for intelligent vehicle , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Brian C. Lovell,et al.  Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching , 2011, CVPR 2011.

[6]  Faliang Chang,et al.  Occlusion-robust Traffic Sign Detection via Cascaded Colour Cubic Feature , 2016 .

[7]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[8]  Bin Fan,et al.  Traffic Sign Recognition Using a Multi-Task Convolutional Neural Network , 2018, IEEE Transactions on Intelligent Transportation Systems.

[9]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[10]  Yan Jiang,et al.  Traffic sign recognition using Ridge Regression and OTSU method , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[11]  许华荣,et al.  Towards Real-Time Traffic Sign Detection and Classification , 2016 .

[12]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[13]  Kang Kim,et al.  Simultaneous Traffic Sign Detection and Boundary Estimation Using Convolutional Neural Network , 2018, IEEE Transactions on Intelligent Transportation Systems.

[14]  Dayong Shen,et al.  Traffic Sign Recognition Using Kernel Extreme Learning Machines With Deep Perceptual Features , 2017, IEEE Transactions on Intelligent Transportation Systems.

[15]  Cheng-Lin Liu,et al.  Traffic Sign Detection Using a Cascade Method With Fast Feature Extraction and Saliency Test , 2017, IEEE Transactions on Intelligent Transportation Systems.

[16]  Faliang Chang,et al.  Rapid Multiclass Traffic Sign Detection in High-Resolution Images , 2014, IEEE Transactions on Intelligent Transportation Systems.

[17]  Wolfgang Heiden,et al.  Vision-Based Road Sign Detection , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[18]  Xilin Chen,et al.  Projection Metric Learning on Grassmann Manifold with Application to Video based Face Recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).