GPU implementation of a road sign detector based on particle swarm optimization

Road Sign Detection is a major goal of the Advanced Driving Assistance Systems. Most published work on this problem share the same approach by which signs are first detected and then classified in video sequences, even if different techniques are used. While detection is usually performed using classical computer vision techniques based on color and/or shape matching, most often classification is performed by neural networks. In this work we present a novel modular and scalable approach to road sign detection based on Particle Swarm Optimization, which takes into account both shape and color to detect signs. In our approach, in particular, the optimization of a single fitness function allows both to detect a sign belonging to a certain category and, at the same time, to estimate its position with respect to the camera reference frame. To speed up processing, the algorithm implementation exploits the parallel computing capabilities offered by modern graphics cards and, in particular, by the Compute Unified Device Architecture by nVIDIA. The effectiveness of the approach has been assessed on both synthetic and real video sequences, which have been successfully processed at, or close to, full frame rate.

[1]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[2]  P.D. Lawrence,et al.  Autonomous Stereo Camera Parameter Estimation for Outdoor Visual Servoing , 2007, 2007 IEEE Workshop on Machine Learning for Signal Processing.

[3]  A.Z. Kouzani,et al.  A Study on Automatic Recognition of Road Signs , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[4]  Songde Ma,et al.  Implicit and Explicit Camera Calibration: Theory and Experiments , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J. Little,et al.  Inverse perspective mapping simplifies optical flow computation and obstacle detection , 2004, Biological Cybernetics.

[6]  Vijay John,et al.  Markerless Multi-view Articulated Pose Estimation Using Adaptive Hierarchical Particle Swarm Optimisation , 2010, EvoApplications.

[7]  Dia I. Abu-Al-Nadi,et al.  Road traffic sign detection in color images , 2003, 10th IEEE International Conference on Electronics, Circuits and Systems, 2003. ICECS 2003. Proceedings of the 2003.

[8]  T. Kailath The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[9]  Riccardo Poli,et al.  Particle Swarm Optimisation , 2011 .

[10]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  A. Broggi,et al.  Real Time Road Signs Recognition , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[13]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Koichi Yamada,et al.  Fast and Robust Traffic Sign Detection , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Giovanni Pilato,et al.  Road signs recognition using a dynamic pixel aggregation technique in the HSV color space , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[16]  Swarup Medasani,et al.  A Swarm-Based Volition/Attention Framework for Object Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[17]  F. Lindner,et al.  Classier training based on synthetically generated samples , 2007 .

[18]  Alexandre Bernardino,et al.  Sample-Based 3D Tracking of Colored Objects : A Flexible Architecture , 2008, BMVC.

[19]  Tae Young Choi,et al.  Robust detection of landmarks in color image based on fuzzy set theory , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[20]  Avinash C. Kak,et al.  A New Approach for Active Stereo Camera Calibration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[21]  Mario Hernández-Tejera,et al.  Particle Swarms as Video Sequence Inhabitants For Object Tracking in Computer Vision , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[22]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[23]  Fabio Daolio,et al.  Evaluation of parallel particle swarm optimization algorithms within the CUDA™ architecture , 2011, Inf. Sci..

[24]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Stefano Cagnoni,et al.  Artificial Creatures for Object Tracking and Segmentation , 2008, EvoWorkshops.

[26]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[27]  Dariu Gavrila,et al.  Traffic Sign Recognition Revisited , 1999, DAGM-Symposium.

[28]  Stefano Cagnoni,et al.  Particle Swarm for Pattern Matching in Image Analysis , 2009 .

[29]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[30]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..

[31]  M.A. Salichs,et al.  Neural traffic sign recognition for autonomous vehicles , 1994, Proceedings of IECON'94 - 20th Annual Conference of IEEE Industrial Electronics.

[32]  Stefano Cagnoni,et al.  Particle Swarm Optimization for Object Detection and Segmentation , 2007, EvoWorkshops.

[33]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[34]  Xiaohong W. Gao,et al.  Vision Models Based Identification of Traffic Signs , 2002, CGIV.

[35]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[36]  Xiaoqin Zhang,et al.  Sequential particle swarm optimization for visual tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[38]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[39]  Fabio Daolio,et al.  Empirical assessment of the effects of update synchronization in Particle Swarm Optimization , 2009 .