Motorcycle detection and classification in urban Scenarios using a model based on Faster R-CNN

This paper introduces a Deep Learning Convolutional Neutral Network model based on Faster-RCNN for motorcycle detection and classification on urban environments. The model is evaluated in occluded scenarios where more than 60% of the vehicles present a degree of occlusion. For training and evaluation, we introduce a new dataset of 7500 annotated images, captured under real traffic scenes, using a drone mounted camera. Several tests were carried out to design the network, achieving promising results of 75% in average precision (AP), even with the high number of occluded motorbikes, the low angle of capture and the moving camera. The model is also evaluated on low occlusions datasets, reaching results of up to 92% in AP.

[1]  Stefano Messelodi,et al.  A computer vision system for the detection and classification of vehicles at urban road intersections , 2005, Pattern Analysis and Applications.

[2]  C. Krishna Mohan,et al.  Visual Big Data Analytics for Traffic Monitoring in Smart City , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[3]  Bobo Duan,et al.  Real-time on-road vehicle and motorcycle detection using a single camera , 2009, 2009 IEEE International Conference on Industrial Technology.

[4]  Thierry Chateau,et al.  Deep MANTA: A Coarse-to-Fine Many-Task Network for Joint 2D and 3D Vehicle Analysis from Monocular Image , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[7]  Yunde Jia,et al.  Vehicle Type Classification Using Unsupervised Convolutional Neural Network , 2014, 2014 22nd International Conference on Pattern Recognition.

[8]  Sergio A. Velastin,et al.  Urban road user detection and classification using 3D wire frame models , 2010 .

[9]  Le Thanh Sach,et al.  Learning bag of visual words for motorbike detection , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[10]  KU MIN-YU,et al.  Visual Motorcycle Detection and Tracking Algorithms , 2008 .

[11]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yang Shuo,et al.  A Driving Support System Base on Traffic Environment Analysis , 2016 .

[13]  W. Marsden.  I and J , 2012 .

[14]  Chung-Cheng Chiu,et al.  Motorcycle Detection and Tracking System with Occlusion Segmentation , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[15]  Feng Liu,et al.  Vehicle type classification via adaptive feature clustering for traffic surveillance video , 2016, 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP).

[16]  Lisa M. Brown,et al.  A closer look at Faster R-CNN for vehicle detection , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[17]  John Chiverton,et al.  Helmet presence classification with motorcycle detection and tracking , 2012 .

[18]  Sergio A. Velastin,et al.  Motorcycle Classification in Urban Scenarios using Convolutional Neural Networks for Feature Extraction , 2018, ArXiv.

[19]  Hans-Hellmut Nagel,et al.  Initialization of Model-Based Vehicle Tracking in Video Sequences of Inner-City Intersections , 2007, International Journal of Computer Vision.

[20]  Rattapoom Waranusast,et al.  Machine vision techniques for motorcycle safety helmet detection , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[21]  Nurdin Bahtiar,et al.  Classification of Motorcyclists not Wear Helmet on Digital Image with Backpropagation Neural Network , 2016 .

[22]  Christoph H. Lampert,et al.  Efficient Subwindow Search: A Branch and Bound Framework for Object Localization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Macario Cordel,et al.  Convolutional neural network for vehicle detection in low resolution traffic videos , 2016, 2016 IEEE Region 10 Symposium (TENSYMP).

[25]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[26]  Xiang Bai,et al.  Vehicle Color Recognition With Spatial Pyramid Deep Learning , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  Ming Tang,et al.  Hierarchical and Networked Vehicle Surveillance in ITS: A Survey , 2015, IEEE transactions on intelligent transportation systems (Print).

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Fabrice Mériaudeau,et al.  Rear-end vision-based collision detection system for motorcyclists , 2017, J. Electronic Imaging.

[31]  Yingfeng Cai,et al.  A Vehicle Detection Algorithm Based on Deep Belief Network , 2014, TheScientificWorldJournal.

[32]  Tamitza Toroyan,et al.  Global status report on road safety , 2009, Injury Prevention.

[33]  Xiao Xu,et al.  Deep classification of vehicle makers and models: The effectiveness of pre-training and data enhancement , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[34]  Wayne A Sarasua,et al.  Traffic Monitoring of Motorcycles during Special Events Using Video Detection , 2010 .

[35]  Chung-Lin Huang,et al.  A vision-based vehicle identification system , 2004, ICPR 2004.

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[38]  Stefano Messelodi,et al.  Vision-based bicycle/motorcycle classification , 2007, Pattern Recognit. Lett..

[39]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[40]  Bernt Schiele,et al.  What Makes for Effective Detection Proposals? , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  C. Krishna Mohan,et al.  Automatic detection of bike-riders without helmet using surveillance videos in real-time , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[42]  C. Krishna Mohan,et al.  Detection of motorcyclists without helmet in videos using convolutional neural network , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[43]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[44]  Amelia Wong Azman,et al.  Moving Object Detection and Classification Using Neuro-Fuzzy Approach , 2016, MUE 2016.

[45]  Romuere Rôdrigues Veloso e Silva,et al.  Detection of helmets on motorcyclists , 2018, Multimedia Tools and Applications.

[46]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[47]  Homayoun Sadeghi Bazargani,et al.  Predictors of Survival in Motor Vehicle Accidents Among Motorcyclists, Bicyclists and Pedestrians , 2016 .

[48]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Robust image segmentation for overhead real time motorbike counting , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[50]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[51]  Quanfu Fan,et al.  Self-calibration from vehicle information , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[52]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.