Real-Time Detection of Motorcyclist without Helmet using Cascade of CNNs on Edge-device

The real-time detection of traffic rule violators in a city-wide surveillance network is a highly desirable but challenging task because it needs to perform computationally complex analytics on the live video streams from large number of cameras, simultaneously. In this paper, we propose an efficient framework using edge computing to deploy a system for automatic detection of bike-riders without helmet. First, we propose a novel robust and compact method for the detection of the motorcyclists without helmet using convolutional neural networks (CNNs). Then, we scale it for the real-time performance on an edge-device by dropping redundant filters and quantizing the model weights. To reduce the network latency, we place the detector module on edge-devices in the cameras. The edge-nodes send their detected alerts to a central alert database where the end users access these alerts through a web interface. To evaluate the proposed method, we collected two datasets of real traffic videos, namely, IITH_Helmet_1 which contains sparse traffic and IITH_Helmet_2 which contains dense traffic. The experimental results show that our method achieves a high detection accuracy of$\approx$95% while maintaining the real-time processing speed of $\approx$22fps on Nvidia-TXI.

[1]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  Ying Wu,et al.  A novel unsupervised approach to discovering regions of interest in traffic images , 2015, Pattern Recognit..

[4]  Romuere Rôdrigues Veloso e Silva,et al.  Automatic detection of motorcyclists without helmet , 2013, 2013 XXXIX Latin American Computing Conference (CLEI).

[5]  Chung-Ping Young,et al.  High-precision bicycle detection on single side-view image based on the geometric relationship , 2017, Pattern Recognit..

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  V. Khanaa,et al.  An Advanced Moving Object Detection Algorithm for Automatic Traffic Monitoring In Real-World Limited Bandwidth Networks , 2015 .

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Feng Wu,et al.  Background-Driven Salient Object Detection , 2017, IEEE Transactions on Multimedia.

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[11]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[12]  Dinesh Singh,et al.  Deep Spatio-Temporal Representation for Detection of Road Accidents Using Stacked Autoencoder , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  Mao Ye,et al.  Accurate object detection using memory-based models in surveillance scenes , 2017, Pattern Recognit..

[14]  Ravi Rautji,et al.  A comprehensive study of motorcycle fatalities in South Delhi , 2009 .

[15]  John Chiverton,et al.  Helmet presence classification with motorcycle detection and tracking , 2012 .

[16]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Carlos Busso,et al.  Modeling of Driver Behavior in Real World Scenarios Using Multiple Noninvasive Sensors , 2013, IEEE Transactions on Multimedia.

[18]  Chung-Cheng Chiu,et al.  Motorcycle Detection and Tracking System with Occlusion Segmentation , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[19]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Qi Wang,et al.  Locality constraint distance metric learning for traffic congestion detection , 2018, Pattern Recognit..

[24]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  C. Krishna Mohan,et al.  Visual Big Data Analytics for Traffic Monitoring in Smart City , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[26]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Romuere Rodrigues Veloso e Silva,et al.  Helmet Detection on Motorcyclists Using Image Descriptors and Classifiers , 2014, 2014 27th SIBGRAPI Conference on Graphics, Patterns and Images.

[29]  C. Krishna Mohan,et al.  Detection of motorcyclists without helmet in videos using convolutional neural network , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[30]  Dhiraj Manohar Dhane,et al.  A review of recent advances in lane detection and departure warning system , 2018, Pattern Recognit..

[31]  Rattapoom Waranusast,et al.  Machine vision techniques for motorcycle safety helmet detection , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[32]  Neil Martin Robertson,et al.  Deep Head Pose: Gaze-Direction Estimation in Multimodal Video , 2015, IEEE Transactions on Multimedia.

[33]  C. Krishna Mohan,et al.  Automatic detection of bike-riders without helmet using surveillance videos in real-time , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[34]  Qingshan Liu,et al.  Robust Visual Tracking via Convolutional Networks Without Training , 2015, IEEE Transactions on Image Processing.

[35]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[36]  C. Krishna Mohan,et al.  Spontaneous Facial Expression Recognition: A Part Based Approach , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).