Towards Computationally Efficient and Realtime Distracted Driver Detection With MobileVGG Network

According to the World Health Organization (WHO) report, the number of road traffic deaths have been continuously increasing since last few years though the rate of deaths relative to world's population has stabilized in recent years. As per the survey of National Highway Traffic Safety Administration (NHTSA), distracted driving is a leading factor in road accidents. In this paper, we present a Convolutional Neural Network (CNN) based approach for detecting and classifying the driver distraction. In the development of safety features for Advanced Driver Assistance Systems, the algorithm not only has to be accurate but also efficient in terms of memory and speed. Hence, we focused on developing computationally efficient CNN while maintaining good accuracy. We propose a new architecture named as mobileVGG based on depthwise separable convolutions. We evaluate results of the proposed network on the American University in Cairo (AUC) distracted driver detection dataset as well as Statefarm's dataset on Kaggle and compare the performance with state-of-the-art CNN architectures from literature. Our proposed mobileVGG architecture with just 2.2M parameters outperforms earlier approaches while achieving 95.24% and 99.75% accuracy on AUC and Statefarm's dataset respectively with less computational complexity and memory requirement.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Kang G. Shin,et al.  Automatic Identification of Driver’s Smartphone Exploiting Common Vehicle-Riding Actions , 2018, IEEE Transactions on Mobile Computing.

[3]  Mohan M. Trivedi,et al.  Driver hand activity analysis in naturalistic driving studies: challenges, algorithms, and experimental studies , 2013, J. Electronic Imaging.

[4]  Bailing Zhang,et al.  Recognition of driving postures by contourlet transform and random forests , 2012 .

[5]  Bhakti Baheti,et al.  Eff-UNet: A Novel Architecture for Semantic Segmentation in Unstructured Environment , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Bailing Zhang,et al.  Erratum to: Recognition of driving postures by combined features and random subspace ensemble of multilayer perceptron classifiers , 2012, Neural Computing and Applications.

[8]  Yaobin Chen,et al.  Studying the Effects of Driver Distraction and Traffic Density on the Probability of Crash and Near-Crash Events in Naturalistic Driving Environment , 2013, IEEE Transactions on Intelligent Transportation Systems.

[9]  Bhakti Baheti,et al.  Pose Estimation for Distracted Driver Detection Using Deep Convolutional Neural Networks , 2018, Communications in Computer and Information Science.

[10]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Mohan M. Trivedi,et al.  On Performance Evaluation of Driver Hand Detection Algorithms: Challenges, Dataset, and Metrics , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[12]  Andreas Savakis,et al.  Distracted Driver Detection: Deep Learning vs Handcrafted Features , 2017 .

[13]  Charlene Hallett,et al.  Driver distraction and driver inattention: definition, relationship and taxonomy. , 2011, Accident; analysis and prevention.

[14]  Mohan M. Trivedi,et al.  Understanding head and hand activities and coordination in naturalistic driving videos , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[15]  Yaser P. Fallah,et al.  An Adaptive Forward Collision Warning Framework Design Based on Driver Distraction , 2018, IEEE Transactions on Intelligent Transportation Systems.

[16]  Nanning Zheng,et al.  Visual recognition of driver hand-held cell phone use based on hidden CRF , 2011, Proceedings of 2011 IEEE International Conference on Vehicular Electronics and Safety.

[17]  S. Daniel,et al.  National Highway Traffic Safety Administration , 2020, Federal Regulatory Guide.

[18]  M. N. Doja,et al.  Detecting distraction of drivers using Convolutional Neural Network , 2020, Pattern Recognit. Lett..

[19]  Mohan M. Trivedi,et al.  Head, Eye, and Hand Patterns for Driver Activity Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[20]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Mohan M. Trivedi,et al.  In-vehicle hand activity recognition using integration of regions , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[22]  Ujjwal Baid,et al.  Detection of Pathological Myopia and Optic Disc Segmentation with Deep Convolutional Neural Networks , 2019, TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON).

[23]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Ilya V. Kolmanovsky,et al.  Visual-Manual Distraction Detection Using Driving Performance Indicators With Naturalistic Driving Data , 2018, IEEE Transactions on Intelligent Transportation Systems.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[27]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[28]  Hesham M. Eraqi,et al.  Real-time Distracted Driver Posture Classification , 2017, ArXiv.

[29]  Abhishek Mahajan,et al.  A Novel Approach for Fully Automatic Intra-Tumor Segmentation With 3D U-Net Architecture for Gliomas , 2020, Frontiers in Computational Neuroscience.

[30]  Sanjay N. Talbar,et al.  Deep Learning Radiomics Algorithm for Gliomas (DRAG) Model: A Novel Approach Using 3D UNET Based Deep Convolutional Neural Network for Predicting Survival in Gliomas , 2018, BrainLes@MICCAI.

[31]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Bhakti Baheti,et al.  Semantic Scene Understanding in Unstructured Environment with Deep Convolutional Neural Network , 2019, TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON).

[33]  Girish Chowdhary,et al.  Real‐time detection of distracted driving based on deep learning , 2018, IET Intelligent Transport Systems.

[34]  Dongpu Cao,et al.  Identification and Analysis of Driver Postures for In-Vehicle Driving Activities and Secondary Tasks Recognition , 2018, IEEE Transactions on Computational Social Systems.

[35]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[36]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[37]  Tamitza Toroyan,et al.  Global status report on road safety , 2009, Injury Prevention.

[38]  D J Victor,et al.  Road accidents in India , 1989 .

[39]  A. Ng.  Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[40]  Dinesh Mohan,et al.  Road Accidents in India , 2009 .

[41]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[44]  J. R. MacDonald.  The Government of India , 2017 .

[45]  Frans Coenen,et al.  Driving posture recognition by convolutional neural networks , 2015, 2015 11th International Conference on Natural Computation (ICNC).

[46]  Ardhendu Behera,et al.  Latent Body-Pose guided DenseNet for Recognizing Driver’s Fine-grained Secondary Activities , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[47]  Marios Savvides,et al.  Driver cell phone usage detection on Strategic Highway Research Program (SHRP2) face view videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[48]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[49]  Marios Savvides,et al.  Multiple Scale Faster-RCNN Approach to Driver’s Cell-Phone Usage and Hands on Steering Wheel Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[50]  Yin Wang,et al.  The 1st Agriculture-Vision Challenge: Methods and Results , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[51]  Sanjay N. Talbar,et al.  Detection of Distracted Driver Using Convolutional Neural Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).