Driver distraction detection using capsule network

With the onset of the new technological age, the distractions caused due to handheld devices have been a major cause of traffic accidents as they affect the decision-making capabilities of the driver and give them less time to react to difficult situations. Often drivers try to multitask which reduces their reaction time leading to accidents which could have been easily avoided if they had been attentive. As such problems are related to the driver’s negligence toward safety, a possible solution is to monitor driver’s behavior and notify if they are distracted. We propose a CapsNet-based approach for detecting the distracted driver which is a novel approach. The proposed method scores perform well on the real-world environment inputs when compared to other famous methods used for the same. Our proposed methods get high scores for all the most commonly used metrics for classification. On the testing set, the proposed method gets an accuracy of 0.90, 0.92 as precision score, 0.90 as recall score and 0.91 as F-measure.

[1]  Cesare Alippi,et al.  Moving Convolutional Neural Networks to Embedded Systems: The AlexNet and VGG-16 Case , 2018, 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[2]  Fernando Alfredo Auat Cheeín,et al.  Sleepiness Detection for Cooperative Vehicle Navigation Strategies , 2018, 2018 5th International Conference on Control, Decision and Information Technologies (CoDIT).

[3]  Xuelong Li,et al.  Convolution in Convolution for Network in Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Guangyao Li,et al.  Capsules Encoder and Capsgan for Image Inpainting , 2019, 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM).

[5]  Arief Koesdwiady,et al.  End-to-End Deep Learning for Driver Distraction Recognition , 2017, ICIAR.

[6]  Byung-Tae Jang,et al.  Driver distraction detection using single convolutional neural network , 2017, 2017 International Conference on Information and Communication Technology Convergence (ICTC).

[7]  Jeffrey J. Rodriguez,et al.  Drive-Net: Convolutional Network for Driver Distraction Detection , 2018, 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[8]  Rahul Bhardwaj,et al.  Study to Determine the Effectiveness of Deep Learning Classifiers for ECG Based Driver Fatigue Classification , 2018, 2018 IEEE 13th International Conference on Industrial and Information Systems (ICIIS).

[9]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[10]  Aamir Saeed Malik,et al.  A Review on EEG-Based Automatic Sleepiness Detection Systems for Driver , 2018, IEEE Access.

[11]  Ying Wang,et al.  Detection of Driver Cognitive Distraction: A Comparison Study of Stop-Controlled Intersection and Speed-Limited Highway , 2016, IEEE Transactions on Intelligent Transportation Systems.

[12]  Jianfeng Hu,et al.  Real-time eye tracking for the assessment of driver fatigue , 2018, Healthcare technology letters.

[13]  Omid Dehzangi,et al.  Characterization and Identification of Driver Distraction During Naturalistic Driving: An Analysis of ECG Dynamics , 2019, Advances in Body Area Networks I.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[16]  M. N. Doja,et al.  Detecting distraction of drivers using Convolutional Neural Network , 2020, Pattern Recognit. Lett..

[17]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[18]  Karel Brookhuis,et al.  Dynamic Maximum Speed Limits , 2012 .

[19]  Mudhakar Srivatsa,et al.  Darnet: a deep learning solution for distracted driving detection , 2017, Middleware '17.

[20]  Bryan Van Hal,et al.  Low-cost EEG-based sleep detection , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Jingang Yi,et al.  Driver Fatigue Detection Based on Machine Vision* , 2018, 2018 IEEE International Conference on Information and Automation (ICIA).

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Mohammed Quddus,et al.  Crash data quality for road safety research: Current state and future directions. , 2017, Accident; analysis and prevention.

[24]  Hesham M. Eraqi,et al.  Real-time Distracted Driver Posture Classification , 2017, ArXiv.