A Machine-Learning Approach to Distinguish Passengers and Drivers Reading While Driving

Driver distraction is one of the major causes of traffic accidents. In recent years, given the advance in connectivity and social networks, the use of smartphones while driving has become more frequent and a serious problem for safety. Texting, calling, and reading while driving are types of distractions caused by the use of smartphones. In this paper, we propose a non-intrusive technique that uses only data from smartphone sensors and machine learning to automatically distinguish between drivers and passengers while reading a message in a vehicle. We model and evaluate seven cutting-edge machine-learning techniques in different scenarios. The Convolutional Neural Network and Gradient Boosting were the models with the best results in our experiments. Results show accuracy, precision, recall, F1-score, and kappa metrics superior to 0.95.

[1]  Gustav Markkula,et al.  Driver Distraction Detection with a Camera Vision System , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Bryan Reimer,et al.  A study of young adults examining phone dialing while driving using a touchscreen vs. a button style flip-phone , 2014 .

[3]  Khaled Shaaban,et al.  Investigating Cell Phone Use While Driving in Qatar , 2013 .

[4]  Pushpa Choudhary,et al.  Mobile phone use during driving: Effects on speed and effectiveness of driver compensatory behaviour. , 2017, Accident; analysis and prevention.

[5]  Sherif Ishak,et al.  Detection of driver engagement in secondary tasks from observed naturalistic driving behavior. , 2017, Accident; analysis and prevention.

[6]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Hesham M. Eraqi,et al.  Driver Distraction Identification with an Ensemble of Convolutional Neural Networks , 2019, Journal of Advanced Transportation.

[8]  Munaf S. Najim Al-Din,et al.  Driver Behavior Detection Techniques : A survey , 2018 .

[9]  Shaojie Tang,et al.  Drive Now, Text Later: Nonintrusive Texting-While-Driving Detection Using Smartphones , 2017, IEEE Transactions on Mobile Computing.

[10]  Björn W. Schuller,et al.  Deep Learning for Environmentally Robust Speech Recognition , 2017, ACM Trans. Intell. Syst. Technol..

[11]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.

[12]  I. Pavlidis,et al.  Dissecting Driver Behaviors Under Cognitive, Emotional, Sensorimotor, and Mixed Stressors , 2016, Scientific Reports.

[13]  Marco Botta,et al.  Real-Time Detection System of Driver Distraction Using Machine Learning , 2013, IEEE Transactions on Intelligent Transportation Systems.

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  Yung-Ching Liu,et al.  Risk prediction model for drivers’ in-vehicle activities – Application of task analysis and back-propagation neural network , 2013 .

[17]  George Yannis,et al.  Simulation of texting impact on young drivers' behavior and safety on motorways , 2016 .

[18]  Y. T. Zhou,et al.  Computation of optical flow using a neural network , 1988, IEEE 1988 International Conference on Neural Networks.

[19]  S. Chandrakala,et al.  Android OpenCV based effective driver fatigue and distraction monitoring system , 2015, 2015 International Conference on Computing and Communications Technologies (ICCCT).

[20]  Kenneth Sundaraj,et al.  A physiological measures-based method for detecting inattention in drivers using machine learning approach , 2015 .

[21]  Mohan M. Trivedi,et al.  On generalizing driver gaze zone estimation using convolutional neural networks , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[22]  Krsto Lipovac,et al.  Mobile phone use while driving-literary review , 2017 .

[23]  Omid Dehzangi,et al.  Detection of distraction under naturalistic driving using Galvanic Skin Responses , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[24]  Joseph M. Crandall,et al.  Mutual interferences of driving and texting performance , 2015, Comput. Hum. Behav..

[25]  Yoshihiko Suhara,et al.  Driver behavior profiling: An investigation with different smartphone sensors and machine learning , 2017, PloS one.

[26]  Jonathan M. Hankey,et al.  Description of the SHRP 2 Naturalistic Database and the Crash, Near-Crash, and Baseline Data Sets , 2016 .

[27]  Raja Bala,et al.  Estimating Gaze Direction of Vehicle Drivers Using a Smartphone Camera , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[28]  Maya Samaha Rupert,et al.  Relationships among smartphone addiction, stress, academic performance, and satisfaction with life , 2016, Comput. Hum. Behav..

[29]  Xiang-Yang Li,et al.  You're driving and texting: detecting drivers using personal smart phones by leveraging inertial sensors , 2013, MobiCom.

[30]  Simon Washington,et al.  Decisions and actions of distracted drivers at the onset of yellow lights. , 2016, Accident; analysis and prevention.

[31]  Yixiao Yun,et al.  Video-based detection and analysis of driver distraction and inattention , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[32]  Liu Zhiqiang,et al.  The Study of Driver Distraction Characteristic Detection Technology , 2010, 2010 International Forum on Information Technology and Applications.

[33]  Rafael A. Berri,et al.  A pattern recognition system for detecting use of mobile phones while driving , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[34]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[35]  G. M. Allan,et al.  Kappa statistic , 2005, Canadian Medical Association Journal.

[36]  Giovanni Alcantara,et al.  Empirical analysis of non-linear activation functions for Deep Neural Networks in classification tasks , 2017, ArXiv.

[37]  Byungyong You,et al.  Driver distraction detection by in-vehicle signal processing , 2014, 2014 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[38]  Janet Wesson,et al.  Using machine learning to predict the driving context whilst driving , 2013, SAICSIT '13.

[39]  Alex M. Andrew,et al.  Boosting: Foundations and Algorithms , 2012 .

[40]  S. M. Mahbubur Rahman,et al.  Tracking-based detection of driving distraction from vehicular interior video , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[41]  Mudhakar Srivatsa,et al.  Darnet: a deep learning solution for distracted driving detection , 2017, Middleware '17.

[42]  Arief Koesdwiady,et al.  End-to-End Deep Learning for Driver Distraction Recognition , 2017, ICIAR.

[43]  Daniel V. McGehee,et al.  Using Naturalistic Driving Data to Examine Teen Driver Behaviors Present in Motor Vehicle Crashes, 2007-2015 , 2016 .

[44]  Carlos Busso,et al.  Analysis of facial features of drivers under cognitive and visual distractions , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[45]  Lidia P. Kostyniuk,et al.  National Survey on Distracted Driving Attitudes and Behaviors -- 2012 , 2013 .

[46]  Xiang-Yang Li,et al.  Detecting Driver’s Smartphone Usage via Nonintrusively Sensing Driving Dynamics , 2017, IEEE Internet of Things Journal.

[47]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[48]  Marios Savvides,et al.  Multiple Scale Faster-RCNN Approach to Driver’s Cell-Phone Usage and Hands on Steering Wheel Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[49]  S. Rigatti Random Forest. , 2017, Journal of insurance medicine.

[50]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[51]  Degui Xiao,et al.  Detection of drivers visual attention using smartphone , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[52]  Omer Tsimhoni,et al.  Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks , 2010, IEEE Transactions on Intelligent Transportation Systems.

[53]  Carlos Busso,et al.  Detecting Drivers' Mirror-Checking Actions and Its Application to Maneuver and Secondary Task Recognition , 2016, IEEE Transactions on Intelligent Transportation Systems.

[54]  Girish Chowdhary,et al.  Real‐time detection of distracted driving based on deep learning , 2018, IET Intelligent Transport Systems.

[55]  Sergio Sister,et al.  São Paulo, Brazil , 2019, The Statesman’s Yearbook Companion.

[56]  Abdul Wahab,et al.  Driver identification and driver's emotion verification using KDE and MLP neural networks , 2010, Proceeding of the 3rd International Conference on Information and Communication Technology for the Moslem World (ICT4M) 2010.

[57]  Richard P. Martin,et al.  Determining Driver Phone Use by Exploiting Smartphone Integrated Sensors , 2016, IEEE Transactions on Mobile Computing.

[58]  Neil K Chaudhary,et al.  The influence of roadway situation, other contextual factors, and driver characteristics on the prevalence of driver secondary behaviors , 2016 .

[59]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.