Smartphone sensing for understanding driving behavior: Current practice and challenges

Abstract Understanding driving behavior – even in the rapid emergence of automation - remains in the spotlight, for decomposing complex driving dynamics, enabling the development of user-friendly and acceptable autonomous vehicles and ensuring the safe co-existence of autonomous and conventional vehicles on the road. Mobile crowdsensing has emerged as a means to understand and model driving behavior. Although the advantages of collecting data through smartphones are many (speed, accuracy, low cost etc.), the challenges including, but do not limited to, the preparation rate, the processing needs, as well as the methodological, legislative and security issues, are significant. The present paper aims to review the research dedicated to analyzing driving behavior based on smartphone sensors’ data streams. We first establish an inclusive stepwise framework to describe the path from data collection to informed decision making. Next, the existing literature is thoroughly analyzed and challenges in relation to data collection and data mining practices are critically discussed placing particular emphasis on the limitations and concerns regarding the use of mobile phones for driving data collection, as well as using crowd sensed data for feature extraction. Subsequently, modeling driving behavior practices and end-to-end solutions for driver assistance and recommendation systems are also reviewed. The paper ends with a discussion on the most critical challenges arising from the literature and future research steps.

[1]  Mehdi Ghatee,et al.  A context aware system for driving style evaluation by an ensemble learning on smartphone sensors data , 2018 .

[2]  Sriram Chellappan,et al.  Leveraging Smartphone Sensors to Detect Distracted Driving Activities , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Gurdit Singh,et al.  A smartphone based technique to monitor driving behavior using DTW and crowdsensing , 2017, Pervasive Mob. Comput..

[4]  Teck Kai Chan,et al.  A Comprehensive Review of Driver Behavior Analysis Utilizing Smartphones , 2020, IEEE Transactions on Intelligent Transportation Systems.

[5]  Cindie Andrieu,et al.  Using statistical models to characterize eco-driving style with an aggregated indicator , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[6]  Daniel G. Aliaga,et al.  Urban sensing: Using smartphones for transportation mode classification , 2015, Comput. Environ. Urban Syst..

[7]  Huadong Ma,et al.  Opportunities in mobile crowd sensing , 2014, IEEE Communications Magazine.

[8]  Eleni I. Vlahogianni,et al.  Identification of Driving Safety Profiles from Smartphone Data Using Machine Learning Techniques , 2019 .

[9]  Laura Eboli,et al.  Combining speed and acceleration to define car users’ safe or unsafe driving behaviour , 2016 .

[10]  Siani Pearson,et al.  Privacy and Security for Cloud Computing , 2012, Computer Communications and Networks.

[11]  Bratislav Predic,et al.  Enhancing driver situational awareness through crowd intelligence , 2015, Expert Syst. Appl..

[12]  Tsippy Lotan,et al.  Can novice drivers be motivated to use a smartphone based app that monitors their behavior , 2016 .

[13]  Suttipong Thajchayapong,et al.  Detection of Driving Events using Sensory Data on Smartphone , 2017, Int. J. Intell. Transp. Syst. Res..

[14]  Siani Pearson,et al.  Privacy, Security and Trust in Cloud Computing , 2013 .

[15]  Robert Boguslaw,et al.  Privacy and Freedom , 1968 .

[16]  George Yannis,et al.  Innovative motor insurance schemes: A review of current practices and emerging challenges. , 2017, Accident; analysis and prevention.

[17]  Fridulv Sagberg,et al.  A Review of Research on Driving Styles and Road Safety , 2015, Hum. Factors.

[18]  George Yannis,et al.  Analysis of driver behaviour through smartphone data: The case of mobile phone use while driving , 2019, Safety Science.

[19]  Frank Köster,et al.  Evaluation of an eco-driving support system , 2014 .

[20]  Yoshihiko Suhara,et al.  Driver behavior profiling: An investigation with different smartphone sensors and machine learning , 2017, PloS one.

[21]  George Yannis,et al.  Estimating the Necessary Amount of Driving Data for Assessing Driving Behavior , 2020, Sensors.

[22]  Shaojie Tang,et al.  Who Sits Where? Infrastructure-Free In-Vehicle Cooperative Positioning via Smartphones , 2014, Sensors.

[23]  Erhan Akin,et al.  Estimating driving behavior by a smartphone , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[24]  Antti Jylhä,et al.  Towards an Applied Gamification Model for Tracking, Managing, & Encouraging Sustainable Travel Behaviours , 2014, EAI Endorsed Trans. Ambient Syst..

[25]  Linlin Wu,et al.  Travel Mode Detection Based on GPS Raw Data Collected by Smartphones: A Systematic Review of the Existing Methodologies , 2016, Inf..

[26]  Xiaohua Zhao,et al.  An analysis of the relationship between driver characteristics and driving safety using structural equation models , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[27]  Luis Miguel Bergasa,et al.  DriveSafe: An app for alerting inattentive drivers and scoring driving behaviors , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[28]  Eleni I. Vlahogianni,et al.  Statistical methods versus neural networks in transportation research: Differences, similarities and some insights , 2011 .

[29]  Wen-Hua Chen,et al.  A machine learning based personalized system for driving state recognition , 2019, Transportation Research Part C: Emerging Technologies.

[30]  Mohan M. Trivedi,et al.  Driving style recognition using a smartphone as a sensor platform , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[31]  Timo Juhani Lajunen,et al.  Self-Report Instruments and Methods , 2011 .

[32]  Nicolas Saunier,et al.  Vehicle manoeuvers as surrogate safety measures: Extracting data from the gps-enabled smartphones of regular drivers. , 2018, Accident; analysis and prevention.

[33]  Hong Yang,et al.  Modeling and Analysis of Daily Driving Patterns of Taxis in Reshuffled Ride-Hailing Service Market , 2019, Journal of Transportation Engineering, Part A: Systems.

[34]  Eleni I. Vlahogianni,et al.  Identifying driving safety profiles from smartphone data using unsupervised learning , 2019, Safety Science.

[35]  Isaac Skog,et al.  Insurance Telematics: Opportunities and Challenges with the Smartphone Solution , 2014, IEEE Intelligent Transportation Systems Magazine.

[36]  Thierry Derrmann,et al.  Driver Behavior Profiling Using Smartphones: A Low-Cost Platform for Driver Monitoring , 2015, IEEE Intelligent Transportation Systems Magazine.

[37]  Delphine Christin,et al.  Privacy in mobile participatory sensing , 2016 .

[38]  Mohsen Guizani,et al.  Improved Vehicle Steering Pattern Recognition by Using Selected Sensor Data , 2018, IEEE Transactions on Mobile Computing.

[39]  Baher Abdulhai,et al.  Using Smartphones and Sensor Technologies to Automate Collection of Travel Data , 2013 .

[40]  Florian Michahelles,et al.  Driving behavior analysis with smartphones: insights from a controlled field study , 2012, MUM.

[41]  Rui Esteves Araujo,et al.  Driving coach: A smartphone application to evaluate driving efficient patterns , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[42]  Salil S. Kanhere,et al.  Participatory Sensing: Crowdsourcing Data from Mobile Smartphones in Urban Spaces , 2011, 2011 IEEE 12th International Conference on Mobile Data Management.

[43]  Emmanouil N. Barmpounakis,et al.  On the new era of urban traffic monitoring with massive drone data: The pNEUMA large-scale field experiment , 2020 .

[44]  Nikolaos Geroliminis,et al.  Lane Detection and Lane-Changing Identification with High-Resolution Data from a Swarm of Drones , 2020 .

[45]  Gys Albertus Marthinus Meiring,et al.  A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms , 2015, Sensors.

[46]  Konstantina Gkritza,et al.  Time series modeling in traffic safety research. , 2018, Accident; analysis and prevention.

[47]  Thomas Engel,et al.  An evaluation study of driver profiling fuzzy algorithms using smartphones , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[48]  George D. C. Cavalcanti,et al.  A study on combining dynamic selection and data preprocessing for imbalance learning , 2018, Neurocomputing.

[49]  Suman Banerjee,et al.  Practical driving analytics with smartphone sensors , 2017, 2017 IEEE Vehicular Networking Conference (VNC).

[50]  Stratis Kanarachos,et al.  Smartphones as an integrated platform for monitoring driver behaviour: The role of sensor fusion and connectivity , 2018, Transportation Research Part C: Emerging Technologies.

[51]  Lei Zhu,et al.  Studying Driving Risk Factors using Multi-Source Mobile Computing Data , 2015 .

[52]  Hjp Harry Timmermans,et al.  Transportation mode recognition using GPS and accelerometer data , 2013 .

[53]  Sasu Tarkoma,et al.  Accelerometer-based transportation mode detection on smartphones , 2013, SenSys '13.

[54]  Ha-Nam Nguyen,et al.  Vehicle Mode and Driving Activity Detection Based on Analyzing Sensor Data of Smartphones , 2018, Sensors.

[55]  Eleni I. Vlahogianni,et al.  Transportation Mode Detection from Low-Power Smartphone Sensors Using Tree-Based Ensembles , 2019 .

[56]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[57]  Hari Balakrishnan,et al.  Smartphone Placement Within Vehicles , 2020, IEEE Transactions on Intelligent Transportation Systems.

[58]  Ram Dantu,et al.  Safe Driving Using Mobile Phones , 2012, IEEE Transactions on Intelligent Transportation Systems.

[59]  Julio López,et al.  Dealing with high-dimensional class-imbalanced datasets: Embedded feature selection for SVM classification , 2018, Appl. Soft Comput..

[60]  Simon J. Godsill,et al.  Driver and Passenger Identification From Smartphone Data , 2019, IEEE Transactions on Intelligent Transportation Systems.

[61]  Ahmad Y. Javaid,et al.  Application Specific Drone Simulators: Recent Advances and Challenges , 2019, Simul. Model. Pract. Theory.

[62]  A. Glendon,et al.  Driver prototypes and behavioral willingness: Young driver risk perception and reported engagement in risky driving. , 2018, Journal of safety research.

[63]  Mehdi Ghatee,et al.  A similarity-based neuro-fuzzy modeling for driving behavior recognition applying fusion of smartphone sensors , 2019, J. Intell. Transp. Syst..

[64]  T. Dingus,et al.  The effect of passengers and risk-taking friends on risky driving and crashes/near crashes among novice teenagers. , 2011, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[65]  Hang-Bong Kang,et al.  Smartphone-based modeling and detection of aggressiveness reactions in senior drivers , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[66]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.

[67]  Licia Capra,et al.  Quality control for real-time ubiquitous crowdsourcing , 2011, UbiCrowd '11.

[68]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[69]  John L. Zhou,et al.  Eco-driving technology for sustainable road transport: A review , 2018, Renewable and Sustainable Energy Reviews.

[70]  Tapas Chakravarty,et al.  Investigations on Driver Unique Identification from Smartphone’s GPS Data Alone , 2018 .

[71]  Jiangtao Wang,et al.  Energy Saving Techniques in Mobile Crowd Sensing: Current State and Future Opportunities , 2018, IEEE Communications Magazine.

[72]  Corinne Mulley,et al.  Gamification in transport interventions: Another way to improve travel behavioural change , 2019, Cities.

[73]  Muhammad Naeem Ahmed Khan,et al.  A Review of Trust Aspects in Cloud Computing Security , 2013, CloudCom 2013.

[74]  Juan-Carlos Cano,et al.  Drivingstyles: a mobile platform for driving styles and fuel consumption characterization , 2016, Journal of Communications and Networks.

[75]  Philip S. Yu,et al.  Transportation mode detection using mobile phones and GIS information , 2011, GIS.

[76]  Jukka Riekki,et al.  Personalised assistance for fuel-efficient driving , 2015 .

[77]  Isaac Skog,et al.  Detection of Dangerous Cornering in GNSS-Data-Driven Insurance Telematics , 2015, IEEE Transactions on Intelligent Transportation Systems.

[78]  Gustavo Pessin,et al.  A Machine-Learning Approach to Distinguish Passengers and Drivers Reading While Driving , 2019, Sensors.

[79]  Isaac Skog,et al.  Smartphone-based Vehicle Telematics - A Ten-Year Anniversary , 2016, ArXiv.

[80]  ChristinDelphine Privacy in mobile participatory sensing , 2016 .

[81]  Eleni I. Vlahogianni,et al.  Driving analytics using smartphones: Algorithms, comparisons and challenges , 2017 .

[82]  Pranab K. Muhuri,et al.  A Review of the Scopes and Challenges of the Modern Real-Time Operating Systems , 2018, Int. J. Embed. Real Time Commun. Syst..

[83]  Aboelmagd Noureldin,et al.  GPS/INS integration utilizing dynamic neural networks for vehicular navigation , 2011, Inf. Fusion.

[84]  N. Shoval,et al.  Mobility Research in the Age of the Smartphone , 2016 .

[85]  Alois Geyer,et al.  Asymmetric Information in Automobile Insurance: Evidence from Driving Behavior , 2016, Journal of Risk and Insurance.

[86]  Mehdi Ghatee,et al.  An inference engine for smartphones to preprocess data and detect stationary and transportation modes , 2016 .

[87]  Jeffrey M Casello,et al.  Developing and Optimizing a Transportation Mode Inference Model Utilizing Data from GPS Embedded Smartphones , 2015 .

[88]  Hajar Mousannif,et al.  The application of machine learning techniques for driving behavior analysis: A conceptual framework and a systematic literature review , 2020, Eng. Appl. Artif. Intell..

[89]  Hong Cao,et al.  Mining smartphone data for app usage prediction and recommendations: A survey , 2017, Pervasive Mob. Comput..

[90]  Salil S. Kanhere,et al.  A survey on privacy in mobile participatory sensing applications , 2011, J. Syst. Softw..

[91]  Rajesh Rajamani,et al.  Smartphone localization inside a moving car for prevention of distracted driving , 2020 .