TEXIVE: Detecting Drivers Using Personal Smart Phones by Leveraging Inertial Sensors

In this work, we address a fundamental and critical task of detecting the behavior of driving and texting using smartphones carried by users. We propose, design, and implement TEXIVE that leverages various sensors integrated in the smartphone and realizes our goal of distinguishing drivers and passengers and detecting texting using rich user micro-movements and irregularities that can be detected by sensors in the phone before and during driving and texting. Without relying on external infrastructure, TEXIVE has an advantage of being readily implemented and adopted, while at the same time raising a number of challenges that need to be carefully addressed for achieving a successful detection with good sensitivity, specificity, accuracy, and precision. Our system distinguishes the driver and passengers by detecting whether a user is entering a vehicle or not, inferring which side of the vehicle s/he is entering, reasoning whether the user is siting in front or rear seats, and discovering if a user is texting by fusing multiple evidences collected from accelerometer, magnetometer, and gyroscope sensors. To validate our approach, we conduct extensive experiments with several users on various vehicles and smartphones. Our evaluation results show that TEXIVE has a classification accuracy of 87.18%, and precision of 96.67%.

[1]  Jana Dittmann,et al.  Hand-movement-based in-vehicle driver/front-seat passenger discrimination for centre console controls , 2010, Electronic Imaging.

[2]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[3]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[4]  Mohamed N. El-Derini,et al.  GAC: Energy-Efficient Hybrid GPS-Accelerometer-Compass GSM Localization , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[5]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[6]  Romit Roy Choudhury,et al.  In-Vehicle Driver Detection Using Mobile Phone Sensors , 2011 .

[7]  R. Jafari,et al.  Body sensor networks for driver distraction identification , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[8]  Gustav Markkula,et al.  Driver Distraction Detection with a Camera Vision System , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[10]  Paramvir Bahl,et al.  Poster: you driving? talk to you later , 2011, ACM SIGMOBILE International Conference on Mobile Systems, Applications, and Services.

[11]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[12]  Osama Masoud,et al.  Vision-based methods for driver monitoring , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[13]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[14]  Jason I. Hong,et al.  Undistracted driving: a mobile phone that doesn't distract , 2011, HotMobile '11.

[15]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[16]  Mikael Wiberg,et al.  Managing availability: Supporting lightweight negotiations to handle interruptions , 2005, TCHI.

[17]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[18]  Anne T McCartt,et al.  Cell Phones and Driving: Review of Research , 2006, Traffic injury prevention.

[19]  F. Ichikawa,et al.  Where's The Phone? A Study of Mobile Phone Location in Public Spaces , 2005, 2005 2nd Asia Pacific Conference on Mobile Technology, Applications and Systems.

[20]  Ramachandran Ramjee,et al.  Nericell: rich monitoring of road and traffic conditions using mobile smartphones , 2008, SenSys '08.

[21]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[22]  F. Cheung National Highway Traffic Safety Administration (NHTSA) notes. An analysis of alcohol-related motor vehicle fatalities by ethnicity. , 1999, Annals of emergency medicine.

[23]  Christian Kohlschein An introduction to Hidden Markov Models , 2007 .

[24]  Pat Langley,et al.  An Analysis of Bayesian Classifiers , 1992, AAAI.

[25]  Sara A. Bly,et al.  Quiet calls: talking silently on mobile phones , 2001, CHI.

[26]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[27]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[28]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[29]  Ryan Newton,et al.  The pothole patrol: using a mobile sensor network for road surface monitoring , 2008, MobiSys '08.

[30]  Dario D. Salvucci Predicting the effects of in-car interfaces on driver behavior using a cognitive architecture , 2001, CHI.

[31]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[32]  Uwe Hansmann,et al.  Pervasive Computing , 2003 .

[33]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[34]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[35]  G. Dimitrakopoulos,et al.  Intelligent Transportation Systems , 2010, IEEE Vehicular Technology Magazine.

[36]  Patrick Baudisch,et al.  Blindsight: eyes-free access to mobile phones , 2008, CHI.