Smartphone based traffic state detection using acoustic analysis and crowdsourcing

Abstract Typically an Intelligent Transportation System (ITS) employs various types of infrastructure-based technologies into vehicles and roadways for monitoring traffic. But these solutions have high installation, maintenance, and operational costs. Further, most of these solutions are based on the assumptions of lane-based organized and homogeneous traffic, due to which these are ineffective in less organized traffic conditions which are common in developing countries. In this paper, we have proposed a cost-effective approach to infer the traffic state of the road by analyzing the cumulative acoustic signal collected from the microphone sensor of the user’s smartphone. To capture the distinctive characteristics of various traffic scenes, we explored two different types of features: Mel Frequency Cepstral Coefficients (MFCCs) and Wavelet Packet Transform (WPT). Based on the understanding of acoustic signals of different traffic scenes, various parameters of these features such as window size and MFCC dimensions are tuned for better detection accuracy and robustness. To validate the approach, field experiments were conducted in varied conditions on the roads of City X. Experimental results revealed that for binary traffic scene classification (‘busy-street’ vs. ‘quiet-street’), MFCC features are sufficient to get an overall accuracy of 100%. However, for ‘congestion’ vs. ‘medium-flow’ vs. ‘free-flow’ traffic scene classification, MFCC features yield a bit lower accuracy of 77.64%. In this scenario, it was observed that WPT features can be used to reduce the false positive rate, thereby providing an absolute gain of 11.38% in the classification accuracy over the MFCC baseline. Also, it has been observed that by crowdsourcing the traffic state information from multiple users’ smartphones, an effective accuracy improvement can be achieved for each traffic scene.

[1]  Amir Averbuch,et al.  Wavelet-based acoustic detection of moving vehicles , 2009, Multidimens. Syst. Signal Process..

[2]  Stan Davis,et al.  Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Se , 1980 .

[3]  Bhaskaran Raman,et al.  RoadSoundSense: Acoustic sensing based road congestion monitoring in developing regions , 2011, 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[4]  Yan Song Wang,et al.  Sound quality recognition using optimal wavelet-packet transform and artificial neural network methods , 2016 .

[5]  Bhaskaran Raman,et al.  Horn-ok-please , 2010, MobiSys '10.

[6]  J. Kato An attempt to acquire traffic density by using road traffic sound , 2005, Proceedings of the 2005 International Conference on Active Media Technology, 2005. (AMT 2005)..

[7]  Saul Rodriguez,et al.  Real-Time Urban Traffic State Estimation with A-GPS Mobile Phones as Probes , 2012 .

[8]  Zhongxian Li,et al.  Application of Cement-Based Piezoelectric Sensors for Monitoring Traffic Flows , 2006 .

[9]  Helmut Hlavacs,et al.  Cellular data meet vehicular traffic theory: location area updates and cell transitions for travel time estimation , 2012, UbiComp '12.

[10]  Bhaskaran Raman,et al.  Kyun queue: a sensor network system to monitor road traffic queues , 2012, SenSys '12.

[11]  Ryan Newton,et al.  The pothole patrol: using a mobile sensor network for road surface monitoring , 2008, MobiSys '08.

[12]  Purushottam Kulkarni,et al.  Wolverine: Traffic and road condition estimation using smartphone sensors , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[13]  D. Bianchi,et al.  Wavelet packet transform for detection of single events in acoustic emission signals , 2015 .

[14]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Arnaud Can,et al.  Traffic noise spectrum analysis: dynamic modeling vs. experimental observations , 2010 .

[16]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 2000, IEEE Trans. Intell. Transp. Syst..

[17]  Bhavdeep Sachdeva,et al.  Traffic state detection using smartphone based acoustic sensing , 2017, J. Intell. Fuzzy Syst..

[18]  Alexandre M. Bayen,et al.  Evaluation of traffic data obtained via GPS-enabled mobile phones: The Mobile Century field experiment , 2009 .

[19]  Gaetano Valenti,et al.  Traffic Estimation And Prediction Based On Real Time Floating Car Data , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[20]  Daljeet Kaur Khanduja,et al.  Time Domain Signal Analysis Using Wavelet Packet Decomposition Approach , 2010, Int. J. Commun. Netw. Syst. Sci..

[21]  Parameswaran Ramanathan,et al.  VividhaVahana: smartphone based vehicle classification and its applications in developing region , 2014, MobiQuitous.

[22]  Rajesh Krishna Balan,et al.  Real-time trip information service for a large taxi fleet , 2011, MobiSys '11.

[23]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[24]  Vesa T. Peltonen,et al.  Audio-based context recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Mingyan Liu,et al.  Surface street traffic estimation , 2007, MobiSys '07.

[26]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[27]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[28]  Shivkumar Kalyanaraman,et al.  Vehicular Traffic Density State Estimation Based on Cumulative Road Acoustics , 2012, IEEE Transactions on Intelligent Transportation Systems.

[29]  Fei-Yue Wang,et al.  Toward Intelligent Transportation Systems for the 2008 Olympics , 2003, IEEE Intell. Syst..

[30]  Hillel Bar-Gera,et al.  Evaluation of a Cellular Phone-Based System for Measurements of Traffic Speeds and Travel Times: A Case Study from Israel , 2007 .

[31]  Matti Siekkinen,et al.  Smartphone Energy Consumption: Modeling and Optimization , 2014 .

[32]  Desire L. Massart,et al.  Noise suppression and signal compression using the wavelet packet transform , 1997 .

[33]  Muhammed Gökhan Cinsdikici,et al.  Vehicle-Classification Algorithm Based on Component Analysis for Single-Loop Inductive Detector , 2010, IEEE Transactions on Vehicular Technology.

[34]  Suttipong Thajchayapong,et al.  Enhanced detection of road traffic congestion areas using cell dwell times , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[35]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Andry Rakotonirainy,et al.  Acoustic Hazard Detection for Pedestrians With Obscured Hearing , 2011, IEEE Transactions on Intelligent Transportation Systems.

[37]  Sinem Coleri,et al.  Traffic Measurement and Vehicle Classification with a Single Magnetic Sensor , 2004 .

[38]  K. R. Rao,et al.  Measuring Urban Traffic Congestion - A Review , 2012 .

[39]  Douglas C. Schmidt,et al.  WreckWatch: Automatic Traffic Accident Detection and Notification with Smartphones , 2011, Mob. Networks Appl..

[40]  M. Zuo,et al.  Gearbox fault detection using Hilbert and wavelet packet transform , 2006 .

[41]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.

[42]  Jun Han,et al.  ACComplice: Location inference using accelerometers on smartphones , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[43]  Mohamed S. Gadala,et al.  Roller bearing acoustic signature extraction by wavelet packet transform, applications in fault detection and size estimation , 2016 .

[44]  Volkan Cevher,et al.  Vehicle Speed Estimation Using Acoustic Wave Patterns , 2009, IEEE Transactions on Signal Processing.

[45]  Dan Stowell,et al.  A database and challenge for acoustic scene classification and event detection , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[46]  A. Rydberg,et al.  A vehicle classification system based on microwave radar measurement of height profiles , 2002, RADAR 2002.

[47]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[48]  Pushpendra Singh,et al.  Using mobile phone sensors to detect driving behavior , 2013, ACM DEV '13.

[49]  Renate Sitte,et al.  Comparison of techniques for environmental sound recognition , 2003, Pattern Recognit. Lett..

[50]  Sivan Toledo,et al.  VTrack: accurate, energy-aware road traffic delay estimation using mobile phones , 2009, SenSys '09.

[51]  Ramachandran Ramjee,et al.  Nericell: rich monitoring of road and traffic conditions using mobile smartphones , 2008, SenSys '08.

[52]  James F. Forren,et al.  Traffic monitoring by tire noise , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[53]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[54]  Xiaojie Wu,et al.  A Road Congestion Detection System Using Undedicated Mobile Phones , 2015, IEEE Transactions on Intelligent Transportation Systems.

[55]  Shiping Chen,et al.  Traffic monitoring using digital sound field mapping , 2001, IEEE Trans. Veh. Technol..

[56]  Jian Fan,et al.  Texture Classification by Wavelet Packet Signatures , 1993, MVA.