Acoustic-based Object Detection for Pedestrian Using Smartphone

Walking while using a smartphone is becoming a major pedestrian safety concern as people may unknowingly bump into various obstacles that could lead to severe injuries. In this paper, we propose ObstacleWatch, an acoustic-based obstacle collision detection system to improve the safety of pedestrians who are engaged in smartphone usage while walking. ObstacleWatch leverages the advanced audio hardware of the smartphone to sense the surrounding obstacles and infers fine-grained information about the frontal obstacle for collision detection. In particular, our system emits well-designed inaudible beep signals from the smartphone built-in speaker and listens to the reflections with the stereo recording of the smartphone. By analyzing the reflected signals received at two microphones, ObstacleWatch is able to extract fine-grained information of the frontal obstacle including the distance, angle and size for detecting the possible collisions and to alert users. Our experimental evaluation under two real-world environments with different types of phones and obstacles shows that ObstacleWatch achieves over 92% accuracy in predicting obstacle collisions with distance estimation errors at about 2 cm. Results also show that ObstacleWatch is robust to different sizes of objects and is compatible to different phone models with low energy consumption.

[1]  Jamario White,et al.  Distracted walking: Examining the extent to pedestrian safety problems , 2015 .

[2]  Wade Trappe,et al.  Auto++: Detecting Cars Using Embedded Microphones in Real-Time , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[3]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[4]  J. Klauder,et al.  The theory and design of chirp radars , 1960 .

[5]  Heena Rathore,et al.  Towards a Practical Pedestrian Distraction Detection Framework using Wearables , 2017, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[6]  Gang Wang,et al.  I am the antenna: accurate outdoor AP location using smartphones , 2011, MobiCom '11.

[7]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.

[8]  Sanglu Lu,et al.  An Efficient Walking Safety Service for Distracted Mobile Users , 2016, 2016 IEEE 13th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[9]  Guihai Chen,et al.  APT: Accurate outdoor pedestrian tracking with smartphones , 2013, 2013 Proceedings IEEE INFOCOM.

[10]  Leah L Thompson,et al.  Impact of social and technological distraction on pedestrian crossing behaviour: an observational study , 2012, Injury Prevention.

[11]  Yiu-Tong Chan,et al.  Passive localization from Doppler-shifted frequency measurements , 1992, IEEE Trans. Signal Process..

[12]  Shaojie Tang,et al.  InfraSee: An Unobtrusive Alertness System for Pedestrian Mobile Phone Users , 2017, IEEE Transactions on Mobile Computing.

[13]  Marco Gruteser,et al.  LookUp: Enabling Pedestrian Safety Services via Shoe Sensing , 2015, MobiSys.

[14]  H. C. Schau,et al.  Passive source localization employing intersecting spherical surfaces from time-of-arrival differences , 1987, IEEE Trans. Acoust. Speech Signal Process..

[15]  Despina Stavrinos,et al.  Distracted walking: cell phones increase injury risk for college pedestrians. , 2011, Journal of safety research.

[16]  Jiannong Cao,et al.  We help you watch your steps: Unobtrusive alertness system for pedestrian mobile phone users , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[17]  Tarak Gandhi,et al.  Pedestrian Protection Systems: Issues, Survey, and Challenges , 2007, IEEE Transactions on Intelligent Transportation Systems.

[18]  Christian Voigtmann,et al.  Evaluation of a Collaborative-Based Filter Technique to Proactively Detect Pedestrians at Risk , 2012, 2012 IEEE Vehicular Technology Conference (VTC Fall).

[19]  Guobin Shen,et al.  BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices , 2007, SenSys '07.

[20]  Sachin Katti,et al.  PinPoint: Localizing Interfering Radios , 2013, NSDI.

[21]  Kang G. Shin,et al.  Use of Phone Sensors to Enhance Distracted Pedestrians’ Safety , 2018, IEEE Transactions on Mobile Computing.

[22]  Heeyoung Kim,et al.  TrailSense: A Crowdsensing System for Detecting Risky Mountain Trail Segments with Walking Pattern Analysis , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[23]  Antonio Corradi,et al.  WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads , 2012, HotMobile '12.

[24]  Bhaskar D. Rao,et al.  A Two Microphone-Based Approach for Source Localization of Multiple Speech Sources , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  K. David,et al.  CAR-2-X and Pedestrian Safety , 2010, IEEE Vehicular Technology Magazine.

[26]  Chi-Han Lin,et al.  pSafety: A Collision Prevention System for Pedestrians Using Smartphone , 2016, 2016 IEEE 84th Vehicular Technology Conference (VTC-Fall).

[27]  Hojung Cha,et al.  Piggyback CrowdSensing (PCS): energy efficient crowdsourcing of mobile sensor data by exploiting smartphone app opportunities , 2013, SenSys '13.

[28]  Corey H Basch,et al.  Technology-related distracted walking behaviours in Manhattan's most dangerous intersections , 2014, Injury Prevention.

[29]  Jie Gao,et al.  Drive-By Localization of Roadside WiFi Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[30]  Naoki Hayashi,et al.  Moving Object Localization Using Sound-Based Positioning System with Doppler Shift Compensation , 2013, Robotics.

[31]  Douglas L. Jones,et al.  Localization of multiple acoustic sources with small arrays using a coherence test. , 2008, The Journal of the Acoustical Society of America.

[32]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[33]  Tadayoshi Kohno,et al.  CovertBand , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[34]  Habibur Rahman,et al.  Pulse Compression Radar , 2019, Fundamental Principles of Radar.

[35]  Klaus David,et al.  Combining Radio Transmission with Filters for Pedestrian Safety: Experiments and Simulations , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.

[36]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[37]  Lili Qiu,et al.  AIM: Acoustic Imaging on a Mobile , 2018, MobiSys.

[38]  David J. Edwards,et al.  SightSafety: A hybrid information and communication technology system for reducing vehicle/pedestrian collisions , 2006 .

[39]  Marco Gruteser,et al.  Recognizing Textures with Mobile Cameras for Pedestrian Safety Applications , 2017, IEEE Transactions on Mobile Computing.

[40]  Tsuyoshi Ishikawa,et al.  Smartphone-Based Pedestrian's Avoidance Behavior Recognition towards Opportunistic Road Anomaly Detection , 2016, ISPRS Int. J. Geo Inf..

[41]  B. R. Badrinath,et al.  VOR base stations for indoor 802.11 positioning , 2004, MobiCom '04.

[42]  Jie Yang,et al.  Snooping Keystrokes with mm-level Audio Ranging on a Single Phone , 2015, MobiCom.

[43]  Derek Troyer,et al.  Pedestrian injuries due to mobile phone use in public places. , 2013, Accident; analysis and prevention.