Chaperone: Real-time Locking and Loss Prevention for Smartphones

Smartphone loss affects millions of users each year and causes significant monetary and data losses. Device tracking services (e.g., Google’s “Find My Device”) enable the device owner to secure or recover a lost device, but they can be easily circumvented with physical access (e.g., turn on airplane mode). An effective loss prevention solution should immediately lock the phone and alert the owner before they leave without the phone. We present such an opensource, real-time system called Chaperone that does not require additional hardware. Chaperone adopts active acoustic sensing to detect a phone’s unattended status by tracking the owner’s departure via the built-in speaker and microphone. It is designed to robustly operate in real-world scenarios characterized by bursting highfrequency noise, bustling crowds, and diverse environmental layouts. We evaluate Chaperone by conducting over 1,300 experiments at a variety of locations including coffee shops, restaurants, transit stations, and cars, under different testing conditions. Chaperone provides an overall precision rate of 93% and an overall recall rate of 96% for smartphone loss events. Chaperone detects these events in under 0.5 seconds for 95% of the successful detection cases. We conduct a user study (n = 17) to investigate participants’ smartphone loss experiences, collect feedback on using Chaperone, and study different alert methods. Most participants were satisfied with Chaperone’s performance for its detection ability, detection accuracy, and power consumption. Finally, we provide an implementation of Chaperone as a standalone Android app.

[1]  Bruno Sinopoli,et al.  ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization , 2015, SenSys.

[2]  Lili Qiu,et al.  CAT: high-precision acoustic motion tracking , 2016, MobiCom.

[3]  Tao Li,et al.  iLock: Immediate and Automatic Locking of Mobile Devices against Data Theft , 2016, CCS.

[4]  Lei Xie,et al.  VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals , 2018, MobiCom.

[5]  Bing Zhou,et al.  BatMapper: Acoustic Sensing Based Indoor Floor Plan Construction Using Smartphones , 2017, MobiSys.

[6]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[7]  Feng Xiao,et al.  PatternListener: Cracking Android Pattern Lock Using Acoustic Signals , 2018, CCS.

[8]  Ben Y. Zhao,et al.  Et Tu Alexa? When Commodity WiFi Devices Turn into Adversarial Motion Sensors , 2020, NDSS.

[9]  Urs Hengartner,et al.  Itus: an implicit authentication framework for android , 2014, MobiCom.

[10]  Kang G. Shin,et al.  Cross-Platform Support for Rapid Development of Mobile Acoustic Sensing Applications , 2018, MobiSys.

[11]  Rong Zheng,et al.  A survey on acoustic sensing , 2019, ArXiv.

[12]  Kang G. Shin,et al.  Use of Phone Sensors to Enhance Distracted Pedestrians’ Safety , 2018, IEEE Transactions on Mobile Computing.

[13]  Mo Li,et al.  DopEnc: acoustic-based encounter profiling using smartphones , 2016, MobiCom.

[14]  A. J. Bernheim Brush,et al.  Phoneprioception: enabling mobile phones to infer where they are kept , 2013, CHI.

[15]  Shan Gao,et al.  An RFID Based Smartphone Proximity Absence Alert System , 2017, IEEE Transactions on Mobile Computing.

[16]  Neng Gao,et al.  Remotely wiping sensitive data on stolen smartphones , 2014, AsiaCCS.

[17]  Chen Wang,et al.  Fine-grained sleep monitoring: Hearing your breathing with smartphones , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[18]  Daniel Vogel,et al.  Targeted Mimicry Attacks on Touch Input Based Implicit Authentication Schemes , 2016, MobiSys.

[19]  Sangki Yun,et al.  Strata: Fine-Grained Acoustic-based Device-Free Tracking , 2017, MobiSys.

[20]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[21]  Xing-Dong Yang,et al.  Surround-see: enabling peripheral vision on smartphones during active use , 2013, UIST.

[22]  Bing Zhou,et al.  EchoPrint: Two-factor Authentication using Acoustics and Vision on Smartphones , 2018, MobiCom.

[23]  Wei Wang,et al.  Device-free gesture tracking using acoustic signals , 2016, MobiCom.

[24]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[25]  Lior Rokach,et al.  SherLock vs Moriarty: A Smartphone Dataset for Cybersecurity Research , 2016, AISec@CCS.

[26]  Serge Egelman,et al.  Detecting Phone Theft Using Machine Learning , 2018 .

[27]  Lili Qiu,et al.  AIM: Acoustic Imaging on a Mobile , 2018, MobiSys.

[28]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.