ShoesHacker: Indoor Corridor Map and User Location Leakage through Force Sensors in Smart Shoes

The past few years have witnessed the rise of smart shoes, the wearable devices that measure foot force or track foot motion. However, people are not aware of the possible privacy leakage from in-shoe force sensors. In this paper, we explore the possibility of locating an indoor victim based on the force signals leaked from smart shoes. We present ShoesHacker, an attack scheme that reconstructs the corridor map of the building that the victim walks in based on force data only. The corridor map enables the attacker to recognize the building, and thus locate the victim on a global map. To handle the lack of training data, we design the stair landing detection algorithm, based on which we extract training data when victims are walking in stairwells. We estimate the trajectory of each walk, and propose the path merging algorithm to merge the trajectories. Moreover, we design a metric to quantify the similarity between corridor maps, which makes building recognition possible. Our experimental results show that, the building recognition accuracy reaches 77.5% in a 40-building dataset, and the victim can be located with an average error lower than 6 m, which reveals the danger of privacy leakage through smart shoes. CCS Concepts: b Information systems~Mobile information processing systems; Location based services; b Human-centered computing~Mobile devices; Ubiquitous and mobile computing systems and tools; b Security and privacy~Domain-specific security and privacy architectures.

[1]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[2]  He Wang,et al.  MoLe: Motion Leaks through Smartwatch Sensors , 2015, MobiCom.

[3]  Chunming Qiao,et al.  Crowd Map: Accurate Reconstruction of Indoor Floor Plans from Crowdsourced Sensor-Rich Videos , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[4]  Pubudu N. Pathirana,et al.  Smartwatch: Performance evaluation for long-term heart rate monitoring , 2015, 2015 International Symposium on Bioelectronics and Bioinformatics (ISBB).

[5]  Larry S. Davis,et al.  Stride and cadence as a biometric in automatic person identification and verification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[6]  Wenyuan Xu,et al.  AccelPrint: Imperfections of Accelerometers Make Smartphones Trackable , 2014, NDSS.

[7]  Moe Z. Win,et al.  A Machine Learning Approach to Ranging Error Mitigation for UWB Localization , 2012, IEEE Transactions on Communications.

[8]  Shivam Bhasin,et al.  Guessing Your PIN Right: Unlocking Smartphones with Publicly Available Sensor Data , 2018, 2018 IEEE Computer Society Annual Symposium on VLSI (ISVLSI).

[9]  Wolfgang Nebel,et al.  A Novel Indoor Localization Approach Using Dynamic Changes in Ultrasonic Echoes , 2012 .

[10]  Luca Benini,et al.  Bluetooth indoor localization with multiple neural networks , 2010, IEEE 5th International Symposium on Wireless Pervasive Computing 2010.

[11]  J. Summers,et al.  Abnormalities in the stride length‐cadence relation in parkinsonian gait , 1998, Movement disorders : official journal of the Movement Disorder Society.

[12]  Jun Han,et al.  ACComplice: Location inference using accelerometers on smartphones , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[13]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[14]  Moustafa Youssef,et al.  SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization , 2016, IEEE Transactions on Mobile Computing.

[15]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[16]  Klara Nahrstedt,et al.  ShoesLoc , 2019, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.

[17]  Marco Gruteser,et al.  USENIX Association , 1992 .

[18]  Yujiang Xiang,et al.  Optimization-based prediction of asymmetric human gait. , 2011, Journal of biomechanics.

[19]  Klara Nahrstedt,et al.  Identity, location, disease and more: inferring your secrets from android public resources , 2013, CCS.

[20]  Anupam Das,et al.  Poster : Fingerprinting Smartphones Through Speaker , 2014 .

[21]  Frank Dürr,et al.  MapGENIE: Grammar-enhanced indoor map construction from crowd-sourced data , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[22]  Gabi Nakibly,et al.  PowerSpy: Location Tracking Using Mobile Device Power Analysis , 2015, USENIX Security Symposium.

[23]  Robert Harle,et al.  Pedestrian localisation for indoor environments , 2008, UbiComp.

[24]  Anton van den Hengel,et al.  Learning to rank in person re-identification with metric ensembles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Shueng-Han Gary Chan,et al.  Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons , 2016, IEEE Communications Surveys & Tutorials.

[26]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[27]  Mohammad H. Mahoor,et al.  Fast image blending using watersheds and graph cuts , 2009, Image Vis. Comput..

[28]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[29]  Jie Wu,et al.  FootStep-tracker: an anchor-free indoor localization system via sensing foot steps , 2015, UbiComp/ISWC Adjunct.

[30]  Chiraz Ben Abdelkader Stride and Cadence as a Biometric in Automatic Person Identification and Verification , 2002 .

[31]  Bo Yang,et al.  Smartphone-based Acoustic Indoor Space Mapping , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[32]  Hui Xiong,et al.  Preserving privacy in gps traces via uncertainty-aware path cloaking , 2007, CCS '07.

[33]  Haojin Zhu,et al.  All your location are belong to us: breaking mobile social networks for automated user location tracking , 2013, MobiHoc '14.

[34]  Minhui Xue,et al.  Revisiting Localization Attacks in Mobile App People-Nearby Services , 2017, SpaCCS.

[35]  Eric Horvitz,et al.  LOCADIO: inferring motion and location from Wi-Fi signal strengths , 2004, The First Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services, 2004. MOBIQUITOUS 2004..

[36]  Reza Shokri,et al.  Evaluating the Privacy Risk of Location-Based Services , 2011, Financial Cryptography.

[37]  Michael Hicks,et al.  Deanonymizing mobility traces: using social network as a side-channel , 2012, CCS.

[38]  Borivoj Vojnovic,et al.  An Algorithm for image stitching and blending , 2005, SPIE BiOS.

[39]  Igor Bilogrevic,et al.  Side-Channel Inference Attacks on Mobile Keypads Using Smartwatches , 2017, IEEE Transactions on Mobile Computing.

[40]  César A. Hidalgo,et al.  Unique in the Crowd: The privacy bounds of human mobility , 2013, Scientific Reports.

[41]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[42]  Hui Zang,et al.  Anonymization of location data does not work: a large-scale measurement study , 2011, MobiCom.

[43]  Kaigui Bian,et al.  Jigsaw: indoor floor plan reconstruction via mobile crowdsensing , 2014, MobiCom.

[44]  Robert P. Dick,et al.  Hallway based automatic indoor floorplan construction using room fingerprints , 2013, UbiComp.

[45]  Seyed Ali Ghorashi,et al.  Fast fingerprinting based indoor localization by Wi-Fi signals , 2017, 2017 7th International Conference on Computer and Knowledge Engineering (ICCKE).

[46]  Murtuza Jadliwala,et al.  Towards Inferring Mechanical Lock Combinations using Wrist-Wearables as a Side-Channel , 2018, WISEC.

[47]  Yang Zhao,et al.  Similarity Analysis-Based Indoor Localization Algorithm With Backscatter Information of Passive UHF RFID Tags , 2017, IEEE Sensors Journal.

[48]  Jie Wu,et al.  Track Your Foot Step: Anchor-Free Indoor Localization Based on Sensing Users' Foot Steps , 2016, 2016 IEEE 13th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).