The StoryTeller

Due to the recent proliferation of location-based services indoors, the need for an accurate floor estimation technique that is easy to deploy in any typical multi-story building is higher than ever. Current approaches that attempt to solve the floor localization problem include sensor-based systems and 3D fingerprinting. Nevertheless, these systems incur high deployment and maintenance overhead, suffer from sensor drift and calibration issues, and/or are not available to all users. In this paper, we propose StoryTeller, a deep learning-based technique for floor prediction in multi-story buildings. StoryTeller leverages the ubiquitous WiFi signals to generate images that are input to a Convolutional Neural Network (CNN) which is trained to predict loors based on detected patterns in visible WiFi scans. Input images are created such that they capture the current WiFi-scan in an AP-independent manner. In addition, a novel virtual building concept is used to normalize the information in order to make them building-independent. This allows StoryTeller to reuse a trained network for a completely new building, significantly reducing the deployment overhead. We have implemented and evaluated StoryTeller using three different buildings with a side-by-side comparison with the state-of-the-art floor estimation techniques. The results show that StoryTeller can estimate the user's floor at least 98.3% within one floor of the actual ground truth floor. This accuracy is consistent across the different testbeds and for scenarios where the models used were trained in a completely different building than the tested building. This highlights StoryTeller's ability to generalize to new buildings and its promise as a scalable, low-overhead, high-accuracy floor localization system.

[1]  Moustafa Youssef,et al.  DeepLoc: a ubiquitous accurate and low-overhead outdoor cellular localization system , 2018, SIGSPATIAL/GIS.

[2]  Michal R. Nowicki,et al.  Low-effort place recognition with WiFi fingerprints using deep learning , 2016, AUTOMATION.

[3]  Haiyong Luo,et al.  HYFI: Hybrid Floor Identification Based on Wireless Fingerprinting and Barometric Pressure , 2017, IEEE Transactions on Industrial Informatics.

[4]  Qiang Yang,et al.  Indoor localization in multi-floor environments with reduced effort , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[5]  Moustafa Youssef,et al.  Towards ubiquitous indoor spatial awareness on a worldwide scale , 2017, SIGSPACIAL.

[6]  Moustafa Youssef,et al.  SenseIO: Realistic Ubiquitous Indoor Outdoor Detection System Using Smartphones , 2018, IEEE Sensors Journal.

[7]  Xue Liu,et al.  LocMe: Human locomotion and map exploitation based indoor localization , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Moustafa Youssef,et al.  SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization , 2016, IEEE Transactions on Mobile Computing.

[10]  Moustafa Youssef,et al.  MonoDCell: A Ubiquitous and Low-Overhead Deep Learning-based Indoor Localization with Limited Cellular Information , 2019, SIGSPATIAL/GIS.

[11]  Adolfo Martínez Usó,et al.  UJIIndoorLoc: A new multi-building and multi-floor database for WLAN fingerprint-based indoor localization problems , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[12]  Moustafa Youssef,et al.  HyRise: A Robust and Ubiquitous Multi-Sensor Fusion-based Floor Localization System , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[13]  Hao Jiang,et al.  WinIPS: WiFi-based non-intrusive IPS for online radio map construction , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[14]  Moustafa Youssef,et al.  The Horus location determination system , 2008 .

[15]  Anping Lin,et al.  Augmentation of Fingerprints for Indoor WiFi Localization Based on Gaussian Process Regression , 2018, IEEE Transactions on Vehicular Technology.

[16]  Elena Simona Lohan,et al.  Wi-Fi Crowdsourced Fingerprinting Dataset for Indoor Positioning , 2017, Data.

[17]  Koustubh Sharma,et al.  Indoor Localization Using Smartphones in Multi Floor Environments Without Prior Calibration or Added Infrastructure , 2015 .

[18]  Naser El-Sheimy,et al.  Multi-Sensor Multi-Floor 3D Localization With Robust Floor Detection , 2018, IEEE Access.

[19]  Mikko Valkama,et al.  K-Means Fingerprint Clustering for Low-Complexity Floor Estimation in Indoor Mobile Localization , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[20]  Moustafa Youssef,et al.  CrossCount: A Deep Learning System for Device-Free Human Counting Using WiFi , 2019, IEEE Sensors Journal.

[21]  Sanghyuk Lee,et al.  A scalable deep neural network architecture for multi-building and multi-floor indoor localization based on Wi-Fi fingerprinting , 2017, ArXiv.

[22]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[23]  Hamada Rizk SoloCell: Efficient Indoor Localization Based on Limited Cell Network Information And Minimal Fingerprinting , 2019, SIGSPATIAL/GIS.

[24]  Igor Bisio,et al.  WiFi Meets Barometer: Smartphone-Based 3D Indoor Positioning Method , 2018, 2018 IEEE International Conference on Communications (ICC).

[25]  Moustafa Youssef,et al.  MonoPHY: Mono-stream-based device-free WLAN localization via physical layer information , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[26]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[27]  Moustafa Youssef,et al.  WiDeep: WiFi-based Accurate and Robust Indoor Localization System using Deep Learning , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom.

[28]  Hamada Rizk Device-Invariant Cellular-Based Indoor Localization System Using Deep Learning , 2019 .

[29]  Moustafa Youssef,et al.  Lighthouse: Enabling Landmark-Based Accurate and Robust Next Generation Indoor LBSs on a Worldwide Scale , 2019, 2019 20th IEEE International Conference on Mobile Data Management (MDM).

[30]  Xiangyu Wang,et al.  ResLoc: Deep residual sharing learning for indoor localization with CSI tensors , 2017, 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[31]  Gianmario Motta,et al.  Wi-Fi-Aided Magnetic Field Positioning with Floor Estimation in Indoor Multi-Floor Navigation Services , 2017, 2017 IEEE International Congress on Internet of Things (ICIOT).

[32]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[33]  Shiwen Mao,et al.  BiLoc: Bi-Modal Deep Learning for Indoor Localization With Commodity 5GHz WiFi , 2017, IEEE Access.

[34]  Moustafa Youssef,et al.  TrueStory: Accurate and Robust RF-Based Floor Estimation for Challenging Indoor Environments , 2018, IEEE Sensors Journal.

[35]  Sanghyuk Lee,et al.  Large-scale location-aware services in access: Hierarchical building/floor classification and location estimation using Wi-Fi fingerprinting based on deep neural networks , 2017, 2017 International Workshop on Fiber Optics in Access Network (FOAN).

[36]  Ashok K. Agrawala,et al.  Locus: robust and calibration-free indoor localization, tracking and navigation for multi-story buildings , 2015, J. Locat. Based Serv..

[37]  Wei Chen,et al.  A novel clustering and KWNN-based strategy for Wi-Fi fingerprint indoor localization , 2015, 2015 4th International Conference on Computer Science and Network Technology (ICCSNT).

[38]  Khaled A. Harras,et al.  GreenLoc: An energy efficient architecture for WiFi-based indoor localization on mobile phones , 2013, 2013 IEEE International Conference on Communications (ICC).

[39]  Moustafa Youssef,et al.  CoSDEO 2016 Keynote: A decade later — Challenges: Device-free passive localization for wireless environments , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[40]  Xiangyu Wang,et al.  CiFi: Deep convolutional neural networks for indoor localization with 5 GHz Wi-Fi , 2017, 2017 IEEE International Conference on Communications (ICC).

[41]  Athanasios V. Vasilakos,et al.  ACE: An Accurate and Efficient Multi-Entity Device-Free WLAN Localization System , 2012, IEEE Transactions on Mobile Computing.

[42]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[43]  Jiangchuan Liu,et al.  RoArray: Towards More Robust Indoor Localization Using Sparse Recovery with Commodity WiFi , 2019, IEEE Transactions on Mobile Computing.

[44]  Moustafa Youssef,et al.  Zero-Calibration Device-Free Localization for the IoT Based on Participatory Sensing , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[45]  Hirozumi Yamaguchi,et al.  TransitLabel: A Crowd-Sensing System for Automatic Labeling of Transit Stations Semantics , 2016, MobiSys.

[46]  Moustafa Youssef,et al.  Humaine: a ubiquitous smartphone-based user heading estimation for mobile computing systems , 2017, GeoInformatica.

[47]  Jianming Wei,et al.  A robust floor localization method using inertial and barometer measurements , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[48]  Dongsoo Han,et al.  AMID: Accurate Magnetic Indoor Localization Using Deep Learning , 2018, Sensors.

[49]  Ashok K. Agrawala,et al.  Hapi: A Robust Pseudo-3D Calibration-Free WiFi-based Indoor Localization System , 2018, MobiQuitous.

[50]  José M. Alonso,et al.  Continuous Space Estimation: Increasing WiFi-Based Indoor Localization Resolution without Increasing the Site-Survey Effort , 2017, Sensors.

[51]  Moustafa Youssef,et al.  CellinDeep: Robust and Accurate Cellular-Based Indoor Localization via Deep Learning , 2019, IEEE Sensors Journal.

[52]  Moustafa Youssef,et al.  OmniCells: Cross-Device Cellular-based Indoor Location Tracking Using Deep Neural Networks , 2020, 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[53]  Kaigui Bian,et al.  Multi-Story Indoor Floor Plan Reconstruction via Mobile Crowdsensing , 2016, IEEE Transactions on Mobile Computing.

[54]  Noelia Hernández,et al.  WiFi-based Indoor Localization Using a Continuous Space Estimator From Topological Information , 2015 .

[55]  Moustafa Youssef,et al.  SemSense: Automatic construction of semantic indoor floorplans , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[56]  Moustafa Youssef,et al.  Towards truly ubiquitous indoor localization on a worldwide scale , 2015, SIGSPATIAL/GIS.

[57]  Jie Zhang,et al.  Localization of unknown indoor wireless transmitter , 2013, 2013 International Conference on Localization and GNSS (ICL-GNSS).

[58]  Moustafa Youssef,et al.  The Tale of Two Localization Technologies: Enabling Accurate Low-Overhead WiFi-based Localization for Low-end Phones , 2017, SIGSPATIAL/GIS.

[59]  Moustafa Youssef,et al.  A Robust Zero-Calibration RF-Based Localization System for Realistic Environments , 2016, 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[60]  Moustafa Youssef,et al.  Nuzzer: A Large-Scale Device-Free Passive Localization System for Wireless Environments , 2009, IEEE Transactions on Mobile Computing.

[61]  Moustafa Youssef,et al.  JustWalk: A Crowdsourcing Approach for the Automatic Construction of Indoor Floorplans , 2019, IEEE Transactions on Mobile Computing.

[62]  Shiwen Mao,et al.  DeepML: Deep LSTM for Indoor Localization with Smartphone Magnetic and Light Sensors , 2018, 2018 IEEE International Conference on Communications (ICC).