Activity Recognition and Semantic Description for Indoor Mobile Localization

As a result of the rapid development of smartphone-based indoor localization technology, location-based services in indoor spaces have become a topic of interest. However, to date, the rich data resulting from indoor localization and navigation applications have not been fully exploited, which is significant for trajectory correction and advanced indoor map information extraction. In this paper, an integrated location acquisition method utilizing activity recognition and semantic information extraction is proposed for indoor mobile localization. The location acquisition method combines pedestrian dead reckoning (PDR), human activity recognition (HAR) and landmarks to acquire accurate indoor localization information. Considering the problem of initial position determination, a hidden Markov model (HMM) is utilized to infer the user’s initial position. To provide an improved service for further applications, the landmarks are further assigned semantic descriptions by detecting the user’s activities. The experiments conducted in this study confirm that a high degree of accuracy for a user’s indoor location can be obtained. Furthermore, the semantic information of a user’s trajectories can be extracted, which is extremely useful for further research into indoor location applications.

[1]  Robert Harle,et al.  A Survey of Indoor Inertial Positioning Systems for Pedestrians , 2013, IEEE Communications Surveys & Tutorials.

[2]  Seth Teller,et al.  Motion Compatibility for Indoor Localization , 2014 .

[3]  Stathes Hadjiefthymiades,et al.  OntoNav: A Semantic Indoor Navigation System , 2005, MCMP@MDM.

[4]  Robert E. Guinness,et al.  Beyond Where to How: A Machine Learning Approach for Sensing Mobility Contexts Using Smartphone Sensors † , 2013, Sensors.

[5]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.

[6]  Yunhao Liu,et al.  Mobility Increases Localizability , 2015, ACM Comput. Surv..

[7]  Di Wu,et al.  Heading Estimation for Indoor Pedestrian Navigation Using a Smartphone in the Pocket , 2015, Sensors.

[8]  G.B. Giannakis,et al.  Localization via ultra-wideband radios: a look at positioning aspects for future sensor networks , 2005, IEEE Signal Processing Magazine.

[9]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[10]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[11]  José M. Alonso,et al.  Continuous Space Estimation: Increasing WiFi-Based Indoor Localization Resolution without Increasing the Site-Survey Effort , 2017, Sensors.

[12]  Guofeng Wang,et al.  Carrying Position Independent User Heading Estimation for Indoor Pedestrian Navigation with Smartphones , 2016, Sensors.

[13]  Moustafa Youssef,et al.  UPTIME: Ubiquitous pedestrian tracking using mobile phones , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[14]  Injong Rhee,et al.  Towards Mobile Phone Localization without War-Driving , 2010, 2010 Proceedings IEEE INFOCOM.

[15]  Vassileios Tsetsos,et al.  Semantic Location Based Services for Smart Spaces , 2007, MTSR.

[16]  Andrei Szabo,et al.  WLAN-Based Pedestrian Tracking Using Particle Filters and Low-Cost MEMS Sensors , 2007, 2007 4th Workshop on Positioning, Navigation and Communication.

[17]  Fei Li,et al.  An Indoor Continuous Positioning Algorithm on the Move by Fusing Sensors and Wi-Fi on Smartphones , 2015, Sensors.

[18]  Cem Ersoy,et al.  A Review and Taxonomy of Activity Recognition on Mobile Phones , 2013 .

[19]  Paul J. M. Havinga,et al.  Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors , 2016, Sensors.

[20]  Matthew Turk,et al.  Location-based augmented reality on mobile phones , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[21]  Youngnam Han,et al.  Improved heading estimation for smartphone-based indoor positioning systems , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[22]  Robertas Damasevicius,et al.  Human Activity Recognition in AAL Environments Using Random Projections , 2016, Comput. Math. Methods Medicine.

[23]  Andrew Vardy,et al.  Incorporating user motion information for indoor smartphone positioning in sparse Wi-Fi environments , 2014, MSWiM '14.

[24]  Agathoniki Trigoni,et al.  Lightweight map matching for indoor localisation using conditional random fields , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[25]  Stathes Hadjiefthymiades,et al.  Environments , 2006, 2006 ACS/IEEE International Conference on Pervasive Services.

[26]  François Marx,et al.  Advanced Integration of WiFi and Inertial Navigation Systems for Indoor Mobile Positioning , 2006, EURASIP J. Adv. Signal Process..

[27]  Jukka Saarinen,et al.  MEMS-IMU Based Pedestrian Navigator for Handheld Devices , 2001 .

[28]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[29]  Wanmin Wu,et al.  Classification Accuracies of Physical Activities Using Smartphone Motion Sensors , 2012, Journal of medical Internet research.

[30]  Hao Jiang,et al.  Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization , 2015, Sensors.

[31]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[32]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[33]  Lin Ma,et al.  Indoor positioning via nonlinear discriminative feature extraction in wireless local area network , 2012, Comput. Commun..

[34]  Carsten Isert,et al.  Self-contained indoor positioning on off-the-shelf mobile devices , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[35]  Youngnam Han,et al.  SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization , 2015, IEEE Sensors Journal.

[36]  Qian Huang,et al.  Refining Wi-Fi Based Indoor Localization with Li-Fi Assisted Model Calibration in Smart Buildings , 2016, ArXiv.

[37]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[38]  Helena Leppäkoski,et al.  Pedestrian Navigation Based on Inertial Sensors, Indoor Map, and WLAN Signals , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Weifeng Tian,et al.  Activity classification and dead reckoning for pedestrian navigation with wearable sensors , 2008 .