Smartphone Location Recognition: A Deep Learning-Based Approach

One of the approaches for indoor positioning using smartphones is pedestrian dead reckoning. There, the user step length is estimated using empirical or biomechanical formulas. Such calculation was shown to be very sensitive to the smartphone location on the user. In addition, knowledge of the smartphone location can also help for direct step-length estimation and heading determination. In a wider point of view, smartphone location recognition is part of human activity recognition employed in many fields and applications, such as health monitoring. In this paper, we propose to use deep learning approaches to classify the smartphone location on the user, while walking, and require robustness in terms of the ability to cope with recordings that differ (in sampling rate, user dynamics, sensor type, and more) from those available in the train dataset. The contributions of the paper are: (1) Definition of the smartphone location recognition framework using accelerometers, gyroscopes, and deep learning; (2) examine the proposed approach on 107 people and 31 h of recorded data obtained from eight different datasets; and (3) enhanced algorithms for using only accelerometers for the classification process. The experimental results show that the smartphone location can be classified with high accuracy using only the smartphone’s accelerometers.

[1]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[2]  Itzik Klein,et al.  Pedestrian Dead Reckoning With Smartphone Mode Recognition , 2018, IEEE Sensors Journal.

[3]  Valérie Renaudin,et al.  Motion Mode Recognition and Step Detection Algorithms for Mobile Phone Users , 2013, Sensors.

[4]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[5]  Paul J. M. Havinga,et al.  Fusion of Smartphone Motion Sensors for Physical Activity Recognition , 2014, Sensors.

[6]  Aboelmagd Noureldin,et al.  A Survey on Approaches of Motion Mode Recognition Using Sensors , 2017, IEEE Transactions on Intelligent Transportation Systems.

[7]  Peilin Liu,et al.  An improved indoor localization method using smartphone inertial sensors , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[8]  Xiaojiang Chen,et al.  SmartMTra: Robust Indoor Trajectory Tracing Using Smartphones , 2017, IEEE Sensors Journal.

[9]  Charlie Wilson,et al.  Smart homes and their users: a systematic analysis and key challenges , 2014, Personal and Ubiquitous Computing.

[10]  Haiyong Luo,et al.  Pedestrian Walking Distance Estimation Based on Smartphone Mode Recognition , 2019, Remote. Sens..

[11]  Jin-Shyan Lee,et al.  An Experimental Heuristic Approach to Multi-Pose Pedestrian Dead Reckoning Without Using Magnetometers for Indoor Localization , 2019, IEEE Sensors Journal.

[12]  Yun Pan,et al.  A Multi-Mode Dead Reckoning System for Pedestrian Tracking Using Smartphones , 2016, IEEE Sensors Journal.

[13]  Itzik Klein,et al.  Robust Smartphone Mode Recognition , 2018, 2018 IEEE International Conference on the Science of Electrical Engineering in Israel (ICSEE).

[14]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[15]  Tamir Hazan,et al.  Gravity Direction Estimation and Heading Determination for Pedestrian Navigation , 2018, 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[16]  Wei Wang,et al.  OxIOD: The Dataset for Deep Inertial Odometry , 2018, ArXiv.

[17]  Yong-Gyu Lee,et al.  Smartphone-based mobile health monitoring. , 2012, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[18]  Zhaohui Wang,et al.  An overview of human activity recognition based on smartphone , 2019, Sensor Review.

[19]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[20]  Rong Yang,et al.  PACP: A Position-Independent Activity Recognition Method Using Smartphone Sensors , 2016, Inf..

[21]  Isaac Skog,et al.  Zero-Velocity Detection—An Algorithm Evaluation , 2010, IEEE Transactions on Biomedical Engineering.

[22]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[23]  Aboelmagd Noureldin,et al.  Online Motion Mode Recognition for Portable Navigation Using Low-Cost Sensors , 2015 .

[24]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[25]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[26]  Andrea Cavallaro,et al.  Mobile Sensor Data Anonymization , 2019 .

[27]  Qi Shan,et al.  RIDI: Robust IMU Double Integration , 2017, ECCV.

[28]  Swarna Ravindra Babu,et al.  UMOISP: Usage Mode and Orientation Invariant Smartphone Pedometer , 2017, IEEE Sensors Journal.

[29]  H. Haas,et al.  Pedestrian Dead Reckoning : A Basis for Personal Positioning , 2006 .

[30]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[31]  François Chollet,et al.  Keras: The Python Deep Learning library , 2018 .

[32]  Manuela Herman,et al.  Aided Navigation Gps With High Rate Sensors , 2016 .

[33]  Itzik Klein,et al.  Smartphone Motion Mode Recognition , 2017, ECSA 2017.

[34]  H. Weinberg Using the ADXL202 in Pedometer and Personal Navigation Applications , 2002 .