Activity recognition on handheld devices for pedestrian indoor navigation

We propose an inertial sensor-based approach to activity recognition for pedestrian indoor navigation. In the considered scenario a mobile device is held in a hand in front of the user. The recognized activities are the ones relevant to positioning in multi-floor buildings: walking and going up or down the stairs. To model the time dependency between consecutive activities we employ a Hidden Markov Model (HMM). For efficient quantization of continuous features, we apply a random forest classifier. For verification of the proposed algorithm, we conducted experiments with 12 participants and 4 different mobile devices. In our comparison to state-of-the-art approaches, we implement and evaluate major classification algorithms, such as nearest neighbour, decision tree and dynamic Bayesian Network. In the experiments we show the trade-off between computational complexity and classification performance. Furthermore, we demonstrate that the complexity of the HMM can be significantly reduced by replacing it with a dynamic Bayesian network with negligible impact on classification performance. The best of our proposed classifier achieves a classification accuracy of 91% for new users, which offers a 30% improvement compared to state-of-the-art approaches.

[1]  Wanmin Wu,et al.  Classification Accuracies of Physical Activities Using Smartphone Motion Sensors , 2012, Journal of medical Internet research.

[2]  Gilles Louppe,et al.  Understanding Random Forests: From Theory to Practice , 2014, 1407.7502.

[3]  Gary M. Weiss,et al.  Limitations with activity recognition methodology & data sets , 2014, UbiComp Adjunct.

[4]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[5]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[6]  Hiroshi Motoda,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998, The Springer International Series in Engineering and Computer Science.

[7]  Zhongmin Wang,et al.  Human activity recognition based on transformed accelerometer data from a mobile phone , 2016, Int. J. Commun. Syst..

[8]  Andrea Mannini,et al.  Activity recognition using a single accelerometer placed at the wrist or ankle. , 2013, Medicine and science in sports and exercise.

[9]  Azeem J. Khan,et al.  Barometric phone sensors: more hype than hope! , 2014, HotMobile.

[10]  Marian Haescher,et al.  Sensor requirements for activity recognition on smart watches , 2013, PETRA '13.

[11]  Rahim Tafazolli,et al.  A survey on smartphone-based systems for opportunistic user context recognition , 2013, CSUR.

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  Stuart J. Russell,et al.  A temporally abstracted Viterbi algorithm , 2011, UAI.

[14]  A. Krogh Two methods for improving performance of an HMM application for gene finding , 1997 .

[15]  Michael Picheny,et al.  Decision-tree based feature-space quantization for fast Gaussian computation , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[16]  Manfred Wieser,et al.  3D indoor positioning with pedestrian dead reckoning and activity recognition based on Bayes filtering , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[17]  Jonathan R. M. Hosking,et al.  Partitioning Nominal Attributes in Decision Trees , 1999, Data Mining and Knowledge Discovery.

[18]  Lalit R. Bahl,et al.  Decision-tree based quantization of the feature space of a speech recognizer , 1997, EUROSPEECH.

[19]  Angelo M. Sabatini,et al.  Accelerometry-Based Classification of Human Activities Using Markov Modeling , 2011, Comput. Intell. Neurosci..

[20]  Daniel Høyer Iversen,et al.  Closed-skew Distributions: Simulation, Inversion and Parameter Estimation , 2010 .

[21]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[22]  Mahesh K. Marina,et al.  HiMLoc: Indoor smartphone localization via activity aware Pedestrian Dead Reckoning with selective crowdsourced WiFi fingerprinting , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[23]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[24]  Eckehard Steinbach,et al.  Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning , 2014, UbiComp.

[25]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[26]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[27]  Lin Sun,et al.  Activity Recognition on an Accelerometer Embedded Mobile Phone with Varying Positions and Orientations , 2010, UIC.

[28]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[29]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[30]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[31]  Corina Kim Schindhelm,et al.  Activity recognition and step detection with smartphones: Towards terminal based indoor positioning system , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[32]  Ye Li,et al.  Physical Activity Recognition Utilizing the Built-In Kinematic Sensors of a Smartphone , 2013, Int. J. Distributed Sens. Networks.

[33]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[34]  Muhammad Usman Ilyas,et al.  Activity recognition using smartphone sensors , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[35]  Korbinian Frank,et al.  Reliable Real-Time Recognition of Motion Related Human Activities using MEMS Inertial Sensors , 2010 .

[36]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.