Human Physical Activity Recognition Using Smartphone Sensors

Because the number of elderly people is predicted to increase quickly in the upcoming years, “aging in place” (which refers to living at home regardless of age and other factors) is becoming an important topic in the area of ambient assisted living. Therefore, in this paper, we propose a human physical activity recognition system based on data collected from smartphone sensors. The proposed approach implies developing a classifier using three sensors available on a smartphone: accelerometer, gyroscope, and gravity sensor. We have chosen to implement our solution on mobile phones because they are ubiquitous and do not require the subjects to carry additional sensors that might impede their activities. For our proposal, we target walking, running, sitting, standing, ascending, and descending stairs. We evaluate the solution against two datasets (an internal one collected by us and an external one) with great effect. Results show good accuracy for recognizing all six activities, with especially good results obtained for walking, running, sitting, and standing. The system is fully implemented on a mobile device as an Android application.

[1]  Ig-Jae Kim,et al.  Mobile health monitoring system based on activity recognition using accelerometer , 2010, Simul. Model. Pract. Theory.

[2]  Lawrence B. Holder,et al.  Discovering Activities to Recognize and Track in a Smart Environment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[3]  Kevin Bouchard,et al.  Exploiting Passive RFID Technology for Activity Recognition in Smart Homes , 2015, IEEE Intelligent Systems.

[4]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[5]  Nancy E. Sherwood,et al.  Behavioral Risk Factors for Overweight and Obesity: Diet and Physical Activity , 2017 .

[6]  Paul J. M. Havinga,et al.  Fusion of Smartphone Motion Sensors for Physical Activity Recognition , 2014, Sensors.

[7]  Liming Chen,et al.  Combining ontological and temporal formalisms for composite activity modelling and recognition in smart homes , 2014, Future Gener. Comput. Syst..

[8]  Sajal K. Das,et al.  Multimodal Wearable Sensing for Fine-Grained Activity Recognition in Healthcare , 2015, IEEE Internet Computing.

[9]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Franco Zambonelli,et al.  Advances in Practical Applications of Heterogeneous Multi-Agent Systems. The PAAMS Collection , 2014, Lecture Notes in Computer Science.

[11]  Mitja Lustrek,et al.  Fall Detection and Activity Recognition with Machine Learning , 2009, Informatica.

[12]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[13]  Kaisa Miettinen,et al.  Training multi layer perceptron network using a genetic algorithm as a global optimizer , 2004 .

[14]  Bruce W. Suter,et al.  The multilayer perceptron as an approximation to a Bayes optimal discriminant function , 1990, IEEE Trans. Neural Networks.

[15]  Thomas Zimmermann,et al.  Persuasive technology in the real world: a study of long-term use of activity sensing devices for fitness , 2014, CHI.

[16]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[17]  Jorge J. Gómez-Sanz,et al.  PHAT: Physical Human Activity Tester , 2013, HAIS.

[18]  Paul J. M. Havinga,et al.  Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors , 2016, Sensors.

[19]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[20]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[21]  Michel Vacher,et al.  On-line human activity recognition from audio and home automation sensors: Comparison of sequential and non-sequential models in realistic Smart Homes , 2016, J. Ambient Intell. Smart Environ..

[22]  M. Kafri,et al.  Nintendo Wii Sports and Wii Fit Game Analysis, Validation, and Application to Stroke Rehabilitation , 2011, Topics in stroke rehabilitation.

[23]  Kaoru Hirota,et al.  A Rule-Based Approach to Activity Recognition , 2010, KICSS.

[24]  Shuangquan Wang,et al.  A review on radio based activity recognition , 2015, Digit. Commun. Networks.

[25]  Juan Murillo.  An Automated Defect Prediction Framework using Genetic Algorithms: A Validation of Empirical Studies , 2016 .

[26]  Rubén Fuentes-Fernández,et al.  An Automated Defect Prediction Framework using Genetic Algorithms: A Validation of Empirical Studies , 2016 .

[27]  Fadi Al Machot,et al.  A review on applications of activity recognition systems with regard to performance and evaluation , 2016, Int. J. Distributed Sens. Networks.

[28]  Lingfei Mo,et al.  Human physical activity recognition based on computer vision with deep learning model , 2016, 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[29]  Jorge J. Gómez-Sanz,et al.  Agent Based Simulation for Creating Ambient Assisted Living Solutions , 2014, PAAMS.

[30]  Catherine Sherrington,et al.  Validity of the Fitbit activity tracker for measuring steps in community-dwelling older adults , 2015, BMJ Open Sport & Exercise Medicine.

[31]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[32]  A. V. Olgac,et al.  Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks , 2011 .

[33]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  Yuri Antonio Gonçalves Vilas Boas.  Overview of Virtual Reality Technologies , 2012 .

[35]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .