Wearable System for Daily Activity Recognition Using Inertial and Pressure Sensors of a Smart Band and Smart Shoes

Human Activity Recognition (HAR) is a challenging task in the field of human-related signal processing. Owing to the development of wearable sensing technology, an emerging research approach in HAR is to identify user-performed tasks by using data collected from wearable sensors. In this paper, we propose a novel system for monitoring and recognizing daily living activities using an off-the-shelf smart band and two smart shoes. The system aims at providing a useful tool for solving problems regarding body part placement, fusion of multimodal sensors and feature selection for a specific set of activities. The system collects inertial and plantar pressure data at wrist and foot to analyze and then, extract, select important features for recognition. We construct and compare two predictive models of classifying activities from the reduced feature set. A comparison of the classification for each wearable device and a fusion scheme is provided to identify the best body part for activity recognition: either the wrist or the feet. This comparison also demonstrated the effective HAR performance of the proposed system.

[1]  Fulvio Mastrogiovanni,et al.  Wearable Inertial Sensors: Applications, Challenges, and Public Test Benches , 2015, IEEE Robotics & Automation Magazine.

[2]  Yuwei Chen,et al.  Human Behavior Cognition Using Smartphone Sensors , 2013, Sensors.

[3]  Ming Zeng,et al.  Recognizing new activities with limited training data , 2015, SEMWEB.

[4]  Álvaro Herrero,et al.  Features and models for human activity recognition , 2015, Neurocomputing.

[5]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[6]  Héctor Pomares,et al.  Daily living activity recognition based on statistical feature quality group selection , 2012, Expert Syst. Appl..

[7]  Shane A Lowe,et al.  Monitoring human health behaviour in one's living environment: a technological review. , 2014, Medical engineering & physics.

[8]  Gu-Min Jeong,et al.  Classification of Three Types of Walking Activities Regarding Stairs Using Plantar Pressure Sensors , 2017, IEEE Sensors Journal.

[9]  Héctor Pomares,et al.  mDurance: A Novel Mobile Health System to Support Trunk Endurance Assessment , 2015, Sensors.

[10]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[11]  Bernt Schiele,et al.  Towards Less Supervision in Activity Recognition from Wearable Sensors , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[12]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[13]  Alex Pentland,et al.  Wearable feedback systems for rehabilitation , 2005, Journal of NeuroEngineering and Rehabilitation.

[14]  Edward Sazonov,et al.  Monitoring of Posture Allocations and Activities by a Shoe-Based Wearable Sensor , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[16]  Annemarie Laudanski,et al.  Activity classification in persons with stroke based on frequency features. , 2015, Medical engineering & physics.

[17]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[18]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[19]  Rubén San-Segundo-Hernández,et al.  Segmenting human activities based on HMMs using smartphone inertial sensors , 2016, Pervasive Mob. Comput..

[20]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[21]  Luis González Abril,et al.  Discrete techniques applied to low-energy mobile human activity recognition. A new approach , 2014, Expert Syst. Appl..

[22]  Mary M. Rodgers,et al.  Recent Advances in Wearable Sensors for Health Monitoring , 2015, IEEE Sensors Journal.

[23]  Lei Gao,et al.  Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. , 2014, Medical engineering & physics.

[24]  Petrica C. Pop,et al.  Feature Analysis to Human Activity Recognition , 2016, Int. J. Comput. Commun. Control.

[25]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[26]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[27]  Irina Mocanu,et al.  Indoor Localisation through Probabilistic Ontologies , 2018, Int. J. Comput. Commun. Control.

[28]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[29]  Yen-Ping Chen,et al.  Online classifier construction algorithm for human activity detection using a tri-axial accelerometer , 2008, Appl. Math. Comput..

[30]  Kerstin Thurow,et al.  A Context-Aware mHealth System for Online Physiological Monitoring in Remote Healthcare , 2015, Int. J. Comput. Commun. Control.

[31]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[32]  Yanjun Jia,et al.  Diatetic and Exercise Therapy against Diabetes Mellitus , 2009, 2009 Second International Conference on Intelligent Networks and Intelligent Systems.

[33]  Stefan Poslad,et al.  Improved Use of Foot Force Sensors and Mobile Phone GPS for Mobility Activity Recognition , 2014, IEEE Sensors Journal.

[34]  Simona Dzitac,et al.  Fuzzy Algorithm for Human Drowsiness Detection Devices , 2010 .

[35]  Cyrus Shahabi,et al.  Activity Recognition Using Wrist-Worn Sensors for Human Performance Evaluation , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[36]  Jin Wang,et al.  Recognizing Human Daily Activities From Accelerometer Signal , 2011 .

[37]  C. Mazzà,et al.  Step Detection and Activity Recognition Accuracy of Seven Physical Activity Monitors , 2015, PloS one.