Evaluation of a smartphone human activity recognition application with able-bodied and stroke participants

BackgroundMobile health monitoring using wearable sensors is a growing area of interest. As the world’s population ages and locomotor capabilities decrease, the ability to report on a person’s mobility activities outside a hospital setting becomes a valuable tool for clinical decision-making and evaluating healthcare interventions. Smartphones are omnipresent in society and offer convenient and suitable sensors for mobility monitoring applications. To enhance our understanding of human activity recognition (HAR) system performance for able-bodied and populations with gait deviations, this research evaluated a custom smartphone-based HAR classifier on fifteen able-bodied participants and fifteen participants who suffered a stroke.MethodsParticipants performed a consecutive series of mobility tasks and daily living activities while wearing a BlackBerry Z10 smartphone on their waist to collect accelerometer and gyroscope data. Five features were derived from the sensor data and used to classify participant activities (decision tree). Sensitivity, specificity and F-scores were calculated to evaluate HAR classifier performance.ResultsThe classifier performed well for both populations when differentiating mobile from immobile states (F-score > 94 %). As activity recognition complexity increased, HAR system sensitivity and specificity decreased for the stroke population, particularly when using information derived from participant posture to make classification decisions.ConclusionsHuman activity recognition using a smartphone based system can be accomplished for both able-bodied and stroke populations; however, an increase in activity classification complexity leads to a decrease in HAR performance with a stroke population. The study results can be used to guide smartphone HAR system development for populations with differing movement characteristics.

[1]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[2]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Sungyoung Lee,et al.  EFM: evolutionary fuzzy model for dynamic activities recognition using a smartphone accelerometer , 2013, Applied Intelligence.

[4]  Xin Zhao,et al.  The association between socioeconomic status and disability after stroke: Findings from the Adherence eValuation After Ischemic stroke Longitudinal (AVAIL) registry , 2014, BMC Public Health.

[5]  Edward D. Lemaire,et al.  Change-of-state determination to recognize mobility activities using a BlackBerry smartphone , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Lorenzo Chiari,et al.  Validity of a Smartphone-based instrumented Timed Up and Go. , 2012, Gait & posture.

[7]  P Rougier,et al.  Asymmetric standing posture after stroke is related to a biased egocentric coordinate system , 2009, Neurology.

[8]  Mohanraj Karunanithi,et al.  Review of accelerometry for determining daily activity among elderly patients. , 2011, Archives of physical medicine and rehabilitation.

[9]  Huan Liu,et al.  Advancing Feature Selection Research − ASU Feature Selection Repository , 2010 .

[10]  Wan-Young Chung,et al.  A Fusion Health Monitoring Using ECG and Accelerometer sensors for Elderly Persons at Home , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[12]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[13]  C. Giemza,et al.  Body posture in elderly, physically active males , 2003, The aging male : the official journal of the International Society for the Study of the Aging Male.

[14]  Ye Li,et al.  Physical Activity Recognition Utilizing the Built-In Kinematic Sensors of a Smartphone , 2013, Int. J. Distributed Sens. Networks.

[15]  C. N. Scanaill,et al.  A Clinical Evaluation of a Remote Mobility Monitoring System based on SMS Messaging , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Edward D. Lemaire,et al.  Correcting Smartphone orientation for accelerometer-based analysis , 2013, 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[17]  John Nelson,et al.  Activity recognition with smartphone support. , 2014, Medical engineering & physics.

[18]  Cem Ersoy,et al.  A Review and Taxonomy of Activity Recognition on Mobile Phones , 2013 .

[19]  Lei Gao,et al.  Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. , 2014, Medical engineering & physics.

[20]  S. Lord,et al.  A comparison of activity classification in younger and older cohorts using a smartphone , 2014, Physiological measurement.

[21]  Edward D. Lemaire,et al.  Wearable Mobility Monitoring Using a Multimedia Smartphone Platform , 2011, IEEE Transactions on Instrumentation and Measurement.