Recognition of Physical Activities from a Single Arm-Worn Accelerometer: A Multiway Approach

In current clinical practice, functional limitations due to chronic musculoskeletal diseases are still being assessed subjectively, e.g., using questionnaires and function scores. Performance-based methods, on the other hand, offer objective insights. Hence, they recently attracted more interest as an additional source of information. This work offers a step towards the shift to performance-based methods by recognizing standardized activities from continuous readings using a single accelerometer mounted on a patient’s arm. The proposed procedure consists of two steps. Firstly, activities are segmented, including rejection of non-informative segments. Secondly, the segments are associated to predefined activities using a multiway pattern matching approach based on higher order discriminant analysis (HODA). The two steps are combined into a multi-layered framework. Experiments on data recorded from 39 patients with spondyloarthritis show results with a classification accuracy of 94.34% when perfect segmentation is assumed. Automatic segmentation has 89.32% overlap with this ideal scenario. However, combining both drops performance to 62.34% due to several badly-recognized subjects. Still, these results are shown to significantly outperform a more traditional pattern matching approach. Overall, the work indicates promising viability of the technique to automate recognition and, through future work, assessment, of functional capacity.

[1]  S. Van Huffel,et al.  Instrumented BASFI (iBASFI) Shows Promising Reliability and Validity in the Assessment of Activity Limitations in Axial Spondyloarthritis , 2016, The Journal of Rheumatology.

[2]  A. Paraschiv-lonescu,et al.  Detection and Classification of Postural Transitions in Real-World Conditions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Jeffrey M. Hausdorff,et al.  Can an accelerometer enhance the utility of the Timed Up & Go Test when evaluating patients with Parkinson's disease? , 2010, Medical engineering & physics.

[4]  Meinard Müller,et al.  Dynamic Time Warping , 2008 .

[5]  Billur Barshan,et al.  Human Activity Recognition Using Inertial/Magnetic Sensor Units , 2010, HBU.

[6]  D. Bassett,et al.  Estimating energy expenditure using accelerometers , 2006, European Journal of Applied Physiology.

[7]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[8]  Konrad Paul Kording,et al.  Using Mobile Phones for Activity Recognition in Parkinson’s Patients , 2012, Front. Neur..

[9]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[10]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[11]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[12]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[13]  Kun Li,et al.  Data sensing and analysis: Challenges for wearables , 2015, The 20th Asia and South Pacific Design Automation Conference.

[14]  M. Dougados,et al.  The Assessment of SpondyloArthritis international Society (ASAS) handbook: a guide to assess spondyloarthritis , 2009, Annals of the rheumatic diseases.

[15]  Fernando De la Torre,et al.  Generalized time warping for multi-modal alignment of human motion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[17]  M. Rudwaleit,et al.  Correction: The development of assessment of SpondyloArthritis international society classification criteria for axial spondyloarthritis (part II): validation and final selection , 2019, Annals of the rheumatic diseases.

[18]  Dominik Schuldhaus,et al.  Hierarchical, Multi-Sensor Based Classification of Daily Life Activities: Comparison with State-of-the-Art Algorithms Using a Benchmark Dataset , 2013, PloS one.

[19]  Fiona Wilson,et al.  Exercise therapy for spondyloarthritis: a systematic review , 2014, Rheumatology International.

[20]  Sabine Van Huffel,et al.  Accelerometry-Based Activity Recognition and Assessment in Rheumatic and Musculoskeletal Diseases , 2016, Sensors.

[21]  A. Calin,et al.  A new approach to defining functional ability in ankylosing spondylitis: the development of the Bath Ankylosing Spondylitis Functional Index. , 1994, The Journal of rheumatology.

[22]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[23]  Patty S. Freedson,et al.  A comprehensive evaluation of commonly used accelerometer energy expenditure and MET prediction equations , 2011, European Journal of Applied Physiology.

[24]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[25]  Alan Julian Izenman,et al.  Modern Multivariate Statistical Techniques: Regression, Classification, and Manifold Learning , 2008 .

[26]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[27]  Hassan Ghasemzadeh,et al.  An automatic segmentation technique in body sensor networks based on signal energy , 2009, BODYNETS.

[28]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[29]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[30]  Andrea Mannini,et al.  Activity recognition using a single accelerometer placed at the wrist or ankle. , 2013, Medicine and science in sports and exercise.

[31]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[32]  Julien Penders,et al.  Estimating Energy Expenditure Using Body-Worn Accelerometers: A Comparison of Methods, Sensors Number and Positioning , 2015, IEEE Journal of Biomedical and Health Informatics.

[33]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[34]  J. Staudenmayer,et al.  Validation of wearable monitors for assessing sedentary behavior. , 2011, Medicine and science in sports and exercise.

[35]  A. Cichocki,et al.  Tensor decompositions for feature extraction and classification of high dimensional datasets , 2010 .

[36]  J. D. Janssen,et al.  Assessment of energy expenditure for physical activity using a triaxial accelerometer. , 1994, Medicine and science in sports and exercise.

[37]  Anna M. Bianchi,et al.  User-Independent Recognition of Sports Activities From a Single Wrist-Worn Accelerometer: A Template-Matching-Based Approach , 2016, IEEE Transactions on Biomedical Engineering.

[38]  A. Izenman Linear Discriminant Analysis , 2013 .

[39]  Fay B. Horak,et al.  Accelerometry Reveals Differences in Gait Variability Between Patients with Multiple Sclerosis and Healthy Controls , 2012, Annals of Biomedical Engineering.

[40]  Allen Y. Yang,et al.  Distributed segmentation and classification of human actions using a wearable motion sensor network , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[41]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[42]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[43]  U. Ekelund,et al.  Assessing physical activity using wearable monitors: measures of physical activity. , 2012, Medicine and science in sports and exercise.

[44]  P. Caselli,et al.  Classification of Motor Activities through Derivative Dynamic Time Warping applied on Accelerometer Data , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[46]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[47]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..