Performance of Activity Classification Algorithms in Free-Living Older Adults.

PURPOSE The objective of this study is to compare activity type classification rates of machine learning algorithms trained on laboratory versus free-living accelerometer data in older adults. METHODS Thirty-five older adults (21 females and 14 males, 70.8 ± 4.9 yr) performed selected activities in the laboratory while wearing three ActiGraph GT3X+ activity monitors (in the dominant hip, wrist, and ankle; ActiGraph, LLC, Pensacola, FL). Monitors were initialized to collect raw acceleration data at a sampling rate of 80 Hz. Fifteen of the participants also wore GT3X+ in free-living settings and were directly observed for 2-3 h. Time- and frequency-domain features from acceleration signals of each monitor were used to train random forest (RF) and support vector machine (SVM) models to classify five activity types: sedentary, standing, household, locomotion, and recreational activities. All algorithms were trained on laboratory data (RFLab and SVMLab) and free-living data (RFFL and SVMFL) using 20-s signal sampling windows. Classification accuracy rates of both types of algorithms were tested on free-living data using a leave-one-out technique. RESULTS Overall classification accuracy rates for the algorithms developed from laboratory data were between 49% (wrist) and 55% (ankle) for the SVMLab algorithms and 49% (wrist) to 54% (ankle) for the RFLab algorithms. The classification accuracy rates for SVMFL and RFFL algorithms ranged from 58% (wrist) to 69% (ankle) and from 61% (wrist) to 67% (ankle), respectively. CONCLUSIONS Our algorithms developed on free-living accelerometer data were more accurate in classifying the activity type in free-living older adults than those on our algorithms developed on laboratory accelerometer data. Future studies should consider using free-living accelerometer data to train machine learning algorithms in older adults.

[1]  C. Jessie Jones,et al.  Development and Validation of a Functional Fitness Test for Community-Residing Older Adults , 1999 .

[2]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[3]  R. Eston,et al.  Activity classification using the GENEA: optimum sampling frequency and number of axes. , 2012, Medicine and science in sports and exercise.

[4]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[5]  L. Ferrucci,et al.  A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. , 1994, Journal of gerontology.

[6]  Alberto G. Bonomi,et al.  Identifying Types of Physical Activity With a Single Accelerometer: Evaluating Laboratory-trained Algorithms in Daily Life , 2011, IEEE Transactions on Biomedical Engineering.

[7]  Friedrich Foerster,et al.  Motion pattern and posture: Correctly assessed by calibrated accelerometers , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[8]  J. Fahrenberg,et al.  Assessment of posture and motion by multichannel piezoresistive accelerometer recordings. , 1997, Psychophysiology.

[9]  J. Staudenmayer,et al.  Methods to estimate aspects of physical activity and sedentary behavior from high-frequency wrist accelerometer measurements. , 2015, Journal of applied physiology.

[10]  Andrea Mannini,et al.  Activity recognition using a single accelerometer placed at the wrist or ankle. , 2013, Medicine and science in sports and exercise.

[11]  John Staudenmayer,et al.  An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. , 2009, Journal of applied physiology.

[12]  Francisca Galindo Garre,et al.  Evaluation of neural networks to identify types of activity using accelerometers. , 2011, Medicine and science in sports and exercise.

[13]  Tina L Hurst,et al.  Physical activity classification using the GENEA wrist-worn accelerometer. , 2012, Medicine and science in sports and exercise.

[14]  A. Goris,et al.  Detection of type, duration, and intensity of physical activity using an accelerometer. , 2009, Medicine and science in sports and exercise.

[15]  J. Staudenmayer,et al.  Classification accuracy of the wrist-worn gravity estimator of normal everyday activity accelerometer. , 2013, Medicine and science in sports and exercise.

[16]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[17]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.