Deep Learning to Predict Energy Expenditure and Activity Intensity in Free Living Conditions using Wrist-specific Accelerometry

Wrist-worn accelerometers are more comfortable and yield greater compliance than hip-worn devices, making them attractive for free-living activity assessments. However, intricate wrist movements may require more complex predictive models than those applied to hip-worn devices. This study developed a novel deep learning method that predicts energy expenditure and physical activity intensity of adults using wrist-specific accelerometry. Triaxial accelerometers were worn by 119 participants on their wrist and hip for two weeks during waking hours. A deep learning model was developed from week 1 data of 60 participants and tested using week 2 data for: (i) the remaining 59 participants (Group UT), and (ii) participants used for training (Group TR). Estimates of physical activity were compared to a reference hip-specific method. Moderate-to-vigorous physical activity predicted by the wrist-model was not different to the reference method for participants in Group UT (5.9±3.1vs. 6.3±3.3 hour/week) and Group TR (6.9±3.7 vs. 7.2±4.2 hour/week). At 60-s epoch level, energy expenditure predicted by the wrist-model on Group UT was strongly correlated with the reference method (r=0.86, 95%CI: 0.84-0.87) and closely predicted activity intensity (83.7%, 95%CI: 80.9-86.5%). The deep learning method has application for wrist-worn accelerometry in free-living adults.

[1]  Dinesh John,et al.  Validation and comparison of ActiGraph activity monitors. , 2011, Journal of science and medicine in sport.

[2]  John Staudenmayer,et al.  A method to estimate free-living active and sedentary behavior from an accelerometer. , 2014, Medicine and science in sports and exercise.

[3]  Edward J. Park,et al.  Identifying the number and location of body worn sensors to accurately classify walking, transferring and sedentary activities , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Laura D. Ellingson,et al.  Sedentary Behavior Research Network (SBRN) – Terminology Consensus Project process and outcome , 2017, International Journal of Behavioral Nutrition and Physical Activity.

[5]  Leena Choi,et al.  Validation of accelerometer wear and nonwear time classification algorithm. , 2011, Medicine and science in sports and exercise.

[6]  Jean-Philippe Chaput,et al.  Sleep duration and the associated cardiometabolic risk scores in adults , 2017, Sleep health.

[7]  Isha Mehta,et al.  Surface stabilized atorvastatin nanocrystals with improved bioavailability, safety and antihyperlipidemic potential , 2019, Scientific Reports.

[8]  Matthew Nicholson,et al.  Wrist-specific accelerometry methods for estimating free-living physical activity. , 2019, Journal of science and medicine in sport.

[9]  A. Sadeh,et al.  Activity-based sleep-wake identification: an empirical test of methodological issues. , 1994, Sleep.

[10]  J. Staudenmayer,et al.  Methods to estimate aspects of physical activity and sedentary behavior from high-frequency wrist accelerometer measurements. , 2015, Journal of applied physiology.

[11]  PATTY S. FREEDSON,et al.  Utilization and Harmonization of Adult Accelerometry Data: Review and Expert Consensus , 2015, Medicine and science in sports and exercise.

[12]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[13]  James M. Pivarnik,et al.  Validation and Comparison of Accelerometers Worn on the Hip, Thigh, and Wrists for Measuring Physical Activity and Sedentary Behavior , 2016, AIMS public health.

[14]  Francisco B. Ortega,et al.  Accelerometer Data Collection and Processing Criteria to Assess Physical Activity and Other Outcomes: A Systematic Review and Practical Considerations , 2017, Sports Medicine.

[15]  Plamen Angelov,et al.  A Comprehensive Review on Handcrafted and Learning-Based Action Representation Approaches for Human Activity Recognition , 2017 .

[16]  U. Ekelund,et al.  Assessing physical activity using wearable monitors: measures of physical activity. , 2012, Medicine and science in sports and exercise.

[17]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[18]  Gregory J. Welk,et al.  Associations between Physical Activity and Metabolic Syndrome: Comparison between Self-Report and Accelerometry , 2016, American journal of health promotion : AJHP.

[19]  David R Bassett,et al.  Calibration and validation of wearable monitors. , 2012, Medicine and science in sports and exercise.

[20]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[21]  Richard P Troiano,et al.  Evolution of accelerometer methods for physical activity research , 2014, British Journal of Sports Medicine.

[22]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[23]  Glyn Howatson,et al.  Energy intake and energy expenditure of pre-professional female contemporary dancers , 2017, PloS one.

[24]  Toby G Pavey,et al.  The validity of the GENEActiv wrist-worn accelerometer for measuring adult sedentary time in free living. , 2016, Journal of science and medicine in sport.

[25]  Ulf Ekelund,et al.  Age group comparability of raw accelerometer output from wrist- and hip-worn monitors. , 2014, Medicine and science in sports and exercise.

[26]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[27]  Bronwyn Clark,et al.  Field evaluation of a random forest activity classifier for wrist-worn accelerometer data. , 2016, Journal of science and medicine in sport.

[28]  Olivier Dieu,et al.  Physical activity using wrist‐worn accelerometers: comparison of dominant and non‐dominant wrist , 2017, Clinical physiology and functional imaging.

[29]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[30]  Gregory J Welk,et al.  Lab-based validation of different data processing methods for wrist-worn ActiGraph accelerometers in young adults , 2017, Physiological measurement.