Perspectives for Progress - A Framework to Evaluate Devices that Assess Physical Behavior.

A framework to develop and evaluate devices used to assess physical behavior will enable the field to move forward more cohesively and coherently. Body-worn devices that estimate physical behavior have tremendous potential to address key research gaps. However, there is no consensus on how devices and processing methods should be developed and evaluated, resulting in large differences in summary estimates and confusion for end users. We propose a phase-based framework for developing and evaluating devices that emphasizes robust validation studies in naturalistic conditions.

[1]  John G. Webster,et al.  Portable Accelerometer Device for Measuring Human Energy Expenditure , 1981, IEEE Transactions on Biomedical Engineering.

[2]  L. Sharp,et al.  From idea to market: the drug approval process. , 2001, The Journal of the American Board of Family Practice.

[3]  Munni Begum,et al.  Comparison of linear and non-linear models for predicting energy expenditure from raw accelerometer data , 2017, Physiological measurement.

[4]  Scott E Crouter,et al.  Validity of ActiGraph 2-regression model, Matthews cut-points, and NHANES cut-points for assessing free-living physical activity. , 2013, Journal of physical activity & health.

[5]  J. Staudenmayer,et al.  Development of novel techniques to classify physical activity mode using accelerometers. , 2006, Medicine and science in sports and exercise.

[6]  Gregory J Welk,et al.  Lab-based validation of different data processing methods for wrist-worn ActiGraph accelerometers in young adults , 2017, Physiological measurement.

[7]  Scott J Strath,et al.  Accelerometer use with children, older adults, and adults with functional limitations. , 2012, Medicine and science in sports and exercise.

[8]  T. Vasankari,et al.  Validation of Cut-Points for Evaluating the Intensity of Physical Activity with Accelerometry-Based Mean Amplitude Deviation (MAD) , 2015, PloS one.

[9]  Gert R. G. Lanckriet,et al.  A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers , 2014, Physiological measurement.

[10]  A. Goris,et al.  Detection of type, duration, and intensity of physical activity using an accelerometer. , 2009, Medicine and science in sports and exercise.

[11]  Tina L Hurst,et al.  Physical activity classification using the GENEA wrist-worn accelerometer. , 2012, Medicine and science in sports and exercise.

[12]  Laura D. Ellingson,et al.  Sedentary Behavior Research Network (SBRN) – Terminology Consensus Project process and outcome , 2017, International Journal of Behavioral Nutrition and Physical Activity.

[13]  Kong Y Chen,et al.  An artificial neural network model of energy expenditure using nonintegrated acceleration signals. , 2007, Journal of applied physiology.

[14]  David A. Chambers,et al.  National Institutes of Health approaches to dissemination and implementation science: current and future directions. , 2012, American journal of public health.

[15]  J. Staudenmayer,et al.  Methods to estimate aspects of physical activity and sedentary behavior from high-frequency wrist accelerometer measurements. , 2015, Journal of applied physiology.

[16]  GREGORY J. WELK,et al.  Standardizing Analytic Methods and Reporting in Activity Monitor Validation Studies , 2019, Medicine and science in sports and exercise.

[17]  Paul A Estabrooks,et al.  Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[18]  DORI ROSENBERG,et al.  Classifiers for Accelerometer-Measured Behaviors in Older Women , 2017, Medicine and science in sports and exercise.

[19]  Dinesh John,et al.  Biomechanical examination of the ‘plateau phenomenon’ in ActiGraph vertical activity counts , 2012, Physiological measurement.

[20]  Dinesh John,et al.  Performance of Activity Classification Algorithms in Free-Living Older Adults. , 2016, Medicine and science in sports and exercise.

[21]  Scott E Crouter,et al.  A novel method for using accelerometer data to predict energy expenditure. , 2006, Journal of applied physiology.

[22]  Dinesh John,et al.  Validation and comparison of ActiGraph activity monitors. , 2011, Journal of science and medicine in sport.

[23]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[24]  PATTY S. FREEDSON,et al.  Utilization and Harmonization of Adult Accelerometry Data: Review and Expert Consensus , 2015, Medicine and science in sports and exercise.

[25]  Kong Y Chen,et al.  Comparing the performance of three generations of ActiGraph accelerometers. , 2008, Journal of applied physiology.

[26]  I-Min Lee,et al.  Using accelerometers to measure physical activity in large-scale epidemiological studies: issues and challenges , 2013, British Journal of Sports Medicine.

[27]  Gregory J Welk,et al.  Validity of an Integrative Method for Processing Physical Activity Data. , 2016, Medicine and science in sports and exercise.

[28]  J. Webster,et al.  Estimation of energy expenditure by a portable accelerometer. , 1983, Medicine and science in sports and exercise.

[29]  A. Herring,et al.  Associations of Accelerometry-Assessed and Self-Reported Physical Activity and Sedentary Behavior With All-Cause and Cardiovascular Mortality Among US Adults. , 2016, American journal of epidemiology.

[30]  Charles E Matthews,et al.  Validation of a previous day recall for measuring the location and purpose of active and sedentary behaviors compared to direct observation , 2014, International Journal of Behavioral Nutrition and Physical Activity.

[31]  John Staudenmayer,et al.  Evaluation of artificial neural network algorithms for predicting METs and activity type from accelerometer data: validation on an independent sample. , 2011, Journal of applied physiology.

[32]  Klaus-Hendrik Wolf,et al.  Challenges and Opportunities for Harmonizing Research Methodology: Raw Accelerometry , 2016, Methods of Information in Medicine.

[33]  Sylvie Naar-King,et al.  From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases. , 2015, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[34]  John Staudenmayer,et al.  An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. , 2009, Journal of applied physiology.

[35]  Richard P Troiano,et al.  Evolution of accelerometer methods for physical activity research , 2014, British Journal of Sports Medicine.

[36]  P S Freedson,et al.  Calibration of the Computer Science and Applications, Inc. accelerometer. , 1998, Medicine and science in sports and exercise.

[37]  P. Dixon,et al.  A Primer on the Use of Equivalence Testing for Evaluating Measurement Agreement , 2017, Medicine and science in sports and exercise.

[38]  J A Lewis,et al.  Trials to assess equivalence: the importance of rigorous methods , 1996, BMJ.

[39]  Kate Lyden,et al.  Accelerometer output and MET values of common physical activities. , 2010, Medicine and science in sports and exercise.

[40]  John Staudenmayer,et al.  Statistical considerations in the analysis of accelerometry-based activity monitor data. , 2012, Medicine and science in sports and exercise.

[41]  Catrine Tudor-Locke,et al.  Frequently reported activities by intensity for U.S. adults: the American Time Use Survey. , 2010, American journal of preventive medicine.

[42]  Marie-France Hivert,et al.  Sedentary Behavior and Cardiovascular Morbidity and Mortality: A Science Advisory From the American Heart Association , 2016, Circulation.

[43]  A. LaCroix,et al.  Accelerometer-Measured Physical Activity and Sedentary Behavior in Relation to All-Cause Mortality: The Women's Health Study. , 2018, Circulation.

[44]  Bronwyn K. Clark,et al.  Field evaluation of a random forest activity classifier for wrist-worn accelerometer data. , 2016, Journal of science and medicine in sport.

[45]  Matthew Willetts,et al.  Statistical machine learning of sleep and physical activity phenotypes from sensor data in 96,220 UK Biobank participants , 2017, Scientific Reports.

[46]  John Staudenmayer,et al.  Direct observation is a valid criterion for estimating physical activity and sedentary behavior. , 2014, Journal of physical activity & health.

[47]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[48]  J. Staudenmayer,et al.  Validation of wearable monitors for assessing sedentary behavior. , 2011, Medicine and science in sports and exercise.

[49]  Patty S. Freedson,et al.  Comparison of Raw Acceleration from the GENEA and ActiGraph™ GT3X+ Activity Monitors , 2013, Sensors.

[50]  Gert R. G. Lanckriet,et al.  Objective Assessment of Physical Activity: Classifiers for Public Health. , 2016, Medicine and science in sports and exercise.

[51]  Wolfgang Ahrens,et al.  The German National Cohort: Aims, study des , 2014 .

[52]  T. Pischon,et al.  Prediction of activity-related energy expenditure using accelerometer-derived physical activity under free-living conditions: a systematic review , 2016, International Journal of Obesity.

[53]  Patty S. Freedson,et al.  A comprehensive evaluation of commonly used accelerometer energy expenditure and MET prediction equations , 2011, European Journal of Applied Physiology.

[54]  J. Stoker,et al.  The Department of Health and Human Services. , 1999, Home healthcare nurse.

[55]  Gregory J Welk,et al.  Protocols for evaluating equivalency of accelerometry-based activity monitors. , 2012, Medicine and science in sports and exercise.

[56]  Rohit J. Kate,et al.  Comparative evaluation of features and techniques for identifying activity type and estimating energy cost from accelerometer data , 2016, Physiological measurement.

[57]  Vinod Chandran,et al.  Ensemble Methods for Classification of Physical Activities from Wrist Accelerometry , 2017, Medicine and science in sports and exercise.

[58]  Dinesh John,et al.  “What Is a Step?” Differences in How a Step Is Detected among Three Popular Activity Monitors That Have Impacted Physical Activity Research , 2018, Sensors.

[59]  Claude Bouchard,et al.  Trends over 5 Decades in U.S. Occupation-Related Physical Activity and Their Associations with Obesity , 2011, PloS one.

[60]  John Staudenmayer,et al.  A method to estimate free-living active and sedentary behavior from an accelerometer. , 2014, Medicine and science in sports and exercise.

[61]  John Staudenmayer,et al.  Errors in MET estimates of physical activities using 3.5 ml x kg(-1) x min(-1) as the baseline oxygen consumption. , 2010, Journal of physical activity & health.

[62]  Nuala M. Byrne,et al.  Assessment of Physical Activity and Energy Expenditure: An Overview of Objective Measures , 2014, Front. Nutr..

[63]  Nils Y. Hammerla,et al.  Large Scale Population Assessment of Physical Activity Using Wrist Worn Accelerometers: The UK Biobank Study , 2017, PloS one.

[64]  Alan Kevin Bourke,et al.  Development of a gold-standard method for the identification of sedentary, light and moderate physical activities in older adults: Definitions for video annotation. , 2019, Journal of science and medicine in sport.

[65]  E. Tomasi,et al.  Calibration of raw accelerometer data to measure physical activity: A systematic review. , 2018, Gait & posture.

[66]  Patty Freedson,et al.  Assessment of physical activity using wearable monitors: recommendations for monitor calibration and use in the field. , 2012, Medicine and science in sports and exercise.

[67]  Gert R. G. Lanckriet,et al.  Hip and Wrist Accelerometer Algorithms for Free-Living Behavior Classification. , 2016, Medicine and science in sports and exercise.

[68]  Lindsay P. Toth,et al.  Video-Recorded Validation of Wearable Step Counters under Free-living Conditions , 2018, Medicine and science in sports and exercise.

[69]  Raymond J Carroll,et al.  Measurement of Active and Sedentary Behavior in Context of Large Epidemiologic Studies , 2017, Medicine and science in sports and exercise.

[70]  J. Staudenmayer,et al.  Influence of Accelerometer Calibration Approach on Moderate–Vigorous Physical Activity Estimates for Adults , 2018, Medicine and science in sports and exercise.

[71]  Andrea K. Chomistek,et al.  Physical Activity Assessment with the ActiGraph GT3X and Doubly Labeled Water , 2017, Medicine and science in sports and exercise.

[72]  David R Bassett,et al.  2011 Compendium of Physical Activities: a second update of codes and MET values. , 2011, Medicine and science in sports and exercise.

[73]  Alberto G. Bonomi,et al.  Identifying Types of Physical Activity With a Single Accelerometer: Evaluating Laboratory-trained Algorithms in Daily Life , 2011, IEEE Transactions on Biomedical Engineering.

[74]  New S Tudy The German National Cohort: aims, study design and organization , 2014 .

[75]  Russell V. Lenth,et al.  Some Practical Guidelines for Effective Sample Size Determination , 2001 .

[76]  Jonathan Lester,et al.  New horizons in sensor development. , 2012, Medicine and science in sports and exercise.

[77]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .