How well do activity monitors estimate energy expenditure? A systematic review and meta-analysis of the validity of current technologies

Objective To determine the accuracy of wrist and arm-worn activity monitors’ estimates of energy expenditure (EE). Data sources SportDISCUS (EBSCOHost), PubMed, MEDLINE (Ovid), PsycINFO (EBSCOHost), Embase (Ovid) and CINAHL (EBSCOHost). Design A random effects meta-analysis was performed to evaluate the difference in EE estimates between activity monitors and criterion measurements. Moderator analyses were conducted to determine the benefit of additional sensors and to compare the accuracy of devices used for research purposes with commercially available devices. Eligibility criteria We included studies validating EE estimates from wrist-worn or arm-worn activity monitors against criterion measures (indirect calorimetry, room calorimeters and doubly labelled water) in healthy adult populations. Results 60 studies (104 effect sizes) were included in the meta-analysis. Devices showed variable accuracy depending on activity type. Large and significant heterogeneity was observed for many devices (I2 >75%). Combining heart rate or heat sensing technology with accelerometry decreased the error in most activity types. Research-grade devices were statistically more accurate for comparisons of total EE but less accurate than commercial devices during ambulatory activity and sedentary tasks. Conclusions EE estimates from wrist and arm-worn devices differ in accuracy depending on activity type. Addition of physiological sensors improves estimates of EE, and research-grade devices are superior for total EE. These data highlight the need to improve estimates of EE from wearable devices, and one way this can be achieved is with the addition of heart rate to accelerometry. PROSPEROregistration number CRD42018085016.

[1]  Kevin D Hall,et al.  Validation of an inexpensive and accurate mathematical method to measure long-term changes in free-living energy intake. , 2015, The American journal of clinical nutrition.

[2]  P. Benito,et al.  Validation of the SenseWear armband in circuit resistance training with different loads , 2012, European Journal of Applied Physiology.

[3]  Hans Braun,et al.  Assessing energy expenditure in male endurance athletes: validity of the SenseWear Armband. , 2011, Medicine and science in sports and exercise.

[4]  James A Levine,et al.  Measurement of energy expenditure. , 2005, Public health nutrition.

[5]  Linda E Rohr,et al.  Accuracy of the vivofit activity tracker , 2016, Journal of medical engineering & technology.

[6]  F. Song,et al.  Evaluating non-randomised intervention studies. , 2003, Health technology assessment.

[7]  G. Plasqui,et al.  Smart approaches for assessing free‐living energy expenditure following identification of types of physical activity , 2017, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[8]  Jeff Goldsmith,et al.  Validation of the Fitbit One® for physical activity measurement at an upper torso attachment site , 2016, BMC Research Notes.

[9]  Mario Siervo,et al.  Is Obesity Associated with Altered Energy Expenditure? , 2016, Advances in nutrition.

[10]  Metin Lütfi Baydar,et al.  Accuracy of the Polar S810i(TM) Heart Rate Monitor and the Sensewear Pro Armband(TM) to Estimate Energy Expenditure of Indoor Rowing Exercise in Overweight and Obese Individuals. , 2010, Journal of sports science & medicine.

[11]  M. Willander,et al.  Valence band structures of heavily doped strained GexSi1−x layers , 1993 .

[12]  Kathryn Sandberg,et al.  How consumer physical activity monitors could transform human physiology research. , 2017, American journal of physiology. Regulatory, integrative and comparative physiology.

[13]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[14]  Paolo Marzullo,et al.  Evaluation of a Multisensor Armband in Estimating Energy Expenditure in Obese Individuals , 2006, Obesity.

[15]  L. Hedges Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[16]  Corby K. Martin,et al.  Evaluation of the ability of three physical activity monitors to predict weight change and estimate energy expenditure. , 2016, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[17]  R. Rabasa-Lhoret,et al.  Validation and reliability of two activity monitors for energy expenditure assessment. , 2016, Journal of science and medicine in sport.

[18]  Barbara Pellegrini,et al.  Validity of the SenseWear Armband to assess energy expenditure in graded walking. , 2015, Journal of physical activity & health.

[19]  Sari A Acra,et al.  Predicting energy expenditure of physical activity using hip- and wrist-worn accelerometers. , 2003, Diabetes technology & therapeutics.

[20]  Gregory J. Welk,et al.  Objective and subjective measurement of energy expenditure in older adults: A doubly-labeled water study , 2014, European Journal of Clinical Nutrition.

[21]  L. Ellegård,et al.  Energy expenditure by multisensor armband in overweight and obese lactating women validated by doubly labeled water , 2013, Obesity.

[22]  David McMinn,et al.  The effect of a school-based active commuting intervention on children's commuting physical activity and daily physical activity. , 2012, Preventive medicine.

[23]  M. Marcus,et al.  Evaluation of the SenseWear Pro Armband to assess energy expenditure during exercise. , 2004, Medicine and science in sports and exercise.

[24]  K. Carlsen,et al.  Validity of physical activity monitors in adults participating in free-living activities , 2008, British Journal of Sports Medicine.

[25]  Jung-Min Lee,et al.  Validity of SenseWear® Armband v5.2 and v2.2 for estimating energy expenditure , 2016, Journal of sports sciences.

[26]  Gregory J Welk,et al.  Field Validation of the MTI Actigraph and BodyMedia Armband Monitor Using the IDEEA Monitor , 2007, Obesity.

[27]  Paul W. Franks,et al.  Estimation of Free-Living Energy Expenditure by Heart Rate and Movement Sensing: A Doubly-Labelled Water Study , 2015, PloS one.

[28]  Scott E Crouter,et al.  Accuracy of Consumer Monitors for Estimating Energy Expenditure and Activity Type , 2017, Medicine and science in sports and exercise.

[29]  S. Berntsen,et al.  Physical activity monitor for recording energy expenditure in pregnancy , 2011, Acta obstetricia et gynecologica Scandinavica.

[30]  Gregory J Welk,et al.  Validity of the SenseWear® Armband to predict energy expenditure in pregnant women. , 2012, Medicine and science in sports and exercise.

[31]  Paul Hibbing,et al.  Comparative evaluation of heart rate-based monitors: Apple Watch vs Fitbit Charge HR , 2018, Journal of sports sciences.

[32]  John P. Porcari,et al.  The accuracy of various activity trackers in estimating steps taken and energy expenditure , 2013 .

[33]  J. Schwartz,et al.  Abstract MP11: Fitbit: An Accurate and Reliable Device for Wireless Physical Activity Tracking , 2015 .

[34]  David J Spiegelhalter,et al.  A re-evaluation of random-effects meta-analysis , 2009, Journal of the Royal Statistical Society. Series A,.

[35]  J. Seale,et al.  Seven-day validation of doubly labeled water method using indirect room calorimetry. , 1993, Journal of applied physiology.

[36]  Johan Lefevre,et al.  Validation of the SenseWear Pro3 Armband Using an Incremental Exercise Test , 2014, Journal of strength and conditioning research.

[37]  Kryštof Slabý,et al.  Validation of physical activity monitors in individuals with diabetes: energy expenditure estimation by the multisensor SenseWear Armband Pro3 and the step counter Omron HJ-720 against indirect calorimetry during walking. , 2013, Diabetes technology & therapeutics.

[38]  Annemarie Koster,et al.  Validation of an armband to measure daily energy expenditure in older adults. , 2011, The journals of gerontology. Series A, Biological sciences and medical sciences.

[39]  Filip Boen,et al.  Validation of the SenseWear Armband in different ambient temperatures , 2015, Journal of sports sciences.

[40]  M. Gorelick,et al.  Accuracy of an infrared LED device to measure heart rate and energy expenditure during rest and exercise , 2011, Journal of sports sciences.

[41]  Patrick Wahl,et al.  Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions , 2017, Front. Physiol..

[42]  Mee-Sup Yoon,et al.  mTOR as a Key Regulator in Maintaining Skeletal Muscle Mass , 2017, Front. Physiol..

[43]  Livio Luzi,et al.  Energy Expenditure Evaluation in Humans and Non-Human Primates by SenseWear Armband. Validation of Energy Expenditure Evaluation by SenseWear Armband by Direct Comparison with Indirect Calorimetry , 2013, PloS one.

[44]  Janelle M. Wagnild,et al.  Gender differences in walking (for leisure, transport and in total) across adult life: a systematic review , 2017, BMC Public Health.

[45]  James M. Pivarnik,et al.  Comparison of Activity Type Classification Accuracy from Accelerometers Worn on the Hip, Wrists, and Thigh in Young, Apparently Healthy Adults , 2016 .

[46]  N. Black,et al.  The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. , 1998, Journal of epidemiology and community health.

[47]  S B Heymsfield,et al.  Response to ‘Energy balance measurement: when something is not better than nothing’ , 2015, International Journal of Obesity.

[48]  J. Brugniaux,et al.  Polar Activity Watch 200: a new device to accurately assess energy expenditure , 2008, British Journal of Sports Medicine.

[49]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[50]  David Moher,et al.  Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement , 2018, JAMA.

[51]  Charles E Matthews,et al.  Comparative validity of physical activity measures in older adults. , 2011, Medicine and science in sports and exercise.

[52]  Philippe Lacomme,et al.  Comparison of total energy expenditure assessed by two devices in controlled and free-living conditions , 2015, European journal of sport science.

[53]  A. Brazeau,et al.  Accuracy of Energy Expenditure Estimation by Activity Monitors Differs with Ethnicity , 2014, International Journal of Sports Medicine.

[54]  Matthew P Buman,et al.  Validity and reliability of Nike + Fuelband for estimating physical activity energy expenditure , 2015, BMC Sports Science, Medicine and Rehabilitation.

[55]  Malgorzata Klass,et al.  Assessment of energy expenditure during high intensity cycling and running using a heart rate and activity monitor in young active adults , 2019, PloS one.

[56]  Alexander H.K. Montoye,et al.  Comparative Accuracy of a Wrist-Worn Activity Tracker and a Smart Shirt for Physical Activity Assessment , 2017 .

[57]  S B Heymsfield,et al.  Energy balance measurement: when something is not better than nothing , 2014, International Journal of Obesity.

[58]  Sofie Martien,et al.  Energy Expenditure in Institutionalized Older Adults: Validation of SenseWear Mini. , 2015, Medicine and science in sports and exercise.

[59]  Manfred J. Müller,et al.  Accuracy of a Portable Multisensor Body Monitor for Predicting Resting Energy Expenditure in Older People: A Comparison with Indirect Calorimetry , 2010, Gerontology.

[60]  Edward L. Melanson,et al.  A novel approach for measuring energy expenditure in free-living humans , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  Maroje Soric,et al.  Validation of the Sensewear Armband during recreational in-line skating , 2011, European Journal of Applied Physiology.

[62]  Hyun-Sung An,et al.  How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? , 2016, BMJ Open Sport & Exercise Medicine.

[63]  Virginia Pensabene,et al.  Assessment of the Fitbit Charge 2 for monitoring heart rate , 2018, PloS one.

[64]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.

[65]  D. Hollander,et al.  Validity of Wearable Activity Monitors during Cycling and Resistance Exercise , 2017, Medicine and science in sports and exercise.

[66]  Enhad A. Chowdhury,et al.  Assessment of laboratory and daily energy expenditure estimates from consumer multi-sensor physical activity monitors , 2017, PloS one.

[67]  Yoshio Nakata,et al.  Accuracy of Wearable Devices for Estimating Total Energy Expenditure: Comparison With Metabolic Chamber and Doubly Labeled Water Method. , 2016, JAMA internal medicine.

[68]  Leonard A Kaminsky,et al.  Comparison of four Fitbit and Jawbone activity monitors with a research-grade ActiGraph accelerometer for estimating physical activity and energy expenditure , 2017, British Journal of Sports Medicine.

[69]  Gregory J Welk,et al.  Validity of physical activity monitors for assessing lower intensity activity in adults , 2014, International Journal of Behavioral Nutrition and Physical Activity.

[70]  K. Price,et al.  Validation of the Fitbit One, Garmin Vivofit and Jawbone UP activity tracker in estimation of energy expenditure during treadmill walking and running , 2017, Journal of medical engineering & technology.

[71]  Gregory J Welk,et al.  Validity of consumer-based physical activity monitors. , 2014, Medicine and science in sports and exercise.

[72]  Karsten Koehler,et al.  Monitoring Energy Expenditure Using a Multi-Sensor Device—Applications and Limitations of the SenseWear Armband in Athletic Populations , 2017, Front. Physiol..

[73]  Blair T. Johnson,et al.  Dynamic Resistance Training as Stand‐Alone Antihypertensive Lifestyle Therapy: A Meta‐Analysis , 2016, Journal of the American Heart Association.

[74]  T. Hastie,et al.  Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort , 2016, bioRxiv.

[75]  F. Pitta,et al.  Step counting and energy expenditure estimation in patients with chronic obstructive pulmonary disease and healthy elderly: accuracy of 2 motion sensors. , 2010, Archives of physical medicine and rehabilitation.

[76]  Karsten Froberg,et al.  Hierarchy of individual calibration levels for heart rate and accelerometry to measure physical activity. , 2007, Journal of applied physiology.

[77]  Gregory J Welk,et al.  Accuracy of armband monitors for measuring daily energy expenditure in healthy adults. , 2010, Medicine and science in sports and exercise.

[78]  L. Andersen,et al.  Validation of SenseWear Armband in children, adolescents, and adults , 2018, Scandinavian journal of medicine & science in sports.

[79]  Gregory J Welk,et al.  Criterion Validity of Competing Accelerometry-Based Activity Monitoring Devices. , 2015, Medicine and science in sports and exercise.

[80]  D. Mignault,et al.  Accuracy of the SenseWear Armband™ during Ergocycling , 2011, International journal of sports medicine.

[81]  Julian P T Higgins,et al.  Commentary: Heterogeneity in meta-analysis should be expected and appropriately quantified. , 2008, International journal of epidemiology.

[82]  Christopher J. Dondzila,et al.  Comparative accuracy of fitness tracking modalities in quantifying energy expenditure , 2016, Journal of medical engineering & technology.

[83]  David B Allison,et al.  Evaluation of a portable device to measure daily energy expenditure in free-living adults. , 2007, The American journal of clinical nutrition.

[84]  John Gormley,et al.  Measurement of energy expenditure by activity monitors , 2013 .

[85]  Joel D. Reece,et al.  Validation of the SenseWear Armband as a Measure of Sedentary Behavior and Light Activity. , 2015, Journal of physical activity & health.

[86]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[87]  L B Sardinha,et al.  Accuracy of a combined heart rate and motion sensor for assessing energy expenditure in free-living adults during a double-blind crossover caffeine trial using doubly labeled water as the reference method , 2014, European Journal of Clinical Nutrition.

[88]  Thierry Troosters,et al.  Validity of activity monitors in health and chronic disease: a systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[89]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[90]  Margaret L Fruin,et al.  Validity of a multi-sensor armband in estimating rest and exercise energy expenditure. , 2004, Medicine and science in sports and exercise.

[91]  Patty S. Freedson,et al.  A comprehensive evaluation of commonly used accelerometer energy expenditure and MET prediction equations , 2011, European Journal of Applied Physiology.

[92]  J. Vanhelst,et al.  Comparison of two ActiGraph accelerometer generations in the assessment of physical activity in free living conditions , 2012, BMC Research Notes.

[93]  Charlie Potter,et al.  Comparison of activity monitors to estimate energy cost of treadmill exercise. , 2004, Medicine and science in sports and exercise.

[94]  Dan Dwyer,et al.  Validity of the ActiGraph GT 3 X + and BodyMedia SenseWear Armband to estimate energy expenditure during physical activity and sport Running Head : Validity of the ActiGraph GT 3 X + and BodyMedia Armband to predict energy expenditure , 2017 .

[95]  Nick Ball,et al.  Accuracy of the SenseWear Armband Mini and the BodyMedia FIT in resistance training. , 2014, Journal of science and medicine in sport.

[96]  Shalaya Kipp,et al.  Calculating metabolic energy expenditure across a wide range of exercise intensities: the equation matters. , 2018, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[97]  M Benjamin Nelson,et al.  Validity of Consumer-Based Physical Activity Monitors for Specific Activity Types. , 2016, Medicine and science in sports and exercise.

[98]  Nuala M. Byrne,et al.  Assessment of Physical Activity and Energy Expenditure: An Overview of Objective Measures , 2014, Front. Nutr..

[99]  Nathalie Farpour-Lambert,et al.  Diet, genes, and obesity , 2018, British Medical Journal.

[100]  Andreas Holtermann,et al.  Validation of Five Minimally Obstructive Methods to Estimate Physical Activity Energy Expenditure in Young Adults in Semi-Standardized Settings , 2015, Sensors.