Estimating activity energy expenditure: how valid are physical activity questionnaires?

Activity energy expenditure (AEE) is the modifiable component of total energy expenditure (TEE) derived from all activities, both volitional and nonvolitional. Because AEE may affect health, there is interest in its estimation in free-living people. Physical activity questionnaires (PAQs) could be a feasible approach to AEE estimation in large populations, but it is unclear whether or not any PAQ is valid for this purpose. Our aim was to explore the validity of existing PAQs for estimating usual AEE in adults, using doubly labeled water (DLW) as a criterion measure. We reviewed 20 publications that described PAQ-to-DLW comparisons, summarized study design factors, and appraised criterion validity using mean differences (AEE(PAQ) - AEE(DLW), or TEE(PAQ) - TEE(DLW)), 95% limits of agreement, and correlation coefficients (AEE(PAQ) versus AEE(DLW) or TEE(PAQ) versus TEE(DLW)). Only 2 of 23 PAQs assessed most types of activity over the past year and indicated acceptable criterion validity, with mean differences (TEE(PAQ) - TEE(DLW)) of 10% and 2% and correlation coefficients of 0.62 and 0.63, respectively. At the group level, neither overreporting nor underreporting was more prevalent across studies. We speculate that, aside from reporting error, discrepancies between PAQ and DLW estimates may be partly attributable to 1) PAQs not including key activities related to AEE, 2) PAQs and DLW ascertaining different time periods, or 3) inaccurate assignment of metabolic equivalents to self-reported activities. Small sample sizes, use of correlation coefficients, and limited information on individual validity were problematic. Future research should address these issues to clarify the true validity of PAQs for estimating AEE.

[1]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[2]  H. Montoye,et al.  Assessment of physical activity by questionnaire and interview. , 1967, The Journal of sports medicine and physical fitness.

[3]  J. Garrow,et al.  Diet and obesity. , 1973, Proceedings of the Royal Society of Medicine.

[4]  R. Paffenbarger,et al.  Physical activity as an index of heart attack risk in college alumni. , 1978, American journal of epidemiology.

[5]  A S Leon,et al.  A questionnaire for the assessment of leisure time physical activities. , 1978, Journal of chronic diseases.

[6]  J E Frijters,et al.  A short questionnaire for the measurement of habitual physical activity in epidemiological studies. , 1982, The American journal of clinical nutrition.

[7]  K. Vranizan,et al.  Assessment of habitual physical activity by a seven-day recall in a community survey and controlled experiments. , 1985, American journal of epidemiology.

[8]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[9]  R E LaPorte,et al.  Assessment of physical activity in epidemiologic research: problems and prospects. , 1985, Public health reports.

[10]  J. Sallis,et al.  Physical activity assessment methodology in the Five-City Project. , 1985, American journal of epidemiology.

[11]  E. Danforth,et al.  Diet and obesity. , 1985, The American journal of clinical nutrition.

[12]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[13]  D A Schoeller,et al.  Measurement of energy expenditure in free-living humans by using doubly labeled water. , 1988, The Journal of nutrition.

[14]  K. Morgan,et al.  Levels of customary physical activity among the old and the very old living at home. , 1988, Journal of epidemiology and community health.

[15]  H. Kohl,et al.  A mail survey of physical activity habits as related to measured physical fitness. , 1988, American journal of epidemiology.

[16]  W. Coward Stable isotopic methods for measuring energy expenditure. The doubly-labelled-water (2H2(18)O) method: principles and practice. , 1988, The Proceedings of the Nutrition Society.

[17]  R. Dishman,et al.  Reliability and concurrent validity for a 7-d re-call of physical activity in college students. , 1988, Medicine and science in sports and exercise.

[18]  B Rosner,et al.  Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. , 2006, Statistics in medicine.

[19]  Lewis H Kuller,et al.  Development of Questionnaire to Examine Relationship of Physical Activity and Diabetes in Pima Indians , 1990, Diabetes Care.

[20]  J. Speakman Principles, problems and a paradox with the measurement of energy expenditure of free-living subjects using doubly-labelled water. , 1990, Statistics in medicine.

[21]  M. Livingstone,et al.  Potential contribution of leisure activity to the energy expenditure patterns of sedentary populations , 1991, British Journal of Nutrition.

[22]  D. Brodie,et al.  Leisure-time physical activity as an estimate of physical fitness: a validation study. , 1991, Journal of clinical epidemiology.

[23]  P. Deurenberg,et al.  A physical activity questionnaire for the elderly. , 1991, Medicine and science in sports and exercise.

[24]  H J Montoye,et al.  Variability of some objective measures of physical activity. , 1992, Medicine and science in sports and exercise.

[25]  Vangeli Rs Influence of diet and exercise on energy expenditure-a review , 1992 .

[26]  R. S. Van Zant Influence of diet and exercise on energy expenditure--a review. , 1992, International journal of sport nutrition.

[27]  M. Goran,et al.  Total energy expenditure and energy requirements in healthy elderly persons. , 1992, Metabolism: clinical and experimental.

[28]  C. Caspersen,et al.  A survey for assessing physical activity among older adults. , 1993, Medicine and science in sports and exercise.

[29]  A. Jette,et al.  The Physical Activity Scale for the Elderly (PASE): development and evaluation. , 1993, Journal of clinical epidemiology.

[30]  B E Ainsworth,et al.  Validity and reliability of self-reported physical activity status: the Lipid Research Clinics questionnaire. , 1993, Medicine and science in sports and exercise.

[31]  B. Bellach Remarks on the use of Pearson's correlation coefficient and other association measures in assessing validity and reliability of dietary assessment methods. , 1993, European journal of clinical nutrition.

[32]  J F Sallis,et al.  Compendium of physical activities: classification of energy costs of human physical activities. , 1993, Medicine and science in sports and exercise.

[33]  J. Lacour,et al.  A new tool for evaluating energy expenditure: the "QAPSE" development and validation. , 1993, Medicine and science in sports and exercise.

[34]  H J Montoye,et al.  Assessment of the accuracy of physical activity questionnaire occupational data. , 1993, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[35]  B E Ainsworth,et al.  A simultaneous evaluation of 10 commonly used physical activity questionnaires. , 1993, Medicine and science in sports and exercise.

[36]  A. Prentice,et al.  Energy balance in healthy elderly women , 1993, British Journal of Nutrition.

[37]  Correction approaches for doubly labeled water in situations of changing background water abundance. , 1995, Obesity research.

[38]  H. Kemper,et al.  Validity and repeatability of a modified Baecke questionnaire on physical activity. , 1995, International journal of epidemiology.

[39]  D A Schoeller,et al.  Analytic requirements for the doubly labeled water method. , 1995, Obesity research.

[40]  D A Schoeller,et al.  Comparison of heart rate and physical activity recall with doubly labeled water in obese women. , 1995, Medicine and science in sports and exercise.

[41]  D. Altman,et al.  Comparing methods of measurement: why plotting difference against standard method is misleading , 1995, The Lancet.

[42]  J. Sallis Measuring Physical Activity and Energy Expenditure , 1996 .

[43]  Wim H. M. Saris,et al.  Measuring Physical Activity and Energy Expenditure , 1996 .

[44]  P S Freedson,et al.  Physical activity assessment: a review of methods. , 1996, Critical reviews in food science and nutrition.

[45]  Mark A Pereira,et al.  A collection of Physical Activity Questionnaires for health-related research. , 1997, Medicine and science in sports and exercise.

[46]  K. Westerterp,et al.  Validity of the Physical Activity Scale for the Elderly (PASE): according to energy expenditure assessed by the doubly labeled water method. , 1997, Journal of clinical epidemiology.

[47]  N. Wareham,et al.  The validation of physical activity instruments for measuring energy expenditure: problems and pitfalls , 1998, Public Health Nutrition.

[48]  R. Meeusen,et al.  Validity and reliability in a Flemish population of the WHO-MONICA Optional Study of Physical Activity Questionnaire. , 1998, Medicine and science in sports and exercise.

[49]  J R Speakman,et al.  The history and theory of the doubly labeled water technique. , 1998, The American journal of clinical nutrition.

[50]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[51]  B. Ainsworth,et al.  Intra-individual variation and estimates of usual physical activity. , 1999, Annals of epidemiology.

[52]  K R Westerterp,et al.  Doubly labelled water validation of three physical activity questionnaires. , 1999, International journal of sports medicine.

[53]  B E Ainsworth,et al.  Moderate physical activity patterns of minority women: the Cross-Cultural Activity Participation Study. , 1999, Journal of women's health & gender-based medicine.

[54]  D. Matthews,et al.  Assessment of physical activity in older individuals: a doubly labeled water study. , 1999, Journal of applied physiology.

[55]  D A Schoeller,et al.  Recent advances from application of doubly labeled water to measurement of human energy expenditure. , 1999, The Journal of nutrition.

[56]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[57]  T. Cole,et al.  Within- and between-subject variation in energy expenditure measured by the doubly-labelled water technique: implications for validating reported dietary energy intake , 2000, European Journal of Clinical Nutrition.

[58]  B E Ainsworth,et al.  Validity of four motion sensors in measuring moderate intensity physical activity. , 2000, Medicine and science in sports and exercise.

[59]  P. Freedson,et al.  Validity of accelerometry for the assessment of moderate intensity physical activity in the field. , 2000, Medicine and science in sports and exercise.

[60]  A. Kriska,et al.  Self-administered questionnaire compared with interview to assess past-year physical activity. , 2000, Medicine and science in sports and exercise.

[61]  E. Howley Type of activity: resistance, aerobic and leisure versus occupational physical activity. , 2001, Medicine and science in sports and exercise.

[62]  H. Nagaraja,et al.  Evaluation of methods to assess physical activity in free-living conditions. , 2001, Medicine and science in sports and exercise.

[63]  B E Ainsworth,et al.  Quantifying energy expenditure and physical activity in the context of dose response. , 2001, Medicine and science in sports and exercise.

[64]  P. M. Reid,et al.  Validation of the Arizona Activity Frequency Questionnaire using doubly labeled water. , 2001, Medicine and science in sports and exercise.

[65]  J. Lacour,et al.  Simultaneous Validation of Ten Physical Activity Questionnaires in Older Men: A Doubly Labeled Water Study , 2001, Journal of the American Geriatrics Society.

[66]  Klaas R. Westerterp,et al.  Pattern and intensity of physical activity , 2001, Nature.

[67]  B E Ainsworth,et al.  Estimation of energy expenditure from physical activity measures: determinants of accuracy. , 2001, Obesity research.

[68]  Garrett Fitzmaurice,et al.  Statistical methods for assessing agreement. , 2002, Nutrition.

[69]  Barbara E Ainsworth,et al.  Comparison of energy expenditure estimates from doubly labeled water, a physical activity questionnaire, and physical activity records. , 2002, The American journal of clinical nutrition.

[70]  N. Day,et al.  Validity and repeatability of the EPIC-Norfolk Physical Activity Questionnaire. , 2002, International journal of epidemiology.

[71]  G. Ma,et al.  Energy requirements of urban Chinese adults with manual or sedentary occupations, determined using the doubly labeled water method , 2002, European Journal of Clinical Nutrition.

[72]  Charles E Matthews,et al.  Systematic errors in middle-aged women's estimates of energy intake: comparing three self-report measures to total energy expenditure from doubly labeled water. , 2002, Annals of epidemiology.

[73]  E. Forsum,et al.  Assessing Physical Activity of Women of Childbearing Age. Ongoing Work to Develop and Evaluate Simple Methods , 2002, Food and nutrition bulletin.

[74]  J. Seale,et al.  Energy expenditure measured by doubly labeled water, activity recall, and diet records in the rural elderly. , 2002, Nutrition.

[75]  Barbara E Ainsworth,et al.  Estimating energy expenditure from the Minnesota Leisure Time Physical Activity and Tecumseh Occupational Activity questionnaires - a doubly labeled water validation. , 2002, Journal of clinical epidemiology.

[76]  L. Tapsell,et al.  Relationship of high energy expenditure and variation in dietary intake with reporting accuracy on 7 day food records and diet histories in a group of healthy adult volunteers , 2002, European Journal of Clinical Nutrition.

[77]  P. Trumbo,et al.  Dietary reference intakes for energy, carbohydrate, fiber, fat, fatty acids, cholesterol, protein and amino acids. , 2002, Journal of the American Dietetic Association.

[78]  James A Levine,et al.  Non-exercise activity thermogenesis , 2003, Proceedings of the Nutrition Society.

[79]  E. Forsum,et al.  Comparison of commonly used procedures, including the doubly-labelled water technique, in the estimation of total energy expenditure of women with special reference to the significance of body fatness* , 2003, British Journal of Nutrition.

[80]  M. Livingstone,et al.  Markers of the validity of reported energy intake. , 2003, The Journal of nutrition.

[81]  D. Altman,et al.  Applying the right statistics: analyses of measurement studies , 2003, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[82]  B. Ainsworth,et al.  Reproducibility and validity of the Shanghai Women's Health Study physical activity questionnaire. , 2003, American journal of epidemiology.

[83]  Jo Mitchell,et al.  Validity and repeatability of a simple index derived from the short physical activity questionnaire used in the European Prospective Investigation into Cancer and Nutrition (EPIC) study , 2003, Public Health Nutrition.

[84]  R. Shephard Limits to the measurement of habitual physical activity by questionnaires , 2003, British journal of sports medicine.

[85]  J. Donnelly,et al.  The validity of the Stanford Seven-Day Physical Activity Recall in young adults. , 2003, Medicine and science in sports and exercise.

[86]  P. Ainslie,et al.  Physiology of accidental hypothermia in the mountains: a forgotten story , 2003, British journal of sports medicine.

[87]  B. Ainsworth,et al.  Evaluation of a two-part survey item to assess moderate physical activity: the Cross-Cultural Activity Participation Study. , 2003, Journal of women's health.

[88]  K. Westerterp,et al.  Seasonal variation in total energy expenditure and physical activity in Dutch young adults. , 2004, Obesity research.

[89]  E. Forsum,et al.  Validation of energy intake by dietary recall against different methods to assess energy expenditure. , 2004, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[90]  G. Hunter,et al.  Comparison of self-reported with objectively assessed energy expenditure in black and white women before and after weight loss. , 2004, The American journal of clinical nutrition.

[91]  A. Manley Physical Activity And Health: A Report Of The Surgeon General , 2004 .

[92]  M. Costanza,et al.  Association of physical activity intensity levels with overweight and obesity in a population-based sample of adults. , 2004, Preventive medicine.

[93]  J. Hébert,et al.  The inappropriateness of conventional use of the correlation coefficient in assessing validity and reliability of dietary assessment methods , 1991, European Journal of Epidemiology.

[94]  Gladys Block,et al.  Activities Contributing to Total Energy Expenditure in the United States: Results from the NHAPS Study , 2004, The international journal of behavioral nutrition and physical activity.

[95]  S. Vesely,et al.  Stability and convergent validity of the Physical Activity Scale for the Elderly (PASE). , 2004, The Journal of sports medicine and physical fitness.

[96]  J. Levine,et al.  Role of nonexercise activity thermogenesis (NEAT) in obesity. , 2005, Minnesota medicine.

[97]  M. Clark,et al.  Interindividual Variation in Posture Allocation: Possible Role in Human Obesity , 2005, Science.

[98]  Ronir Raggio Luiz,et al.  More than one statistical strategy to assess agreement of quantitative measurements may usefully be reported. , 2005, Journal of clinical epidemiology.

[99]  A. McTiernan Cancer prevention and management through exercise and weight control , 2005 .

[100]  D. Schoeller,et al.  Relationship between blood pressure and physical activity assessed with stable isotopes , 2005, Journal of Human Hypertension.

[101]  Charles E Matthews,et al.  The effect of social desirability and social approval on self-reports of physical activity. , 2005, American journal of epidemiology.

[102]  Charlene Compher,et al.  Comparison of predictive equations for resting metabolic rate in healthy nonobese and obese adults: a systematic review. , 2005, Journal of the American Dietetic Association.

[103]  Thierry Troosters,et al.  How to assess physical activity? How to assess physical fitness? , 2005, European journal of cardiovascular prevention and rehabilitation : official journal of the European Society of Cardiology, Working Groups on Epidemiology & Prevention and Cardiac Rehabilitation and Exercise Physiology.

[104]  Mark A Hlatky,et al.  Practice of Epidemiology Validation of a New Brief Physical Activity Survey among Men and Women Aged 60 – 69 Years , 2006 .

[105]  R. Dellavalle,et al.  Inaccessible novel questionnaires in published medical research: hidden methods, hidden costs. , 2006, American journal of epidemiology.

[106]  James F Sallis,et al.  Comparative validation of the IPAQ and the 7-Day PAR among women diagnosed with breast cancer , 2006, The international journal of behavioral nutrition and physical activity.

[107]  Tamara B Harris,et al.  Daily activity energy expenditure and mortality among older adults. , 2006, JAMA.

[108]  Heather K. Neilson,et al.  Practice of Epidemiology Reliability and Validity of the Past Year Total Physical Activity Questionnaire , 2005 .

[109]  P. Taylor,et al.  Comparison of energy expenditure estimates from 4 physical activity questionnaires with doubly labeled water estimates in postmenopausal women. , 2006, The American journal of clinical nutrition.

[110]  K. Steindorf,et al.  Statistical Methods for the Validation of Questionnaires , 2006, Methods of Information in Medicine.

[111]  R. Iqbal,et al.  Validating MOSPA questionnaire for measuring physical activity in Pakistani women , 2006, Nutrition journal.

[112]  S. Blair,et al.  Objectively measured physical activity and mortality in older adults. , 2006, JAMA.

[113]  M. Bonnefoy,et al.  Validation of a physical activity questionnaire in the elderly , 2006, European Journal of Applied Physiology and Occupational Physiology.