Bias in dietary-report instruments and its implications for nutritional epidemiology

Abstract Objective: To evaluate measurement error structure in dietary assessment instruments and to investigate its implications for nutritional studies, using urinary nitrogen excretion as a reference biomarker for protein intake. Design: The dietary assessment methods included different food-frequency questionnaires (FFQs) and such conventional dietary-report reference instruments as a series of 24-hour recalls, 4-day weighed food records or 7-day diaries. Setting: Six original pilot validation studies within the European Prospective Investigation of Cancer (EPIC), and two validation studies conducted by the British Medical Research Council (MRC) within the Norfolk cohort that later joined as a collaborative component cohort of EPIC. Subjects: A sample of approximately 100 to 200 women and men, aged 35–74 years, from each of eight validation studies. Results: In assessing protein intake, all conventional dietary-report reference methods violated the critical requirements for a valid reference instrument for evaluating, and adjusting for, dietary measurement error in an FFQ. They displayed systematic bias that depended partly on true intake and partly was person-specific, correlated with person-specific bias in the FFQ. Using the dietary-report methods as reference instruments produced substantial overestimation (up to 230%) of the FFQ correlation with true usual intake and serious underestimation (up to 240%) of the degree of attenuation of FFQ-based log relative risks. Conclusion: The impact of measurement error in dietary assessment instruments on the design, analysis and interpretation of nutritional studies may be much greater than has been previously estimated, at least regarding protein intake.

[1]  M. Tarnopolsky,et al.  Evaluation of protein requirements for trained strength athletes. , 1992, Journal of applied physiology.

[2]  P. Corey,et al.  Sources of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation. , 1979, The American journal of clinical nutrition.

[3]  M. Singer,et al.  Nutritional Epidemiology , 2020, Definitions.

[4]  M. Livingstone,et al.  Accuracy of weighed dietary records in studies of diet and health. , 1990, BMJ.

[5]  L S Freedman,et al.  The impact of dietary measurement error on planning sample size required in a cohort study. , 1990, American journal of epidemiology.

[6]  D. Ruppert,et al.  Measurement Error in Nonlinear Models , 1995 .

[7]  Ames,et al.  Cohort studies of fat intake and the risk of breast cancer--a pooled analysis. , 2000 .

[8]  J. Freudenheim,et al.  The problem of profound mismeasurement and the power of epidemiological studies of diet and cancer. , 1988, Nutrition and cancer.

[9]  R J Carroll,et al.  Empirical evidence of correlated biases in dietary assessment instruments and its implications. , 2001, American journal of epidemiology.

[10]  D. Calloway,et al.  Nitrogen balance of men fed amino acid mixtures based on Rose's requirements, egg white protein, and serum free amino acid patterns. , 1971, The Journal of nutrition.

[11]  M. Lawson,et al.  Nitrogen balance studies in apparently healthy elderly people and those who are housebound , 1987, British Journal of Nutrition.

[12]  W. Willett,et al.  Interval estimates for correlation coefficients corrected for within-person variation: implications for study design and hypothesis testing. , 1988, American journal of epidemiology.

[13]  A A Tsiatis,et al.  The impact that group sequential tests would have made on ECOG clinical trials. , 1989, Statistics in medicine.

[14]  M. C. Crim,et al.  Increased protein requirements in elderly people: new data and retrospective reassessments. , 1994, The American journal of clinical nutrition.

[15]  D A Schoeller,et al.  Validity of reported energy intake in obese and nonobese adolescents. , 1990, The American journal of clinical nutrition.

[16]  D. Calloway,et al.  Protein requirements of elderly men. , 1979, The Journal of nutrition.

[17]  W. Rand,et al.  A long-term metabolic balance study in young men to assess the nutritional quality of an isolated soy protein and beef proteins. , 1984, The American journal of clinical nutrition.

[18]  Maurice E. Shils,et al.  Modern Nutrition in Health and Disease , 1965, Diabetes.

[19]  E Riboli,et al.  Calibration of dietary intake measurements in prospective cohort studies. , 1995, American journal of epidemiology.

[20]  R. Prentice,et al.  Measurement error and results from analytic epidemiology: dietary fat and breast cancer. , 1996, Journal of the National Cancer Institute.

[21]  M. C. Crim,et al.  Elderly women accommodate to a low-protein diet with losses of body cell mass, muscle function, and immune response. , 1995, The American journal of clinical nutrition.

[22]  C. Chichester,et al.  Comparative nitrogen balance study between young and aged adults using three levels of protein intake from a combination wheat-soy-milk mixture. , 1978, The American journal of clinical nutrition.

[23]  L. Lissner,et al.  Dietary underreporting by obese individuals--is it specific or non-specific? , 1995, BMJ.

[24]  W. Coward,et al.  Validation of dietary intakes of protein and energy against 24 hour urinary N and DLW energy expenditure in middle-aged women, retired men and post-obese subjects: comparisons with validation against presumed energy requirements , 1997, European Journal of Clinical Nutrition.

[25]  N F Boyd,et al.  Comparison of energy intakes determined by food records and doubly labeled water in women participating in a dietary-intervention trial. , 1996, The American journal of clinical nutrition.

[26]  C. W. Wrigley,et al.  Proteins and amino acids , 1988 .

[27]  W. Willett,et al.  Dietary fiber and the risk of colorectal cancer and adenoma in women. , 1999, The New England journal of medicine.

[28]  W. Rand,et al.  Retrospective analysis of data from five long-term, metabolic balance studies: implications for understanding dietary nitrogen and energy utilization. , 1985, The American journal of clinical nutrition.

[29]  B. Caballero,et al.  PROTEINS and amino acids. , 1945, American professional pharmacist.

[30]  N. Day,et al.  EPIC-Norfolk: study design and characteristics of the cohort. European Prospective Investigation of Cancer. , 1999, British journal of cancer.

[31]  G E Dallal,et al.  Evaluation of four methods for determining energy intake in young and older women: comparison with doubly labeled water measurements of total energy expenditure. , 1996, The American journal of clinical nutrition.

[32]  N E Day,et al.  Validation of dietary assessment methods in the UK arm of EPIC using weighed records, and 24-hour urinary nitrogen and potassium and serum vitamin C and carotenoids as biomarkers. , 1997, International journal of epidemiology.

[33]  R. Kaaks,et al.  Biochemical markers as additional measurements in studies of the accuracy of dietary questionnaire measurements: conceptual issues. , 1997, The American journal of clinical nutrition.

[34]  K. Westerterp,et al.  Effect of protein source and quantity on protein metabolism in elderly women. , 1998, The American journal of clinical nutrition.

[35]  S. Margen,et al.  Nitrogen balance studies in humans: long-term effect of high nitrogen intake on nitrogen accretion. , 1979, The Journal of nutrition.

[36]  B. Heitmann.  The influence of fatness, weight change, slimming history and other lifestyle variables on diet reporting in Danish men and women aged 35-65 years. , 1993, International journal of obesity and related metabolic disorders : journal of the International Association for the Study of Obesity.

[37]  R. Uauy,et al.  Human protein requirements: nitrogen balance response to graded levels of egg protein in elderly men and women. , 1978, The American journal of clinical nutrition.

[38]  S A Bingham,et al.  Urine nitrogen as an independent validatory measure of dietary intake: a study of nitrogen balance in individuals consuming their normal diet. , 1985, The American journal of clinical nutrition.

[39]  R J Carroll,et al.  Estimating the relation between dietary intake obtained from a food frequency questionnaire and true average intake. , 1991, American journal of epidemiology.

[40]  R J Carroll,et al.  Implications of a new dietary measurement error model for estimation of relative risk: application to four calibration studies. , 1999, American journal of epidemiology.

[41]  N Slimani,et al.  Pilot phase studies on the accuracy of dietary intake measurements in the EPIC project: overall evaluation of results. European Prospective Investigation into Cancer and Nutrition. , 1997, International journal of epidemiology.

[42]  B Rosner,et al.  Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. , 2006, Statistics in medicine.

[43]  W. Willett,et al.  Prospective study of fruit and vegetable consumption and incidence of colon and rectal cancers. , 2000, Journal of the National Cancer Institute.

[44]  T. Atinmo,et al.  Nitrogen balance study in young Nigerian adult males using four levels of protein intake , 1988, British Journal of Nutrition.