Is everything we eat associated with cancer? A systematic cookbook review.

BACKGROUND Nutritional epidemiology is a highly prolific field. Debates on associations of nutrients with disease risk are common in the literature and attract attention in public media. OBJECTIVE We aimed to examine the conclusions, statistical significance, and reproducibility in the literature on associations between specific foods and cancer risk. DESIGN We selected 50 common ingredients from random recipes in a cookbook. PubMed queries identified recent studies that evaluated the relation of each ingredient to cancer risk. Information regarding author conclusions and relevant effect estimates were extracted. When >10 articles were found, we focused on the 10 most recent articles. RESULTS Forty ingredients (80%) had articles reporting on their cancer risk. Of 264 single-study assessments, 191 (72%) concluded that the tested food was associated with an increased (n = 103) or a decreased (n = 88) risk; 75% of the risk estimates had weak (0.05 > P ≥ 0.001) or no statistical (P > 0.05) significance. Statistically significant results were more likely than nonsignificant findings to be published in the study abstract than in only the full text (P < 0.0001). Meta-analyses (n = 36) presented more conservative results; only 13 (26%) reported an increased (n = 4) or a decreased (n = 9) risk (6 had more than weak statistical support). The median RRs (IQRs) for studies that concluded an increased or a decreased risk were 2.20 (1.60, 3.44) and 0.52 (0.39, 0.66), respectively. The RRs from the meta-analyses were on average null (median: 0.96; IQR: 0.85, 1.10). CONCLUSIONS Associations with cancer risk or benefits have been claimed for most food ingredients. Many single studies highlight implausibly large effects, even though evidence is weak. Effect sizes shrink in meta-analyses.

[1]  I. Macdonald.  Nonsense and non-science in nutrition , 1983, Proceedings of the Nutrition Society.

[2]  M. Carroll,et al.  Nutrient sources in the American diet: quantitative data from the NHANES II survey. I. Vitamins and minerals. , 1985, American journal of epidemiology.

[3]  M. Carroll,et al.  Nutrient sources in the American diet: quantitative data from the NHANES II survey. II. Macronutrients and fats. , 1985, American journal of epidemiology.

[4]  A R Feinstein,et al.  A collection of 56 topics with contradictory results in case-control research. , 1988, International journal of epidemiology.

[5]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[6]  G. Taubes.  Epidemiology faces its limits. , 1995, Science.

[7]  G. Omenn,et al.  Effects of a combination of beta carotene and vitamin A on lung cancer and cardiovascular disease. , 1996, The New England journal of medicine.

[8]  J. Vogels,et al.  Effect of short-term dietary administration of eugenol in humans , 1996, Human & experimental toxicology.

[9]  G. Smith,et al.  Meta-analysis Spurious precision? Meta-analysis of observational studies , 1998, BMJ.

[10]  P. Davis,et al.  Whole almonds and almond fractions reduce aberrant crypt foci in a rat model of colon carcinogenesis. , 2001, Cancer letters.

[11]  Jonathan A C Sterne,et al.  Sifting the evidence—what's wrong with significance tests? , 2001, BMJ : British Medical Journal.

[12]  J. Sterne,et al.  What is newsworthy? Longitudinal study of the reporting of medical research in two British newspapers , 2002, BMJ : British Medical Journal.

[13]  A. MØller,et al.  Publication bias in ecology and evolution: an empirical assessment using the ‘trim and fill’ method , 2002, Biological reviews of the Cambridge Philosophical Society.

[14]  J. Mann.  Discrepancies in nutritional recommendations: the need for evidence based nutrition. , 2002, Asia Pacific journal of clinical nutrition.

[15]  D. Bender,et al.  Vitamins and Minerals , 2003 .

[16]  R. Hayes,et al.  Alcohol concentration and risk of oral cancer in Puerto Rico. , 2003, American journal of epidemiology.

[17]  Rachel Churchill,et al.  Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. , 2004, Journal of clinical epidemiology.

[18]  Zuo-Feng Zhang,et al.  Allium vegetables and stomach cancer risk in China. , 2005, Asian Pacific journal of cancer prevention : APJCP.

[19]  J. Ioannidis.  Contradicted and Initially Stronger Effects in Highly Cited Clinical Research , 2005 .

[20]  G. Ursin,et al.  Dietary Risk Factors for Ovarian Cancer: The Adventist Health Study (United States) , 2006, Cancer Causes & Control.

[21]  M. Thun,et al.  Low-dose aspirin and vitamin E: challenges and opportunities in cancer prevention. , 2005, JAMA.

[22]  John P A Ioannidis,et al.  Selective reporting biases in cancer prognostic factor studies. , 2005, Journal of the National Cancer Institute.

[23]  Sarmistha Banerjee,et al.  Clove (Syzygium aromaticum L.), a potential chemopreventive agent for lung cancer. , 2005, Carcinogenesis.

[24]  P. Loehrer.  Vitamin E in the Primary Prevention of Cardiovascular Disease and Cancer: The Women's Health Study: A Randomized Controlled Trial , 2006 .

[25]  M. Thun,et al.  American Cancer Society Guidelines on Nutrition and Physical Activity for Cancer Prevention: Reducing the Risk of Cancer With Healthy Food Choices and Physical Activity , 2002, CA: a cancer journal for clinicians.

[26]  George Liberopoulos,et al.  Selection in Reported Epidemiological Risks: An Empirical Assessment , 2007, PLoS medicine.

[27]  J. Ioannidis,et al.  Persistence of contradicted claims in the literature. , 2007, JAMA.

[28]  Brian C. Martinson,et al.  The Perverse Effects of Competition on Scientists’ Work and Relationships , 2007, Sci. Eng. Ethics.

[29]  E. Riboli,et al.  The second expert report, Food, Nutrition, Physical Activity and the Prevention of Cancer: A Global Perspective , 2007 .

[30]  John P A Ioannidis,et al.  Almost all articles on cancer prognostic markers report statistically significant results. , 2007, European journal of cancer.

[31]  J. Ioannidis.  Why Most Discovered True Associations Are Inflated , 2008, Epidemiology.

[32]  J. Brooks.  Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[33]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[34]  John P A Ioannidis,et al.  Effect of formal statistical significance on the credibility of observational associations. , 2008, American journal of epidemiology.

[35]  P. Gann.  Randomized trials of antioxidant supplementation for cancer prevention: first bias, now chance--next, cause. , 2009, JAMA.

[36]  J. Manson,et al.  Vitamins E and C in the prevention of prostate and total cancer in men: the Physicians' Health Study II randomized controlled trial. , 2009, JAMA.

[37]  L. S. Yazan,et al.  Apoptosis and cell cycle arrest of human colorectal cancer cell line HT-29 induced by vanillin. , 2009, Cancer epidemiology.

[38]  K. Brownell,et al.  The perils of ignoring history: Big Tobacco played dirty and millions died. How similar is Big Food? , 2009, The Milbank quarterly.

[39]  D. Burr,et al.  Food groups and renal cell carcinoma: results from a case-control study. , 2009, Journal of the American Dietetic Association.

[40]  D. Alexander,et al.  Quantitative assessment of red meat or processed meat consumption and kidney cancer. , 2009, Cancer detection and prevention.

[41]  D. Fanelli.  Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data , 2010, PloS one.

[42]  M. Stampfer,et al.  Evidence-based criteria in the nutritional context. , 2010, Nutrition reviews.

[43]  David B Allison,et al.  White Hat Bias: Examples of its Presence in Obesity Research and a Call for Renewed Commitment to Faithfulness in Research Reporting , 2009, International Journal of Obesity.

[44]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[45]  M. Baliga,et al.  Update on the Chemopreventive Effects of Ginger and its Phytochemicals , 2011, Critical reviews in food science and nutrition.

[46]  F. Prinz,et al.  Believe it or not: how much can we rely on published data on potential drug targets? , 2011, Nature Reviews Drug Discovery.

[47]  Leonard A Stefanski,et al.  P-Value Precision and Reproducibility , 2011, The American statistician.

[48]  T. Efferth,et al.  Cytotoxicity of Thymus vulgaris essential oil towards human oral cavity squamous cell carcinoma. , 2011, Anticancer research.

[49]  F. Clavel-Chapelon,et al.  Alcohol consumption and gastric cancer risk in the European Prospective Investigation into Cancer and Nutrition (EPIC) cohort. , 2011, The American journal of clinical nutrition.

[50]  J. Crowley,et al.  Vitamin E and the Risk of Prostate Cancer The Selenium and Vitamin E Cancer Prevention Trial ( SELECT ) , 2011 .

[51]  D. Alexander,et al.  Meta‐Analysis of Prospective Studies of Red Meat Consumption and Colorectal Cancer , 2010, European journal of cancer prevention : the official journal of the European Cancer Prevention Organisation.

[52]  M. Inoue,et al.  Green tea and coffee consumption and its association with thyroid cancer risk: a population-based cohort study in Japan , 2011, Cancer Causes & Control.

[53]  P. Walsh.  Re: vitamin E and the risk of prostate cancer: the Selenium and Vitamin E Cancer Prevention Trial (SELECT). , 2012, The Journal of urology.

[54]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[55]  T. Byers,et al.  Dietary supplements and cancer prevention: balancing potential benefits against proven harms. , 2012, Journal of the National Cancer Institute.

[56]  J. Ioannidis.  The importance of potential studies that have not existed and registration of observational data sets. , 2012, JAMA.

[57]  M. Thun,et al.  American Cancer Society guidelines on nutrition and physical activity for cancer prevention , 2002, CA: a cancer journal for clinicians.

[58]  I. Thompson,et al.  Vitamin E supplementation increased risk for prostate cancer in healthy men at a median of 7 years , 2012 .

[59]  J. Ioannidis.  Why Most Published Research Findings Are False , 2019, CHANCE.