A rapid review of meta-analyses and systematic reviews of environmental footprints of food commodities and diets

Abstract Systematic reviews, sometimes including meta-analyses, are often presented as an approach for identifying healthy and sustainable diets. Here we explore to which extent systematic review protocols have been adopted by studies comparing environmental impacts of foods based on Life Cycle Assessment (LCA) results, and to which extent they comply with the PRISMA protocol for transparent reporting. Out of 224 studies screened, seven explicitly define themselves as systematic reviews, and/or claim to carry out meta-analyses. Of these, only one acknowledges a review protocol, while none complies with all the PRISMA criteria. Neither do we believe that reviews of LCA results can comply with all the criteria or carry out meta-analyses, due to underreporting on standard deviations and artificial sample sizes in LCAs. Nonetheless, reviews of food commodities and diets based on LCA results would benefit from better aligning with criteria in systematic review protocols.

[1]  Emily Newman,et al.  PROSPERO International prospective register of systematic reviews , 2017 .

[2]  Sangwon Suh,et al.  Challenges in assessing the environmental consequences of dietary changes , 2016, Environment Systems and Decisions.

[3]  R. Kleijn,et al.  Evaluating European imports of Asian aquaculture products using statistically supported Life Cycle Assessments , 2009 .

[4]  J. Rockström,et al.  Rewiring food systems to enhance human health and biosphere stewardship , 2017 .

[5]  H. Handoll,et al.  Interventions for replacing missing teeth: different times for loading dental implants. , 2004, The Cochrane database of systematic reviews.

[6]  Reinout Heijungs,et al.  Measures of Difference and Significance in the Era of Computer Simulations, Meta-Analysis, and Big Data , 2016, Entropy.

[7]  Reinout Heijungs,et al.  LCA of second generation bioethanol: A review and some issues to be resolved for good LCA practice , 2012 .

[8]  R. Lau,et al.  Red and Processed Meat and Colorectal Cancer Incidence: Meta-Analysis of Prospective Studies , 2011, PloS one.

[9]  P. Scheelbeek,et al.  Climate change mitigation in food systems: the environmental and health impacts of shifting towards sustainable diets, a systematic review protocol , 2019, Wellcome open research.

[10]  R. Light,et al.  Summing Up: The Science of Reviewing Research. , 1986 .

[11]  David García,et al.  EATLancet vs yes2meat: the digital backlash to the planetary health diet , 2019, The Lancet.

[12]  Qingshi Tu,et al.  Harmonized algal biofuel life cycle assessment studies enable direct process train comparison , 2018, Applied Energy.

[13]  Maria Beatrice Pairotti,et al.  Energy consumption and GHG emission of the Mediterranean diet: a systemic assessment using a hybrid LCA-IO method , 2015 .

[14]  John J. Reap,et al.  A survey of unresolved problems in life cycle assessment , 2008 .

[15]  Reinout Heijungs,et al.  Allocation and 'what-if' scenarios in life cycle assessment of waste management systems. , 2007, Waste management.

[16]  F. Hu,et al.  Red and processed meat consumption and mortality: dose–response meta-analysis of prospective cohort studies , 2015, Public Health Nutrition.

[17]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[18]  G. Guyatt,et al.  Reduction of Red and Processed Meat Intake and Cancer Mortality and Incidence , 2019, Annals of Internal Medicine.

[19]  S. Carpenter,et al.  Planetary boundaries: Guiding human development on a changing planet , 2015, Science.

[20]  D. Showler,et al.  Collaboration for Environmental Evidence , 2010 .

[21]  H. Witzke,et al.  Greenhouse gas emission profiles of European livestock sectors , 2011 .

[22]  N. Wilson,et al.  Achieving Healthy and Sustainable Diets: A Review of the Results of Recent Mathematical Optimization Studies. , 2019, Advances in nutrition.

[23]  Karli Verghese,et al.  Systematic review of greenhouse gas emissions for different fresh food categories , 2017 .

[24]  Paul S. Fischbeck,et al.  Energy use, blue water footprint, and greenhouse gas emissions for current food consumption patterns and dietary recommendations in the US , 2016, Environment Systems and Decisions.

[25]  W. Willett,et al.  The Misuse of Meta-analysis in Nutrition Research. , 2017, JAMA.

[26]  A. Carlsson-kanyama,et al.  Environmental impact of dietary change: a systematic review , 2015 .

[27]  Janet E Squires,et al.  Systematic reviews of complex interventions: framing the review question. , 2013, Journal of clinical epidemiology.

[28]  M. Hall,et al.  Nutritional and greenhouse gas impacts of removing animals from US agriculture , 2017, Proceedings of the National Academy of Sciences.

[29]  F. Perez-Cueto,et al.  Which Diet Has the Least Environmental Impact on Our Planet? A Systematic Review of Vegan, Vegetarian and Omnivorous Diets , 2019, Sustainability.

[30]  D. Tilman,et al.  Comparative analysis of environmental impacts of agricultural production systems, agricultural input efficiency, and food choice , 2017 .

[31]  I. Olkin,et al.  Improving the Quality of Reports of Meta-Analyses of Randomised Controlled Trials: The QUOROM Statement , 2000, Oncology Research and Treatment.

[32]  G. Guyatt,et al.  Effect of Lower Versus Higher Red Meat Intake on Cardiometabolic and Cancer Outcomes , 2019, Annals of Internal Medicine.

[33]  Pascal Lesage,et al.  Empirically based uncertainty factors for the pedigree matrix in ecoinvent , 2016, The International Journal of Life Cycle Assessment.

[34]  A. Carroll,et al.  Meat Consumption and Health: Food for Thought , 2019, Annals of Internal Medicine.

[35]  Alan Pearson,et al.  The systematic review: an overview. , 2014, The American journal of nursing.

[36]  Reinout Heijungs,et al.  A protocol for horizontal averaging of unit process data—including estimates for uncertainty , 2014, The International Journal of Life Cycle Assessment.

[37]  David Moher,et al.  Evidence summaries: the evolution of a rapid review approach , 2012, Systematic Reviews.

[38]  Nicole Tichenor Blackstone,et al.  Systematic Review of Dietary Patterns and Sustainability in the United States , 2020, Advances in nutrition.

[39]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[40]  Brandon Kuczenski,et al.  False confidence: are we ignoring significant sources of uncertainty? , 2019, The International Journal of Life Cycle Assessment.

[41]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation , 2015, BMJ : British Medical Journal.

[42]  G. Guyatt,et al.  Red and Processed Meat Consumption and Risk for All-Cause Mortality and Cardiometabolic Outcomes , 2019, Annals of Internal Medicine.

[43]  Raj Patel,et al.  Feeding ten billion , 2012 .

[44]  S. Cucurachi,et al.  Are Technological Developments Improving the Environmental Sustainability of Photovoltaic Electricity? , 2020, Energy Technology.

[45]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[46]  Reinout Heijungs,et al.  On the number of Monte Carlo runs in comparative probabilistic LCA , 2019, The International Journal of Life Cycle Assessment.

[47]  Susan E. Lee,et al.  EATS: a life cycle-based decision support tool for local authorities and school caterers , 2019, The International Journal of Life Cycle Assessment.

[48]  Nathan Pelletier,et al.  Comparing sources and analysis of uncertainty in consequential and attributional life cycle assessment: review of current practice and recommendations , 2020, The International Journal of Life Cycle Assessment.

[49]  Scott Duncan,et al.  A survey of unresolved problems in life cycle assessment , 2008 .

[50]  G. Keoleian,et al.  Greenhouse Gas Emission Estimates of U.S. Dietary Choices and Food Loss , 2015 .

[51]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[52]  Kath Wright,et al.  PTSD in prison settings: A systematic review and meta-analysis of comorbid mental disorders and problematic behaviours , 2019, PloS one.

[53]  Reid Lifset,et al.  Toward Meta‐Analysis in Life Cycle Assessment , 2012 .

[54]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement , 2015, Systematic Reviews.

[55]  D. Tranfield,et al.  Producing a systematic review. , 2009 .

[56]  Joyce Smith Cooper,et al.  Systematic Review Checklist , 2012 .

[57]  C. Mulrow.  The medical review article: state of the science. , 1987, Annals of internal medicine.

[58]  Fabio Menten,et al.  A review of LCA greenhouse gas emissions results for advanced biofuels: The use of meta-regression analysis , 2013 .

[59]  D. Moher,et al.  A scoping review of rapid review methods , 2015, BMC Medicine.

[60]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[61]  S. Larsson,et al.  Systematic Reviews and Meta- and Pooled Analyses Red Meat and Processed Meat Consumption and All-Cause Mortality: A Meta-Analysis , 2014 .

[62]  G. Guyatt,et al.  Unprocessed Red Meat and Processed Meat Consumption: Dietary Guideline Recommendations From the Nutritional Recommendations (NutriRECS) Consortium , 2019, Annals of Internal Medicine.

[63]  D. Moher,et al.  The nuts and bolts of PROSPERO: an international prospective register of systematic reviews , 2012, Systematic Reviews.

[64]  E. Mohareb,et al.  Cities’ Role in Mitigating United States Food System Greenhouse Gas Emissions , 2018, Environmental science & technology.

[65]  William R. Shadish,et al.  Combining estimates of effect size. , 1994 .

[66]  W. Willett,et al.  Food in the Anthropocene: the EAT–Lancet Commission on healthy diets from sustainable food systems , 2019, The Lancet.

[67]  Ashley Green,et al.  A Systematic Review of the Measurement of Sustainable Diets. , 2016, Advances in nutrition.

[68]  E. Hertwich,et al.  Climate policy through changing consumption choices: Options and obstacles for reducing greenhouse gas emissions , 2014 .

[69]  M. Kummu,et al.  Feeding ten billion people is possible within four terrestrial planetary boundaries , 2020, Nature Sustainability.

[70]  G. Guyatt,et al.  Patterns of Red and Processed Meat Consumption and Risk for Cardiometabolic and Cancer Outcomes , 2019, Annals of Internal Medicine.

[71]  H. van Marwijk,et al.  Pharmacological interventions for somatoform disorders in adults. , 2014, The Cochrane database of systematic reviews.

[72]  Pete Smith,et al.  The Impacts of Dietary Change on Greenhouse Gas Emissions, Land Use, Water Use, and Health: A Systematic Review , 2016, PloS one.