Low-calorie sweeteners and health outcomes: A demonstration of rapid evidence mapping (rEM).

BACKGROUND "Evidence Mapping" is an emerging tool that is increasingly being used to systematically identify, review, organize, quantify, and summarize the literature. It can be used as an effective method for identifying well-studied topic areas relevant to a broad research question along with any important literature gaps. However, because the procedure can be significantly resource-intensive, approaches that can increase the speed and reproducibility of evidence mapping are in great demand. METHODS We propose an alternative process called "rapid Evidence Mapping" (rEM) to map the scientific evidence in a time-efficient manner, while still utilizing rigorous, transparent and explicit methodological approaches. To illustrate its application, we have conducted a proof-of-concept case study on the topic of low-calorie sweeteners (LCS) with respect to human dietary exposures and health outcomes. During this process, we developed and made publicly available our study protocol, established a PECO (Participants, Exposure, Comparator, and Outcomes) statement, searched the literature, screened titles and abstracts to identify potentially relevant studies, and applied semi-automated machine learning approaches to tag and categorize the included articles. We created various visualizations including bubble plots and frequency tables to map the evidence and research gaps according to comparison type, population baseline health status, outcome group, and study sample size. We compared our results with a traditional evidence mapping of the same topic published in 2016 (Wang et al., 2016). RESULTS We conducted an rEM of LCS, for which we identified 8122 records from a PubMed search (January 1, 1946-May 1, 2014) and then utilized machine learning (SWIFT-Active Screener) to prioritize relevant records. After screening 2267 (28%) of the total set of titles and abstracts to achieve 95% estimated recall, we ultimately included 297 relevant studies. Overall, our findings corroborated those of Wang et al. (2016) and identified that most studies were acute or short-term in healthy individuals, and studied the outcomes of appetite, energy sensing and body weight. We also identified a lack of studies assessing appetite and dietary intake related outcomes in people with diabetes. The rEM approach required approximately 100 person-hours conducted over 7 calendar months. CONCLUSION Rapid Evidence Mapping is an expeditious approach based on rigorous methodology that can be used to quickly summarize the available body of evidence relevant to a research question, identify gaps in the literature to inform future research, and contextualize the design of a systematic review within the broader scientific literature, significantly reducing human effort while yielding results comparable to those from traditional methods. The potential time savings of this approach in comparison to the traditional evidence mapping process make it a potentially powerful tool for rapidly translating knowledge to inform science-based decision-making.

[1]  Neal R. Haddaway,et al.  A methodology for systematic mapping in environmental sciences , 2016, Environmental Evidence.

[2]  Carla E. Brodley,et al.  Deploying an interactive machine learning system in an evidence-based practice center: abstrackr , 2012, IHI '12.

[3]  Patrice Sutton,et al.  An evidence-based medicine methodology to bridge the gap between clinical and environmental health sciences. , 2011, Health affairs.

[4]  Gábor L. Lövei,et al.  Application of Systematic Review Methodology to Food and Feed Safety Assessments to Support Decision Making , 2010 .

[5]  Maria J Grant,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[6]  David Moher,et al.  Evidence summaries: the evolution of a rapid review approach , 2012, Systematic Reviews.

[7]  Brian E. Howard,et al.  SWIFT-Review: a text-mining workbench for systematic review , 2016, Systematic Reviews.

[8]  D. Gough,et al.  Clarifying differences between review designs and methods , 2012, Systematic Reviews.

[9]  J. Scott Parrott,et al.  Creating a literature database of low-calorie sweeteners and health studies: evidence mapping , 2016, BMC Medical Research Methodology.

[10]  Paul Glasziou,et al.  Faster title and abstract screening? Evaluating Abstrackr, a semi-automated online screening program for systematic reviewers , 2015, Systematic Reviews.

[11]  Ruth Garside,et al.  Sustainability: Map the evidence , 2015, Nature.

[12]  Steven Duffy,et al.  Supplementary searches of PubMed to improve currency of MEDLINE and MEDLINE In-Process searches via Ovid. , 2017, Journal of the Medical Library Association : JMLA.

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  Susanne Hempel,et al.  What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products , 2016, Systematic Reviews.

[15]  D. Moher,et al.  Scoping reviews: time for clarity in definition, methods, and reporting. , 2014, Journal of clinical epidemiology.

[16]  Emma Tavender,et al.  The Global Evidence Mapping Initiative: Scoping research in broad topic areas , 2011, BMC medical research methodology.

[17]  Martijn J. Schuemie,et al.  Distribution of information in biomedical abstracts and full-text publications , 2004, Bioinform..

[18]  John R. Bucher,et al.  Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments , 2014, Environmental health perspectives.

[19]  Ethan M Balk,et al.  A Web-based archive of systematic review data , 2012, Systematic Reviews.

[20]  Donna Ciliska,et al.  Expediting systematic reviews: methods and implications of rapid reviews , 2010, Implementation science : IS.