Using and improving distributed data networks to generate actionable evidence: the case of real-world outcomes in the Food and Drug Administration's Sentinel system

The US Food and Drug Administration (FDA) Sentinel System uses a distributed data network, a common data model, curated real-world data, and distributed analytic tools to generate evidence for FDA decision-making. Sentinel system needs include analytic flexibility, transparency, and reproducibility while protecting patient privacy. Based on over a decade of experience, a critical system limitation is the inability to identify enough medical conditions of interest in observational data to a satisfactory level of accuracy. Improving the system's ability to use computable phenotypes will require an "all of the above" approach that improves use of electronic health data while incorporating the growing array of complementary electronic health record data sources. FDA recently funded a Sentinel System Innovation Center and a Community Building and Outreach Center that will provide a platform for collaboration across disciplines to promote better use of real-world data for decision-making.

[1]  Richard Platt,et al.  Design of a National Distributed Health Data Network , 2009, Annals of Internal Medicine.

[2]  R. Platt,et al.  Distributed Health Data Networks: A Practical and Preferred Approach to Multi-Institutional Evaluations of Comparative Effectiveness, Safety, and Quality of Care , 2010, Medical care.

[3]  R. Platt,et al.  Developing the Sentinel System--a national resource for evidence development. , 2011, The New England journal of medicine.

[4]  McGinnis Jm,et al.  Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care: Workshop Series Summary , 2011 .

[5]  A. Levy,et al.  CNODES: the Canadian Network for Observational Drug Effect Studies , 2012, Open medicine : a peer-reviewed, independent, open-access journal.

[6]  Marsha A Raebel,et al.  Design considerations, architecture, and use of the Mini‐Sentinel distributed data system , 2012, Pharmacoepidemiology and drug safety.

[7]  Patrick B. Ryan,et al.  Validation of a common data model for active safety surveillance research , 2012, J. Am. Medical Informatics Assoc..

[8]  Richard Platt,et al.  The U.S. Food and Drug Administration's Mini‐Sentinel program: status and direction , 2012, Pharmacoepidemiology and drug safety.

[9]  Marius Fieschi,et al.  Harmonization process for the identification of medical events in eight European healthcare databases: the experience from the EU-ADR project , 2013, J. Am. Medical Informatics Assoc..

[10]  Andrew Bate,et al.  An Evaluation of the THIN Database in the OMOP Common Data Model for Active Drug Safety Surveillance , 2013, Drug Safety.

[11]  Melissa A. Basford,et al.  Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[12]  Richard Platt,et al.  Four health data networks illustrate the potential for a shared national multipurpose big-data network. , 2014, Health affairs.

[13]  Richard Platt,et al.  Launching PCORnet, a national patient-centered clinical research network , 2014, Journal of the American Medical Informatics Association : JAMIA.

[14]  J. Lei,et al.  Combining multiple healthcare databases for postmarketing drug and vaccine safety surveillance: why and how? , 2014, Journal of internal medicine.

[15]  Vivienne J. Zhu,et al.  Feasibility and utility of applications of the common data model to multiple, disparate observational health databases , 2015, J. Am. Medical Informatics Assoc..

[16]  William W. Stead,et al.  Toward a science of learning systems: a research agenda for the high-functioning Learning Health System , 2014, J. Am. Medical Informatics Assoc..

[17]  Andrew Bate,et al.  A Comparative Assessment of Observational Medical Outcomes Partnership and Mini-Sentinel Common Data Models and Analytics: Implications for Active Drug Safety Surveillance , 2015, Drug Safety.

[18]  Kevin Haynes,et al.  Identifying health outcomes in healthcare databases , 2015, Pharmacoepidemiology and drug safety.

[19]  Marsha A Raebel,et al.  Utilizing data consortia to monitor safety and effectiveness of biosimilars and their innovator products. , 2015, Journal of managed care & specialty pharmacy.

[20]  Nigam H. Shah,et al.  Learning statistical models of phenotypes using noisy labeled training data , 2016, J. Am. Medical Informatics Assoc..

[21]  R. Califf,et al.  Real-World Evidence - What Is It and What Can It Tell Us? , 2016, The New England journal of medicine.

[22]  Edoardo Vacchi,et al.  Data Extraction and Management in Networks of Observational Health Care Databases for Scientific Research: A Comparison of EU-ADR, OMOP, Mini-Sentinel and MATRICE Strategies , 2016, EGEMS.

[23]  S. Anderson,et al.  The FDA's sentinel initiative—A comprehensive approach to medical product surveillance , 2016, Clinical pharmacology and therapeutics.

[24]  Sengwee Toh,et al.  Early impact of the ICD‐10‐CM transition on selected health outcomes in 13 electronic health care databases in the United States , 2018, Pharmacoepidemiology and drug safety.

[25]  Jacqueline Corrigan-Curay,et al.  Real-World Evidence and Real-World Data for Evaluating Drug Safety and Effectiveness. , 2018, JAMA.

[26]  Taxiarchis Botsis,et al.  Evaluating automated approaches to anaphylaxis case classification using unstructured data from the FDA Sentinel System , 2018, Pharmacoepidemiology and drug safety.

[27]  Sudha R. Raman,et al.  Cancer Screening Results and Follow-up Using Routinely Collected Electronic Health Data: Estimates for Breast, Colon, and Cervical Cancer Screenings , 2018, Journal of General Internal Medicine.

[28]  George Hripcsak,et al.  Effect of vocabulary mapping for conditions on phenotype cohorts , 2018, J. Am. Medical Informatics Assoc..

[29]  Richard Platt,et al.  The FDA Sentinel Initiative - An Evolving National Resource. , 2018, The New England journal of medicine.

[30]  Sebastian Schneeweiss,et al.  Choosing Among Common Data Models for Real‐World Data Analyses Fit for Making Decisions About the Effectiveness of Medical Products , 2020, Clinical pharmacology and therapeutics.

[31]  Mia Gallagher,et al.  Validity of Privacy-Protecting Analytical Methods That Use Only Aggregate-Level Information to Conduct Multivariable-Adjusted Analysis in Distributed Data Networks , 2018, American journal of epidemiology.

[32]  Jeffrey R Curtis,et al.  Mapping from the International Classification of Diseases (ICD) 9th to 10th Revision for Research in Biologics and Biosimilars Using Administrative Healthcare Data , 2019, Pharmacoepidemiology and drug safety.