Robust Preclinical Evidence in Somatic Cell Genome Editing: A Key Driver of Responsible and Efficient Therapeutic Innovations

Somatic cell genome editing (SCGE) is highly promising for therapeutic innovation. Multifold financial and academic incentives exist for the quickest possible translation from preclinical to clinical studies. This study demonstrates that the majority of 46 preclinical SCGE studies discussed in expert reviews as particularly promising for clinical translation do not report on seven key elements for robust and confirmatory research practices: (1) randomization, (2) blinding, (3) sample size calculation, (4) data handling, (5) pre-registration, (6) multi-centric study design, and (7) independent confirmation. Against the background of the high incentives for clinical translation and recent concerns about the reproducibility of published preclinical evidence, we present the here examined reporting standards (1-4) and the new NIH funding criteria for SCGE research (6-7) as a viable solution to protect this promising field from backlashes. We argue that the implementation of the novel methodological standards, e.g. “confirmation” and “pre-registration”, is promising for preclinical SCGE research and provides an opportunity to become a lighthouse example for trust-worthy and useful translational research.

[1]  James A. Anderson,et al.  Should preclinical studies be registered? , 2012, Nature Biotechnology.

[2]  D. Strech,et al.  Animal Study Registries: Results from a Stakeholder Analysis on Potential Strengths, Weaknesses, Facilitators, and Barriers , 2016, PLoS biology.

[3]  K. Peggs,et al.  First Clinical Application of Talen Engineered Universal CAR19 T Cells in B-ALL , 2015 .

[4]  Carole Federico,et al.  Consider drug efficacy before first-in-human trials , 2017, Nature.

[5]  Gillian L. Currie,et al.  Risk of Bias in Reports of In Vivo Research: A Focus for Improvement , 2015, PLoS biology.

[6]  M. Macleod,et al.  Emulating Multicentre Clinical Stroke Trials: A New Paradigm for Studying Novel Interventions in Experimental Models of Stroke , 2009, International journal of stroke : official journal of the International Stroke Society.

[7]  C. Nathues,et al.  Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor , 2016, PLoS biology.

[8]  R Rainey Focus on improvement. , 1993, Executive housekeeping today.

[9]  J. Kimmelman Gene Transfer and the Ethics of First-in-Human Research: Lost in Translation , 2009 .

[10]  Arthur Liesz,et al.  The next step in translational research: lessons learned from the first preclinical randomized controlled trial , 2016, Journal of neurochemistry.

[11]  C. Glenn Begley,et al.  Raise standards for preclinical cancer research , 2012 .

[12]  D. Ekwueme,et al.  Cost Analysis of Screening for, Diagnosing, and Staging Prostate Cancer Based on a Systematic Review of Published Studies , 2007, Preventing chronic disease.

[13]  C. Sheridan Go-ahead for first in-body CRISPR medicine testing , 2018 .

[14]  M. Baker Animal registries aim to reduce bias , 2019, Nature.

[15]  Kevin Esvelt,et al.  Gene editing can drive science to openness , 2016, Nature.

[16]  Marlies Leenaars,et al.  Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions , 2012, PloS one.

[17]  Announcement: Transparency upgrade for Nature journals , 2017, Nature.

[18]  F. Prinz,et al.  Believe it or not: how much can we rely on published data on potential drug targets? , 2011, Nature Reviews Drug Discovery.

[19]  E. Rebar,et al.  Genome editing with engineered zinc finger nucleases , 2010, Nature Reviews Genetics.

[20]  George M. Church,et al.  Safeguarding gene drive experiments in the laboratory , 2015, Science.

[21]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[22]  M. Greiner,et al.  Refining animal research: The Animal Study Registry , 2019, PLoS biology.

[23]  Claudio Mussolino,et al.  Refining strategies to translate genome editing to the clinic , 2017, Nature Medicine.

[24]  Carlijn R Hooijmans,et al.  Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed , 2010, Laboratory animals.

[25]  Malcolm Macleod,et al.  Reproducibility and Rigor in Animal-Based Research , 2019, ILAR journal.

[26]  I. Cuthill,et al.  Reporting : The ARRIVE Guidelines for Reporting Animal Research , 2010 .

[27]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[28]  T. Caulfield,et al.  CRISPR in the North American popular press , 2019, Genetics in Medicine.

[29]  Alvaro G Moreira,et al.  Mesenchymal stem cells for sensorineural hearing loss: protocol for a systematic review of preclinical studies , 2019, Systematic Reviews.

[30]  I. Cuthill,et al.  Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research † , 2012, Osteoarthritis and Cartilage.

[31]  David R. Liu,et al.  Search-and-replace genome editing without double-strand breaks or donor DNA , 2019, Nature.

[32]  David Cyranoski,et al.  CRISPR gene-editing tested in a person for the first time , 2016, Nature.

[33]  U. Dirnagl Resolving the Tension Between Exploration and Confirmation in Preclinical Biomedical Research. , 2019, Handbook of experimental pharmacology.

[34]  C. Begley,et al.  Drug development: Raise standards for preclinical cancer research , 2012, Nature.

[35]  Adrian Pickar-Oliver,et al.  The next generation of CRISPR–Cas technologies and applications , 2019, Nature Reviews Molecular Cell Biology.

[36]  Douglas G. Altman,et al.  Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research , 2010, Journal of pharmacology & pharmacotherapeutics.

[37]  N. Plesnila,et al.  Results of a preclinical randomized controlled multicenter trial (pRCT): Anti-CD49d treatment for acute brain ischemia , 2015, Science Translational Medicine.

[38]  Malcolm R. Macleod,et al.  No publication without confirmation , 2017, Nature.

[39]  Jing Liao,et al.  Did a change in Nature journals’ editorial policy for life sciences research improve reporting? , 2019, BMJ Open Science.

[40]  M. Lalu,et al.  Multicenter preclinical studies as an innovative method to enhance translation: a systematic review of published studies , 2019, bioRxiv.

[41]  Adrian J. Thrasher,et al.  Molecular remission of infant B-ALL after infusion of universal TALEN gene-edited CAR T cells , 2017, Science Translational Medicine.

[42]  J. Grimshaw,et al.  Threats to Validity in the Design and Conduct of Preclinical Efficacy Studies: A Systematic Review of Guidelines for In Vivo Animal Experiments , 2013, PLoS medicine.

[43]  D. Strech,et al.  Preclinical efficacy studies in investigator brochures: Do they enable risk–benefit assessment? , 2018, PLoS biology.