Systematic Review and Meta-analysis: Important Tools in Understanding Drug Development for Stroke

Animal models of ischaemic stroke have become an integral part of the preclinical pipeline for identifying novel neuroprotective drug targets and drugs. As the process serves as a filter, researchers do not expect complete concordance between the experimental animal and human clinical trial data. However, the paucity of clear examples of translation of promising animal results into drugs that work in a clinical setting has raised concerns about the utility of this translational paradigm. Preclinical systematic reviews have been used in response to these concerns to identify weaknesses in animal studies and provide empirical evidence supporting improvements to the design and conduct of preclinical animal experiments. We propose that further strategic development and application of data analysis methods can help continue this process of improvement and help identify the most promising therapeutic targets and drugs. These next steps in systematic review aim to tighten the focus of preclinical research, streamline the drug development process, and minimise research waste.

[1]  Ulrich Dirnagl,et al.  Found in translation: preclinical stroke research predicts human pathophysiology, clinical phenotypes, and therapeutic outcomes. , 2014, Stroke.

[2]  G. Donnan,et al.  Systematic Review and Metaanalysis of the Efficacy of FK506 in Experimental Stroke , 2005, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[3]  M. Macleod,et al.  A Systematic Review and Meta-Analysis of the Efficacy of Piracetam and Piracetam-Like Compounds in Experimental Stroke , 2007, Cerebrovascular Diseases.

[4]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[5]  David W Howells,et al.  Factors Affecting the Apparent Efficacy and Safety of Tissue Plasminogen Activator in Thrombotic Occlusion Models of Stroke: Systematic Review and Meta-Analysis , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[6]  Emily S Sena,et al.  Systematic review and stratified meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke. , 2009, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[7]  Harlan M Krumholz,et al.  Increasing value and reducing waste: addressing inaccessible research , 2014, The Lancet.

[8]  D. Krieger,et al.  EuroHYP-1: European Multicenter, Randomized, Phase III Clinical Trial of Therapeutic Hypothermia plus Best Medical Treatment vs. Best Medical Treatment Alone for Acute Ischemic Stroke , 2014, International journal of stroke : official journal of the International Stroke Society.

[9]  Carlijn R Hooijmans,et al.  Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed , 2010, Laboratory animals.

[10]  D. Howells,et al.  Publication Bias in Reports of Animal Stroke Studies Leads to Major Overstatement of Efficacy , 2010, PLoS biology.

[11]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[12]  Malcolm Macleod,et al.  How can we improve the pre-clinical development of drugs for stroke? , 2007, Trends in Neurosciences.

[13]  D. Howells,et al.  Meta-Analysis of Pre-Clinical Studies of Early Decompression in Acute Spinal Cord Injury: A Battle of Time and Pressure , 2013, PloS one.

[14]  D. Howells,et al.  The Benefit of Hypothermia in Experimental Ischemic Stroke is Not Affected by Pethidine , 2013, International journal of stroke : official journal of the International Stroke Society.

[15]  Peter Sandercock,et al.  Systematic Review and Meta-Analysis of the Efficacy of Tirilazad in Experimental Stroke , 2007, Stroke.

[16]  M. Macleod,et al.  Edinburgh Research Explorer Systematic Review and Meta-analysis of the Efficacy of Interleukin-1 Receptor Antagonist in Animal Models of Stroke: an Update , 2022 .

[17]  Emily S. Sena,et al.  Bringing rigour to translational medicine , 2014, Nature Reviews Neurology.

[18]  Robert F Terry,et al.  Mapping of available health research and development data: what's there, what's missing, and what role is there for a global observatory? , 2013, The Lancet.

[19]  D. Howells,et al.  Improving the Efficiency of the Development of Drugs for Stroke , 2012, International journal of stroke : official journal of the International Stroke Society.

[20]  G. Mead,et al.  Exercise Reduces Infarct Volume and Facilitates Neurobehavioral Recovery , 2014, Neurorehabilitation and neural repair.

[21]  G. Hankey,et al.  The FOCUS, AFFINITY and EFFECTS trials studying the effect(s) of fluoxetine in patients with a recent stroke: a study protocol for three multicentre randomised controlled trials , 2015, Trials.

[22]  Blair H. Smith,et al.  Pharmacotherapy for neuropathic pain in adults: a systematic review and meta-analysis , 2015, The Lancet Neurology.

[23]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[24]  U. Dirnagl,et al.  REPRINT: Good Laboratory Practice: Preventing Introduction of Bias at the Bench , 2009, International journal of stroke : official journal of the International Stroke Society.

[25]  L. Say,et al.  Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality , 2005, BMC medical research methodology.

[26]  Michael Nilsson,et al.  A Systematic Review and Meta-Analysis of Erythropoietin in Experimental Stroke , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[27]  I. Cuthill,et al.  Reporting : The ARRIVE Guidelines for Reporting Animal Research , 2010 .

[28]  T. Woodruff,et al.  Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review , 2013, Environmental health perspectives.

[29]  D. Howells,et al.  Stem Cell-Based Therapy for Experimental Stroke: A Systematic Review and Meta-Analysis , 2012, International journal of stroke : official journal of the International Stroke Society.

[30]  Iain Chalmers,et al.  How to increase value and reduce waste when research priorities are set , 2014, The Lancet.

[31]  D. Moher,et al.  CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials , 2010, Journal of pharmacology & pharmacotherapeutics.

[32]  U. Dirnagl,et al.  Evidence for the Efficacy of NXY-059 in Experimental Focal Cerebral Ischaemia Is Confounded by Study Quality , 2008, Stroke.

[33]  William A Ghali,et al.  An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks , 2014, Systematic Reviews.

[34]  David W Howells,et al.  Pooling of Animal Experimental Data Reveals Influence of Study Design and Publication Bias , 2004, Stroke.

[35]  Marc Fisher,et al.  Update of the Stroke Therapy Academic Industry Roundtable Preclinical Recommendations , 2009, Stroke.

[36]  G. Donnan,et al.  Preclinical Drug Evaluation for Combination Therapy in Acute Stroke Using Systematic Review, Meta-Analysis, and Subsequent Experimental Testing , 2011, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[37]  G. Donnan,et al.  Hypothermia in animal models of acute ischaemic stroke: a systematic review and meta-analysis. , 2007, Brain : a journal of neurology.

[38]  G. Donnan,et al.  1,026 Experimental treatments in acute stroke , 2006, Annals of neurology.

[39]  J. Glanville,et al.  Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. , 2013, The Cochrane database of systematic reviews.

[40]  M. Briel,et al.  Dissemination Bias in Systematic Reviews of Animal Research: A Systematic Review , 2014, PloS one.

[41]  Hans-Christoph Diener,et al.  NXY-059 for the treatment of acute ischemic stroke. , 2007, The New England journal of medicine.

[42]  D. Rujescu,et al.  The current development of CNS drug research. , 2013, The international journal of neuropsychopharmacology.

[43]  M. Macleod,et al.  Drug Repurposing: A Systematic Approach to Evaluate Candidate Oral Neuroprotective Interventions for Secondary Progressive Multiple Sclerosis , 2015, PloS one.

[44]  Gillian L. Currie,et al.  Efficacy of Antidepressants in Animal Models of Ischemic Stroke: A Systematic Review and Meta-Analysis , 2014, Stroke.

[45]  Alex J. Sutton,et al.  A Systematic Review of Systematic Reviews and Meta-Analyses of Animal Experiments with Guidelines for Reporting , 2006 .

[46]  Gillian L. Currie,et al.  Meta-analysis of data from animal studies: A practical guide , 2014, Journal of Neuroscience Methods.

[47]  A. Conti,et al.  Anaesthetic-Related Neuroprotection , 2010, CNS drugs.

[48]  D. Howells,et al.  Systematic Review and Meta-Analysis of Therapeutic Hypothermia in Animal Models of Spinal Cord Injury , 2013, PloS one.

[49]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[50]  Ulrich Dirnagl,et al.  Reprint: Good Laboratory Practice: Preventing Introduction of Bias at the Bench , 2009, Stroke.

[51]  S. Iliffe,et al.  The impact of Cochrane Reviews: a mixed-methods evaluation of outputs from Cochrane Review Groups supported by the National Institute for Health Research. , 2015, Health technology assessment.

[52]  J. Ioannidis,et al.  Evaluation of Excess Significance Bias in Animal Studies of Neurological Diseases , 2013, PLoS biology.