Skip to main content
SpringerLink
Log in

Systematic Review and Meta-analysis: Important Tools in Understanding Drug Development for Stroke

  • Chapter
  • First Online:
Neuroprotective Therapy for Stroke and Ischemic Disease

Part of the book series: Springer Series in Translational Stroke Research ((SSTSR))

Abstract

Animal models of ischaemic stroke have become an integral part of the preclinical pipeline for identifying novel neuroprotective drug targets and drugs. As the process serves as a filter, researchers do not expect complete concordance between the experimental animal and human clinical trial data. However, the paucity of clear examples of translation of promising animal results into drugs that work in a clinical setting has raised concerns about the utility of this translational paradigm. Preclinical systematic reviews have been used in response to these concerns to identify weaknesses in animal studies and provide empirical evidence supporting improvements to the design and conduct of preclinical animal experiments. We propose that further strategic development and application of data analysis methods can help continue this process of improvement and help identify the most promising therapeutic targets and drugs. These next steps in systematic review aim to tighten the focus of preclinical research, streamline the drug development process, and minimise research waste.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Abbreviations

ARRIVE:

Animal Research: Reporting of In Vivo Experiments

CAMARADES:

Collaborative Approach to Meta-analysis and Review of Animal Data from Experimental Studies

CONSORT:

Consolidated Standards of Reporting Trials

EBPM:

Evidence-based Preclinical Medicine

EDA:

Experimental Design Assistant

EuroHYP-1:

European multicentre randomised, phase III clinical trial of hypothermia plus best medical treatment versus best medical treatment alone for acute ischaemic stroke

FOCUS:

Fluoxetine or Control Under Supervision

IL-1 RA:

Interleukin-1 receptor antagonist

MeSH:

Medical Subject Headings

NC3Rs:

National Centre for the Replacement Refinement and Reduction of Animals in Research

NIH:

National Institutes of Health

NINDS:

National Institutes of Neurological Disorders and Stroke

NMDA:

N-methyl-d-aspartate

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

QUOROM:

Quality of Reporting of Meta-analyses

SAINT:

Stroke -Acute Ischemic NXY Treatment

STAIR:

Stroke Treatment academic industry roundtable

SYRCLE:

Systematic Review Centre for Laboratory Animal Experimentation

three Rs:

Replacement reduction and refinement

tPA:

Tissue plasminogen activator

UK:

United Kingdom

US:

United States

References

  1. Dirnagl U, Endres M (2014) Found in translation: preclinical stroke research predicts human pathophysiology, clinical phenotypes, and therapeutic outcomes. Stroke 45(5):1510–1518

    Article  PubMed  Google Scholar 

  2. O’Collins VE, Macleod MR, Donnan GA, Horky LL, van der Worp BH, Howells DW (2006) 1,026 experimental treatments in acute stroke. Ann Neurol 59(3):467–477

    Article  PubMed  Google Scholar 

  3. Sena ES, Briscoe CL, Howells DW, Donnan GA, Sandercock PA, Macleod MR (2010) Factors affecting the apparent efficacy and safety of tissue plasminogen activator in thrombotic occlusion models of stroke: systematic review and meta-analysis. J Cereb Blood Flow Metab 30(12):1905–1913

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Shuaib A, Lees KR, Lyden P, Grotta J, Davalos A, Davis SM et al (2007) NXY-059 for the treatment of acute ischemic stroke. N Engl J Med 357(6):562–571

    Article  CAS  PubMed  Google Scholar 

  5. Macleod MR, van der Worp HB, Sena ES, Howells DW, Dirnagl U, Donnan GA (2008) Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality. Stroke 39(10):2824–2829

    Article  PubMed  Google Scholar 

  6. Greb E (2014) Magnesium treatment may not improve stroke outcome. Neurol Rev 22(3):5

    Google Scholar 

  7. O’Collins VE, Macleod MR, Cox SF, Van Raay L, Aleksoska E, Donnan GA et al (2011) Preclinical drug evaluation for combination therapy in acute stroke using systematic review, meta-analysis, and subsequent experimental testing. J Cereb Blood Flow Metab 31(3):962–975

    Article  PubMed  Google Scholar 

  8. Howells DW, Sena ES, Macleod MR (2014) Bringing rigour to translational medicine. Nat Rev Neurol 10(1):37–43

    Article  CAS  PubMed  Google Scholar 

  9. Tsilidis KK, Panagiotou OA, Sena ES, Aretouli E, Evangelou E, Howells DW et al (2013) Evaluation of excess significance bias in animal studies of neurological diseases. PLoS Biol 11(7), e1001609

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Wegener G, Rujescu D (2013) The current development of CNS drug research. Int J Neuropsychopharmacol 16(7):1687–1693

    Article  PubMed  Google Scholar 

  11. Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gulmezoglu AM et al (2014) How to increase value and reduce waste when research priorities are set. Lancet 383(9912):156–165

    Article  PubMed  Google Scholar 

  12. Cochrane|Trusted evidence (c2004–2015) Informed decisions. Better health. [Internet]. The Cochrane Collaboration, Oxford. Available from: http://www.cochrane.org/

  13. Schulz KF, Altman DG, Moher D, for the CG (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med 7(3):e1000251

    Google Scholar 

  14. Bunn F, Trivedi D, Alderson P, Hamilton L, Martin A, Pinkney E et al (2015) The impact of Cochrane Reviews: a mixed-methods evaluation of outputs from Cochrane Review Groups supported by the National Institute for Health Research. Health Technol Assess 19(28):1–100

    Article  PubMed  PubMed Central  Google Scholar 

  15. Peters JL, Sutton AJ, Jones DR, Rushton L, Abrams KR (2006) A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting. J Environ Sci Health B 41(7):1245–1258

    Article  CAS  PubMed  Google Scholar 

  16. Mueller KF, Briel M, Strech D, Meerpohl JJ, Lang B, Motschall E et al (2014) Dissemination bias in systematic reviews of animal research: a systematic review. PLoS One 9(12), e116016

    Article  PubMed  PubMed Central  Google Scholar 

  17. Vesterinen HM, Sena ES, Egan KJ, Hirst TC, Churolov L, Currie GL et al (2014) Meta-analysis of data from animal studies: a practical guide. J Neurosci Methods 221:92–102

    Article  CAS  PubMed  Google Scholar 

  18. Jerndal M, Forsberg K, Sena ES, Macleod MR, O’Collins VE, Linden T et al (2010) A systematic review and meta-analysis of erythropoietin in experimental stroke. J Cereb Blood Flow Metab 30(5):961–968

    Article  CAS  PubMed  Google Scholar 

  19. Macleod MR, O’Collins T, Horky LL, Howells DW, Donnan GA (2005) Systematic review and metaanalysis of the efficacy of FK506 in experimental stroke. J Cereb Blood Flow Metab 25(6):713–721

    Article  CAS  PubMed  Google Scholar 

  20. Macleod MR, O’Collins T, Howells DW, Donnan GA (2004) Pooling of animal experimental data reveals influence of study design and publication bias. Stroke 35(5):1203–1208

    Article  PubMed  Google Scholar 

  21. Sena E, Wheble P, Sandercock P, Macleod M (2007) Systematic review and meta-analysis of the efficacy of tirilazad in experimental stroke. Stroke 38(2):388–394

    Article  CAS  PubMed  Google Scholar 

  22. Sena ES, van der Worp HB, Bath PM, Howells DW, Macleod MR (2010) Publication bias in reports of animal stroke studies leads to major overstatement of efficacy. PLoS Biol 8(3), e1000344

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lees JS, Sena ES, Egan KJ, Antonic A, Koblar SA, Howells DW et al (2012) Stem cell-based therapy for experimental stroke: a systematic review and meta-analysis. Int J Stroke 7(7):582–588

    Article  PubMed  Google Scholar 

  24. Krauth D, Woodruff TJ, Bero L (2013) Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121(9):985–992

    PubMed  PubMed Central  Google Scholar 

  25. Fisher M, Feuerstein G, Howells DW, Hurn PD, Kent TA, Savitz SI et al (2009) Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke 40(6):2244–2250

    Article  PubMed  PubMed Central  Google Scholar 

  26. Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW et al (2012) A call for transparent reporting to optimize the predictive value of preclinical research. Nature 490(7419):187–191

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Schifilliti D, Grasso G, Conti A, Fodale V (2010) Anaesthetic-related neuroprotection: intravenous or inhalational agents? CNS Drugs 24(11):893–907

    CAS  PubMed  Google Scholar 

  28. Vesterinen HM, Connick P, Irvine CM, Sena ES, Egan KJ, Carmichael GG et al (2015) Drug repurposing: a systematic approach to evaluate candidate oral neuroprotective interventions for secondary progressive multiple sclerosis. PLoS One 10(4), e0117705

    Article  PubMed  PubMed Central  Google Scholar 

  29. Sena E, van der Worp HB, Howells D, Macleod M (2007) How can we improve the pre-clinical development of drugs for stroke? Trends Neurosci 30(9):433–439

    Article  CAS  PubMed  Google Scholar 

  30. Egan KJ, Janssen H, Sena ES, Longley L, Speare S, Howells DW et al (2014) Exercise reduces infarct volume and facilitates neurobehavioral recovery: results from a systematic review and meta-analysis of exercise in experimental models of focal ischemia. Neurorehabil Neural Repair 28(8):800–812

    Article  PubMed  Google Scholar 

  31. Wheble PC, Sena ES, Macleod MR (2008) A systematic review and meta-analysis of the efficacy of piracetam and piracetam-like compounds in experimental stroke. Cerebrovasc Dis 25(1–2):5–11

    CAS  PubMed  Google Scholar 

  32. Baker M (2016) 1,500 scientists lift the lid on reproducibility. Nature 533(7604):452–454

    Article  CAS  PubMed  Google Scholar 

  33. McCann SK, Cramond F, Macleod MR, Sena ES (2016) Systematic review and meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke: an update. Transl Stroke Res doi:10.1007/s12975-016-0489-z

  34. Higgins JPT, Green S (2011) Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]: The Cochrane Collaboration. Available from: www.cochrane-handbook.org

  35. Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ et al (2010) Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess 14(8):Iii, ix–xi, 1–193

    Article  PubMed  Google Scholar 

  36. Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC et al (2014) Increasing value and reducing waste: addressing inaccessible research. Lancet 383(9913):257–266

    Article  PubMed  PubMed Central  Google Scholar 

  37. Banwell V, Sena ES, Macleod MR (2009) Systematic review and stratified meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke. J Stroke Cerebrovasc Dis 18(4):269–276

    Article  PubMed  Google Scholar 

  38. Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Reprint: good laboratory practice: preventing introduction of bias at the bench. Int J Stroke 4(1):3–5

    Article  PubMed  Google Scholar 

  39. Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Reprint: good laboratory practice: preventing introduction of bias at the bench. J Cereb Blood Flow Metab 29(2):221–223

    Article  PubMed  Google Scholar 

  40. Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM et al (2009) Good laboratory practice: preventing introduction of bias at the bench. Stroke 40(3):e50–e52

    Article  PubMed  Google Scholar 

  41. Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG (2010) Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol 8(6), e1000412

    Article  PubMed  PubMed Central  Google Scholar 

  42. Editorial (2013) Announcement: reducing our irreproducibility. Nature 496(7446):398.

    Google Scholar 

  43. van der Worp HB, Macleod MR, Bath PM, Demotes J, Durand-Zaleski I, Gebhardt B et al (2014) EuroHYP-1: European multicenter, randomized, phase III clinical trial of therapeutic hypothermia plus best medical treatment vs. best medical treatment alone for acute ischemic stroke. Int J Stroke 9:642–645

    Article  PubMed  Google Scholar 

  44. van der Worp HB, Sena ES, Donnan GA, Howells DW, Macleod MR (2007) Hypothermia in animal models of acute ischaemic stroke: a systematic review and meta-analysis. Brain 130(pt 12):3063–3074

    Article  PubMed  Google Scholar 

  45. Sena ES, Jeffreys AL, Cox SF, Sastra SA, Churilov L, Rewell S et al (2013) The benefit of hypothermia in experimental ischemic stroke is not affected by pethidine. Int J Stroke 8(3):180–185

    Article  PubMed  Google Scholar 

  46. McCann SK, Irvine C, Mead GE, Sena ES, Currie GL, Egan KE et al (2014) Efficacy of antidepressants in animal models of ischemic stroke: a systematic review and meta-analysis. Stroke 45(10):3055–3063

    Article  CAS  PubMed  Google Scholar 

  47. Mead G, Hackett ML, Lundstrom E, Murray V, Hankey GJ, Dennis M (2015) The FOCUS, AFFINITY and EFFECTS trials studying the effect(s) of fluoxetine in patients with a recent stroke: a study protocol for three multicentre randomised controlled trials. Trials 16:369

    Article  PubMed  PubMed Central  Google Scholar 

  48. Batchelor PE, Skeers P, Antonic A, Wills TE, Howells DW, Macleod MR et al (2013) Systematic review and meta-analysis of therapeutic hypothermia in animal models of spinal cord injury. PLoS One 8(8), e71317

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Batchelor PE, Wills TE, Skeers P, Battistuzzo CR, Macleod MR, Howells DW et al (2013) Meta-analysis of pre-clinical studies of early decompression in acute spinal cord injury: a battle of time and pressure. PLoS One 8(8), e72659

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Howells DW, Sena ES, O’Collins V, Macleod MR (2012) Improving the efficiency of the development of drugs for stroke. Int J Stroke 7(5):371–377

    Article  PubMed  Google Scholar 

  51. Rottingen JA, Regmi S, Eide M, Young AJ, Viergever RF, Ardal C et al (2013) Mapping of available health research and development data: what’s there, what’s missing, and what role is there for a global observatory? Lancet 382(9900):1286–1307

    Article  PubMed  Google Scholar 

  52. Finnerup NB, Attal N, Haroutounian S, McNicol E, Baron R, Dworkin RH et al (2015) Pharmacotherapy for neuropathic pain in adults: a systematic review and meta-analysis. Lancet Neurol 14(2):162–173

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Betran AP, Say L, Gulmezoglu AM, Allen T, Hampson L (2005) Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol 5(1):6

    Article  PubMed  PubMed Central  Google Scholar 

  54. Kwon Y, Powelson SE, Wong H, Ghali WA, Conly JM (2014) An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks. Syst Rev 3:135

    Article  PubMed  PubMed Central  Google Scholar 

  55. Beynon R, Leeflang MM, McDonald S, Eisinga A, Mitchell RL, Whiting P et al (2013) Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev (9):MR000022

    Google Scholar 

  56. Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M (2010) Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed. Lab Anim 44(3):170–175

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK

    Sarah K. McCann, Emily S. Sena, Gillian L. Currie & Malcolm R. Macleod

  2. Florey Institute of Neuroscience and Mental Health, Heidelberg, VIC, Australia

    David W. Howells

  3. Faculty of Health, School of Medicine, University of Tasmania, Medical Science Precinct, 17 Liverpool Street, Hobart, TAS, Australia

    David W. Howells

Authors
  1. Sarah K. McCann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emily S. Sena
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gillian L. Currie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Malcolm R. Macleod
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. David W. Howells
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David W. Howells .

Editor information

Editors and Affiliations

  1. Department of Neurology and Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, California, USA

    Paul A. Lapchak

  2. Loma Linda University School of Medicine, Loma Linda, California, USA

    John H. Zhang

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

McCann, S.K., Sena, E.S., Currie, G.L., Macleod, M.R., Howells, D.W. (2017). Systematic Review and Meta-analysis: Important Tools in Understanding Drug Development for Stroke. In: Lapchak, P., Zhang, J. (eds) Neuroprotective Therapy for Stroke and Ischemic Disease. Springer Series in Translational Stroke Research. Springer, Cham. https://doi.org/10.1007/978-3-319-45345-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45345-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45344-6

  • Online ISBN: 978-3-319-45345-3

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation