Optimizing literature search in systematic reviews – are MEDLINE, EMBASE and CENTRAL enough for identifying effect studies within the area of musculoskeletal disorders?

BackgroundWhen conducting systematic reviews, it is essential to perform a comprehensive literature search to identify all published studies relevant to the specific research question. The Cochrane Collaborations Methodological Expectations of Cochrane Intervention Reviews (MECIR) guidelines state that searching MEDLINE, EMBASE and CENTRAL should be considered mandatory. The aim of this study was to evaluate the MECIR recommendations to use MEDLINE, EMBASE and CENTRAL combined, and examine the yield of using these to find randomized controlled trials (RCTs) within the area of musculoskeletal disorders.MethodsData sources were systematic reviews published by the Cochrane Musculoskeletal Review Group, including at least five RCTs, reporting a search history, searching MEDLINE, EMBASE, CENTRAL, and adding reference- and hand-searching. Additional databases were deemed eligible if they indexed RCTs, were in English and used in more than three of the systematic reviews. Relative recall was calculated as the number of studies identified by the literature search divided by the number of eligible studies i.e. included studies in the individual systematic reviews. Finally, cumulative median recall was calculated for MEDLINE, EMBASE and CENTRAL combined followed by the databases yielding additional studies.ResultsDeemed eligible was twenty-three systematic reviews and the databases included other than MEDLINE, EMBASE and CENTRAL was AMED, CINAHL, HealthSTAR, MANTIS, OT-Seeker, PEDro, PsychINFO, SCOPUS, SportDISCUS and Web of Science. Cumulative median recall for combined searching in MEDLINE, EMBASE and CENTRAL was 88.9% and increased to 90.9% when adding 10 additional databases.ConclusionSearching MEDLINE, EMBASE and CENTRAL was not sufficient for identifying all effect studies on musculoskeletal disorders, but additional ten databases did only increase the median recall by 2%. It is possible that searching databases is not sufficient to identify all relevant references, and that reviewers must rely upon additional sources in their literature search. However further research is needed.

[1]  T. Trikalinos,et al.  Using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions. , 2015, Journal of clinical epidemiology.

[2]  David Moher,et al.  An evidence-based practice guideline for the peer review of electronic search strategies. , 2009, Journal of clinical epidemiology.

[3]  Guy Tsafnat,et al.  Citation networks of related trials are often disconnected: implications for bidirectional citation searches. , 2014, Journal of clinical epidemiology.

[4]  S. Bayliss,et al.  Where and how to search for information on the effectiveness of public health interventions--a case study for prevention of cardiovascular disease. , 2014, Health information and libraries journal.

[5]  A. Woolf,et al.  Burden of major musculoskeletal conditions. , 2003, Bulletin of the World Health Organization.

[6]  Jesse A Berlin,et al.  Searching one or two databases was insufficient for meta-analysis of observational studies. , 2005, Journal of clinical epidemiology.

[7]  B. Koes,et al.  Multidisciplinary rehabilitation for fibromyalgia and musculoskeletal pain in working age adults. , 1999, The Cochrane database of systematic reviews.

[8]  M. Nylenna,et al.  A new network to promote evidence-based research , 2014, The Lancet.

[9]  C. Edwards,et al.  Safety of non-steroidal anti-inflammatory drugs, including aspirin and paracetamol (acetaminophen) in people receiving methotrexate for inflammatory arthritis (rheumatoid arthritis, ankylosing spondylitis, psoriatic arthritis, other spondyloarthritis). , 2011, The Cochrane database of systematic reviews.

[10]  D. Moher,et al.  Guides for Reading and Interpreting Systematic Reviews , 2016 .

[11]  D. Moher,et al.  An alternative to the hand searching gold standard: validating methodological search filters using relative recall , 2006, BMC medical research methodology.

[12]  R. Christensen,et al.  Aquatic exercise for the treatment of knee and hip osteoarthritis. , 2007, The Cochrane database of systematic reviews.

[13]  M. Wallen,et al.  Searching for Evidence in Pediatric Occupational Therapy Using Free versus Subscription Databases , 2006 .

[14]  M. Suarez‐Almazor,et al.  Calcitonin for preventing and treating corticosteroid‐induced osteoporosis , 2000 .

[15]  L. Hartling,et al.  Which resources should be used to identify RCT/CCTs for systematic reviews: a systematic review , 2005, BMC medical research methodology.

[16]  L. Turner-Stokes,et al.  Multidisciplinary rehabilitation programmes following joint replacement at the hip and knee in chronic arthropathy. , 2008, The Cochrane database of systematic reviews.

[17]  A. Kazanjian,et al.  BEYOND MEDLINE , 2003, International Journal of Technology Assessment in Health Care.

[18]  N. Bellamy,et al.  Viscosupplementation for the treatment of osteoarthritis of the knee. , 2006, The Cochrane database of systematic reviews.

[19]  J. Schoones,et al.  Re: "using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions". , 2016, Journal of Clinical Epidemiology.

[20]  D. Lawlor,et al.  Searching multiple databases for systematic reviews: added value or diminishing returns? , 2004, Complementary therapies in medicine.

[21]  A. Rutjes,et al.  Therapeutic ultrasound for osteoarthritis of the knee or hip. , 2010, The Cochrane database of systematic reviews.

[22]  M. Clarke,et al.  Identifying relevant studies for systematic reviews , 1995, BMJ.

[23]  Catherine Sherrington,et al.  CENTRAL, PEDro, PubMed, and EMBASE Are the Most Comprehensive Databases Indexing Randomized Controlled Trials of Physical Therapy Interventions , 2011, Physical Therapy.

[24]  A G Edwards,et al.  Efficient literature searching in diffuse topics: lessons from a systematic review of research on communicating risk to patients in primary care. , 1999, Health libraries review.

[25]  M. Suarez‐Almazor,et al.  Leflunomide for treating rheumatoid arthritis. , 2003, The Cochrane database of systematic reviews.

[26]  C. Counsell,et al.  Identifying relevant studies for systematic reviews , 1995, BMJ.

[27]  L. Ada,et al.  Surgery for thumb (trapeziometacarpal joint) osteoarthritis. , 2009, The Cochrane database of systematic reviews.

[28]  P. Tugwell,et al.  Transcutaneous electrical nerve stimulation (TENS) for the treatment of rheumatoid arthritis in the hand. , 2003, The Cochrane database of systematic reviews.

[29]  L. Rollin,et al.  Searching for high-quality articles about intervention studies in occupational health--what is really missed when using only the Medline database? , 2010, Scandinavian journal of work, environment & health.

[30]  V. Bykerk,et al.  Etanercept in the treatment of rheumatoid arthritis , 2007, Therapeutics and clinical risk management.

[31]  M. Dorgan,et al.  Identifying clinical trials in the medical literature with electronic databases: MEDLINE alone is not enough. , 2000, Controlled clinical trials.

[32]  K. Dickersin,et al.  Systematic Reviews: Identifying relevant studies for systematic reviews , 1994 .

[33]  P. Royle,et al.  Sources of evidence for systematic reviews of interventions in diabetes , 2005, Diabetic medicine : a journal of the British Diabetic Association.

[34]  Liz Dennett,et al.  VALUE OF DATABASES OTHER THAN MEDLINE FOR RAPID HEALTH TECHNOLOGY ASSESSMENTS , 2014, International Journal of Technology Assessment in Health Care.

[35]  J. Keating,et al.  Exercise for acutely hospitalised older medical patients. , 2007, The Cochrane database of systematic reviews.

[36]  David Moher,et al.  Should meta-analysts search Embase in addition to Medline? , 2003, Journal of clinical epidemiology.

[37]  D. Moher,et al.  Searching for Controlled Trials of Complementary and Alternative Medicine: A Comparison of 15 Databases , 2011, Evidence-based complementary and alternative medicine : eCAM.

[38]  Performance of online biomedical databases in rheumatology. , 1994, The Journal of rheumatology.

[39]  Gordon H Guyatt,et al.  GRADE guidelines: 5. Rating the quality of evidence--publication bias. , 2011, Journal of clinical epidemiology.

[40]  A. Garg,et al.  Availability of renal literature in six bibliographic databases , 2012, Clinical kidney journal.

[41]  E. Hendriks,et al.  Transcutaneous electrostimulation for osteoarthritis of the knee. , 2009, The Cochrane database of systematic reviews.

[42]  J. Reginster,et al.  Strontium ranelate for preventing and treating postmenopausal osteoporosis. , 2006, The Cochrane database of systematic reviews.

[43]  C. Adams,et al.  An investigation of the adequacy of MEDLINE searches for randomized controlled trials (RCTs) of the effects of mental health care , 1994, Psychological Medicine.

[44]  Claire Stansfield,et al.  Searching for systematic reviews of the effects of social and environmental interventions: a case study of children and obesity. , 2010, Journal of the Medical Library Association : JMLA.

[45]  David Moher,et al.  Network meta-analyses could be improved by searching more sources and by involving a librarian. , 2014, Journal of clinical epidemiology.

[46]  R. Buchbinder,et al.  Surgery for rotator cuff disease. , 2008, The Cochrane database of systematic reviews.

[47]  J. Haafkens,et al.  Searching bibliographic databases for literature on chronic disease and work participation. , 2006, Occupational medicine.

[48]  Rajat Mittal,et al.  Cryotherapy following total knee replacement. , 2012, The Cochrane database of systematic reviews.

[49]  K. N. Dollman,et al.  - 1 , 1743 .

[50]  Dean Giustini,et al.  Comparing the coverage, recall, and precision of searches for 120 systematic reviews in Embase, MEDLINE, and Google Scholar: a prospective study , 2016, Systematic Reviews.

[51]  D. Moher,et al.  Guides for reading and interpreting systematic reviews: I. Getting started. , 1998, Archives of pediatrics & adolescent medicine.

[52]  Len Kelly,et al.  So many databases, such little clarity: Searching the literature for the topic aboriginal. , 2008, Canadian family physician Medecin de famille canadien.

[53]  Sam Vincent,et al.  Clinical Evidence diagnosis: Developing a sensitive search strategy to retrieve diagnostic studies on deep vein thrombosis: a pragmatic approach. , 2003, Health information and libraries journal.

[54]  A. Moseley,et al.  Indexing of randomised controlled trials of physiotherapy interventions: a comparison of AMED, CENTRAL, CINAHL, EMBASE, hooked on evidence, PEDro, PsycINFO and PubMed. , 2009, Physiotherapy.

[55]  V Pistotti,et al.  Searching for rehabilitation articles on MEDLINE and EMBASE. An example with cross-over design. , 2000, Archives of physical medicine and rehabilitation.

[56]  A. Kazanjian,et al.  Evidence-based practice: extending the search to find material for the systematic review. , 2001, Bulletin of the Medical Library Association.

[57]  T. Winzenberg,et al.  Vitamin D supplementation for improving bone mineral density in children. , 2010, The Cochrane database of systematic reviews.

[58]  Kath Wright,et al.  Can we prioritise which databases to search? A case study using a systematic review of frozen shoulder management. , 2013, Health information and libraries journal.

[59]  T. Winzenberg,et al.  Vitamin D supplementation for improving bone mineral density in children (Intervention Review) , 2010 .

[60]  G. Slobogean,et al.  MEDLINE, EMBASE, and Cochrane index most primary studies but not abstracts included in orthopedic meta-analyses. , 2009, Journal of clinical epidemiology.

[61]  L. Murphy,et al.  Spinal palpation: The challenges of information retrieval using available databases. , 2003, Journal of manipulative and physiological therapeutics.

[62]  David Ogilvie,et al.  Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go? , 2005, Journal of Epidemiology and Community Health.

[63]  Pamela Royle,et al.  LITERATURE SEARCHING FOR RANDOMIZED CONTROLLED TRIALS USED IN COCHRANE REVIEWS: RAPID VERSUS EXHAUSTIVE SEARCHES , 2003, International Journal of Technology Assessment in Health Care.

[64]  J. Gray.  Evidence-Based Healthcare , 1997 .

[65]  R. Buchbinder,et al.  Antidepressants for pain management in rheumatoid arthritis. , 2011, The Cochrane database of systematic reviews.

[66]  P. Richardson,et al.  Identifying randomized controlled trials of cognitive therapy for depression: comparing the efficiency of Embase, Medline and PsycINFO bibliographic databases. , 1999, The British journal of medical psychology.

[67]  A. Vickers.  Bibliometric analysis of randomized trials in complementary medicine , 1998 .

[68]  D. W. Lawrence.  What is lost when searching only one literature database for articles relevant to injury prevention and safety promotion? , 2008, Injury Prevention.

[69]  Sarah Stockton,et al.  Searching CINAHL did not add value to clinical questions posed in NICE guidelines. , 2013, Journal of clinical epidemiology.

[70]  Claire Bombardier,et al.  Methotrexate monotherapy versus methotrexate combination therapy with non-biologic disease modifying anti-rheumatic drugs for rheumatoid arthritis. , 2010, The Cochrane database of systematic reviews.

[71]  M. Suarez‐Almazor,et al.  Calcitonin for the treatment and prevention of corticosteroid-induced osteoporosis. , 2000, The Cochrane database of systematic reviews.

[72]  J. Sterne,et al.  Systematic reviews of test accuracy should search a range of databases to identify primary studies. , 2008, Journal of clinical epidemiology.

[73]  Peter Jüni,et al.  Oral or transdermal opioids for osteoarthritis of the knee or hip. , 2014, The Cochrane database of systematic reviews.

[74]  A. Burls,et al.  Certolizumab pegol (CDP870) for rheumatoid arthritis in adults. , 2017, The Cochrane database of systematic reviews.

[75]  Ghazala Mir,et al.  Searching for religion and mental health studies required health, social science, and grey literature databases. , 2014, Journal of clinical epidemiology.

[76]  Richard Horton,et al.  GBD 2010: understanding disease, injury, and risk , 2012, The Lancet.

[77]  Marlies Leenaars,et al.  Towards evidence based research , 2016, British Medical Journal.

[78]  R. Buchbinder,et al.  Neuromodulators for pain management in rheumatoid arthritis , 2012, The Cochrane database of systematic reviews.

[79]  R. Buchbinder,et al.  Opioid therapy for treating rheumatoid arthritis pain. , 2011, The Cochrane database of systematic reviews.

[80]  V. Welch,et al.  Oral or transdermal opioids for osteoarthritis of the knee or hip. , 2009, The Cochrane database of systematic reviews.

[81]  N. Bellamy,et al.  Intraarticular corticosteroid for treatment of osteoarthritis of the knee. , 2005, The Cochrane database of systematic reviews.

[82]  Stephen P. Harter,et al.  Online Information Retrieval: Concepts, Principles and Techniques , 1986 .

[83]  P. Aker,et al.  Searching chiropractic literature: a comparison of three computerized databases. , 1996, Journal of manipulative and physiological therapeutics.

[84]  Angela Evans,et al.  Non-surgical interventions for paediatric pes planus. , 2010, The Cochrane database of systematic reviews.

[85]  H. Khalil.  MUSCLE RELAXANTS FOR PAIN MANAGEMENT IN RHEUMATOID ARTHRITIS , 2012 .