Novel citation-based search method for scientific literature: a validation study

Background We recently developed CoCites, a citation-based search method that is designed to be more efficient than traditional keyword-based methods. The method begins with identification of one or more highly relevant publications (query articles) and consists of two searches: the co-citation search, which ranks publications on their co-citation frequency with the query articles, and the citation search, which ranks publications on frequency of all citations that cite or are cited by the query articles. Methods We aimed to reproduce the literature searches of published systematic reviews and meta-analyses and assess whether CoCites retrieves all eligible articles while screening fewer titles. Results A total of 250 reviews were included. CoCites retrieved a median of 75% of the articles that were included in the original reviews. The percentage of retrieved articles was higher (88%) when the query articles were cited more frequently and when they had more overlap in their citations. Applying CoCites to only the highest-cited article yielded similar results. The co-citation and citation searches combined were more efficient when the review authors had screened more than 500 titles, but not when they had screened less. Conclusions CoCites is an efficient and accurate method for finding relevant related articles. The method uses the expert knowledge of authors to rank related articles, does not depend on keyword selection and requires no special expertise to build search queries. The method is transparent and reproducible.

[1]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[2]  Kevin W. Boyack,et al.  Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately? , 2010, J. Assoc. Inf. Sci. Technol..

[3]  Ludo Waltman,et al.  Appropriate similarity measures for author co-citation analysis , 2008 .

[4]  A. Janssens,et al.  Novel citation-based search method for scientific literature: application to meta-analyses , 2015, BMC Medical Research Methodology.

[5]  Henry G. Small,et al.  Co-citation in the scientific literature: A new measure of the relationship between two documents , 1973, J. Am. Soc. Inf. Sci..

[6]  C. Kindler,et al.  Active Research Fields in Anesthesia: A Document Co-Citation Analysis of the Anesthetic Literature , 2008, Anesthesia and analgesia.

[7]  Caleb M Trujillo,et al.  Document co-citation analysis to enhance transdisciplinary research , 2018, Science Advances.

[8]  I. Olkin,et al.  Meta-analysis of observational studies in epidemiology - A proposal for reporting , 2000 .

[9]  Su Golder,et al.  Citation searching: a systematic review case study of multiple risk behaviour interventions , 2014, BMC Medical Research Methodology.

[10]  M. Mckee,et al.  The health impact of trade and investment agreements: a quantitative systematic review and network co-citation analysis , 2017, Globalization and Health.

[11]  Christopher W. Belter,et al.  Citation analysis as a literature search method for systematic reviews , 2016, J. Assoc. Inf. Sci. Technol..

[12]  Jöran Beel,et al.  Citation Proximity Analysis (CPA) : A New Approach for Identifying Related Work Based on Co-Citation Analysis , 2009 .

[13]  George Gaylord Simpson,et al.  Mammals and the nature of continents , 1943 .

[14]  Elke Hausner,et al.  Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface , 2010, BMC medical research methodology.

[15]  Masaki Eto,et al.  Evaluations of context-based co-citation searching , 2012, Scientometrics.

[16]  Birger Larsen,et al.  Exploiting citation overlaps for Information Retrieval: Generating a boomerang effect from the network of scientific papers , 2002, Scientometrics.

[17]  Christopher W. Belter.  A relevance ranking method for citation-based search results , 2017, Scientometrics.

[18]  Katherine W. McCain,et al.  Visualizing a Discipline: An Author Co-Citation Analysis of Information Science, 1972-1995 , 1998, J. Am. Soc. Inf. Sci..

[19]  Ardis Hanson,et al.  It takes longer than you think: librarian time spent on systematic review tasks* , 2018, Journal of the Medical Library Association : JMLA.

[20]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[21]  Alison Callahan,et al.  Contextual cocitation: Augmenting cocitation analysis and its applications , 2010, J. Assoc. Inf. Sci. Technol..

[22]  Ignacio Rojas,et al.  Using cited references to improve the retrieval of related biomedical documents , 2013, BMC Bioinformatics.

[23]  Robert J Volk,et al.  Citation searches are more sensitive than keyword searches to identify studies using specific measurement instruments. , 2015, Journal of clinical epidemiology.

[24]  M. Sampson,et al.  Checking reference lists to find additional studies for systematic reviews. , 2011, The Cochrane database of systematic reviews.

[25]  Jin Chen,et al.  On the definition of forward and backward citation generations , 2011, J. Informetrics.

[26]  Eldon Spackman,et al.  Bidirectional Citation Searching to Completion: An Exploration of Literature Searching Methods , 2014, PharmacoEconomics.

[27]  Guy Tsafnat,et al.  Citation networks of related trials are often disconnected: implications for bidirectional citation searches. , 2014, Journal of clinical epidemiology.