Reference-based search strategies in systematic reviews

In systematic reviews, the number of articles found by search strings tend to be very large. In order to limit the number of articles to handle manually, we investigate a search strategy based on references between papers. We first identify a "take-off paper" which is the starting point for the search and then we follow the references from that paper. We also investigate "cardinal papers", i.e. papers that are referenced by many authors, and let the references to those papers guide the selection in the systematic review. We evaluate the search strategies on three published systematic reviews. The results vary greatly between the three studied systematic reviews, from 88% reduction to 92% extension of the original paper set.

[1]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[2]  B. Bahli,et al.  The role of knowledge creation in adopting extreme programming model: an empirical study , 2005, 2005 International Conference on Information and Communication Technology.

[3]  Gregg Rothermel,et al.  A safe, efficient regression test selection technique , 1997, TSEM.

[4]  Per Runeson,et al.  Empirical evaluations of regression test selection techniques: a systematic review , 2008, ESEM '08.

[5]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[6]  M. M. Kessler.  Bibliographic coupling between scientific papers , 1963 .

[7]  Gregg Rothermel,et al.  Analyzing Regression Test Selection Techniques , 1996, IEEE Trans. Software Eng..

[8]  JuristoNatalia,et al.  Developing search strategies for detecting relevant experiments , 2009 .

[9]  Laurie A. Williams,et al.  Applying regression test selection for COTS-based applications , 2006, ICSE.

[10]  Peter Bailey,et al.  Engineering a multi-purpose test collection for Web retrieval experiments , 2003, Inf. Process. Manag..

[11]  Anthony Debons,et al.  Bibliographic coupling , 1972, J. Am. Soc. Inf. Sci..

[12]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[13]  Claes Wohlin,et al.  How much information is needed for usage-based reading? A series of experiments , 2002, Proceedings International Symposium on Empirical Software Engineering.

[14]  Hong Xu,et al.  Journal co-citation analysis of semiconductor literature , 2003, Scientometrics.

[15]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007, IEEE Transactions on Software Engineering.

[16]  Natalia Juristo Juzgado,et al.  Developing search strategies for detecting relevant experiments , 2009, Empirical Software Engineering.

[17]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[18]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..