The Symposium on Search-Based Software Engineering: Past, Present and Future

Abstract Context Search-Based Software Engineering (SBSE) is the research field where Software Engineering (SE) problems are modelled as search problems to be solved by search-based techniques. The Symposium on Search Based Software Engineering (SSBSE) is the premier event on SBSE, which had its 11th edition in 2019. Objective In order to better understand the characteristics and evolution of papers published at SSBSE, this work reports results from a mapping study targeting the proceedings of all SSBSE editions. Despite the existing mapping studies on SBSE, our contribution in this work is to provide information to researchers and practitioners willing to enter the SBSE field, being a source of information to strengthen the symposium, guide new studies, and motivate new collaboration among research groups. Method A systematic mapping study was conducted with a set of four research questions, in which 134 studies published in all editions of SSBSE, dated from 2009 to 2019, were evaluated. In a fifth question, 32 papers published in the challenge track were summarised. Results Throughout the years, 290 authors from 25 countries have contributed to the main track of the symposium, with the collaboration of at least two institutions in 46.3% of the papers. SSBSE papers have got substantial external visibility, as most citations are from different venues. The SE tasks addressed by SSBSE are mostly related to software testing, software debugging, software design, and maintenance. Evolutionary algorithms are present in 75% of the papers, being the most common search technique. The evaluation of the SBSE approaches usually includes industrial systems. Conclusions SSBSE has helped increase the popularity of SBSE in the SE research community and has played an important role on making SBSE mature. There are still problems and challenges to be addressed in the SBSE field, which can be tackled by SSBSE authors in further studies.

[1]  Outi Räihä,et al.  A survey on search-based software design , 2010, Comput. Sci. Rev..

[2]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[3]  Alexander Egyed,et al.  Reengineering legacy applications into software product lines: a systematic mapping , 2017, Empirical Software Engineering.

[4]  Mark Harman,et al.  Search Based Software Engineering: Techniques, Taxonomy, Tutorial , 2010, LASER Summer School.

[5]  Sebastián Ventura,et al.  A survey of many-objective optimisation in search-based software engineering , 2019, J. Syst. Softw..

[6]  Jerffeson Teixeira de Souza,et al.  Incorporating user preferences in search-based software engineering: A systematic mapping study , 2017, Inf. Softw. Technol..

[7]  Márcio de Oliveira Barros,et al.  A Systematic Review of Software Requirements Selection and Prioritization Using SBSE Approaches , 2013, SSBSE.

[8]  Pravin Chandra,et al.  Applicability of Soft Computing and Optimization Algorithms in Software Testing and Metrics - A Brief Review , 2016, SoCPaR.

[9]  Márcio de Oliveira Barros,et al.  Software requirements selection and prioritization using SBSE approaches: A systematic review and mapping of the literature , 2015, J. Syst. Softw..

[10]  Stefano Russo,et al.  Search-Based Optimization for the Testing Resource Allocation Problem: Research Trends and Opportunities , 2018, 2018 IEEE/ACM 11th International Workshop on Search-Based Software Testing (SBST).

[11]  Yuanyuan Zhang,et al.  Search based software engineering for software product line engineering: a survey and directions for future work , 2014, SPLC.

[12]  Mohammadreza Keyvanpour,et al.  Software requirements interaction management using search-based software engineering methods: A survey , 2017, 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI).

[13]  Leila Silva,et al.  Software project scheduling problem in the context of search-based software engineering: A systematic review , 2019, J. Syst. Softw..

[14]  Abdel Salam Sayyad,et al.  Pareto-optimal search-based software engineering (POSBSE): A literature survey , 2013, 2013 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE).

[15]  Mark Harman,et al.  Genetic Improvement of Software: A Comprehensive Survey , 2018, IEEE Transactions on Evolutionary Computation.

[16]  Wesley Klewerton Guez Assunção,et al.  A Review of Ten Years of the Symposium on Search-Based Software Engineering , 2019, SSBSE.

[17]  Alexander Egyed,et al.  A systematic mapping study of search-based software engineering for software product lines , 2015, Inf. Softw. Technol..

[18]  Aurora Ramírez,et al.  A Systematic Review of Interaction in Search-Based Software Engineering , 2019, IEEE Transactions on Software Engineering.

[19]  Dayang N. A. Jawawi,et al.  A comparative evaluation of cloud migration optimization approaches: A systematic literature review , 2015 .

[20]  Prabhat Kumar,et al.  An extensive evaluation of search-based software testing: a review , 2017, Soft Computing.

[21]  Phil McMinn,et al.  Search‐based software test data generation: a survey , 2004, Softw. Test. Verification Reliab..

[22]  Vineeta Singh Software module clustering using metaheuristic search techniques: A survey , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[23]  Betty H. C. Cheng,et al.  Automated Optimization of Weighted Non-functional Objectives in Self-adaptive Systems , 2018, SSBSE.

[24]  ArcuriAndrea,et al.  A Hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering , 2014 .

[25]  Mark Harman Automated Test Data Generation using Search Based Software Engineering , 2007, Second International Workshop on Automation of Software Test (AST '07).

[26]  Alexander Egyed,et al.  Evolutionary Computation for Software Product Line Testing: An Overview and Open Challenges , 2016, Computational Intelligence and Quantitative Software Engineering.

[27]  Des Greer,et al.  A survey of search-based refactoring for software maintenance , 2018, Journal of Software Engineering Research and Development.

[28]  PetersenKai,et al.  Challenges and best practices in industry-academia collaborations in software engineering , 2016 .

[29]  Yuanyuan Zhang,et al.  Achievements, Open Problems and Challenges for Search Based Software Testing , 2015, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST).

[30]  Jerffeson Teixeira de Souza,et al.  The Human Competitiveness of Search Based Software Engineering , 2010, 2nd International Symposium on Search Based Software Engineering.

[31]  Jerffeson Teixeira de Souza,et al.  Ten Years of Search Based Software Engineering: A Bibliometric Analysis , 2011, SSBSE.

[32]  Massimiliano Di Penta SBSE Meets Software Maintenance: Achievements and Open Problems , 2012, SSBSE.

[33]  Casper Lassenius,et al.  Problems, causes and solutions when adopting continuous delivery - A systematic literature review , 2017, Inf. Softw. Technol..

[34]  Valdivino Alexandre de Santiago Júnior,et al.  A systematic mapping addressing Hyper-Heuristics within Search-based Software Testing , 2019, Inf. Softw. Technol..

[35]  Lionel C. Briand,et al.  A Hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering , 2014, Softw. Test. Verification Reliab..

[36]  Yuanyuan Zhang,et al.  Search Based Requirements Optimisation: Existing Work and Challenges , 2008, REFSQ.

[37]  Yuanyuan Zhang,et al.  Search Based Software Engineering: A Comprehensive Analysis and Review of Trends Techniques and Applications , 2009 .

[38]  Syed Zaffar Qasim,et al.  Research problems in Search-Based Software Engineering for many-objective optimization , 2017, 2017 International Conference on Innovations in Electrical Engineering and Computational Technologies (ICIEECT).

[39]  Yuanyuan Zhang,et al.  Search-based software engineering: Trends, techniques and applications , 2012, CSUR.

[40]  Lori L. Pollock,et al.  Exploring Evolutionary Search Strategies to Improve Applications' Energy Efficiency , 2018, SSBSE.

[41]  Silvia Regina Vergilio,et al.  A systematic review on search-based refactoring , 2017, Inf. Softw. Technol..

[42]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[43]  Ashish Sureka,et al.  Women in computer science research: what is the bibliography data telling us? , 2016, CSOC.

[44]  Mark Harman,et al.  Search-Based Software Project Management , 2014, Software Project Management in a Changing World.

[45]  Gordon Fraser,et al.  On Parameter Tuning in Search Based Software Engineering , 2011, SSBSE.

[46]  Markus Wagner,et al.  Data-Driven Search-Based Software Engineering , 2018, 2018 IEEE/ACM 15th International Conference on Mining Software Repositories (MSR).

[47]  Patrick Siarry,et al.  A survey on search-based model-driven engineering , 2017, Automated Software Engineering.

[48]  Vahid Garousi,et al.  Challenges and best practices in industry-academia collaborations in software engineering: A systematic literature review , 2016, Inf. Softw. Technol..

[49]  N. Lazar,et al.  Moving to a World Beyond “p < 0.05” , 2019, The American Statistician.