A Preliminary Systematic Mapping Study of Human Competitiveness of SBSE

Search Based Software Engineering (SBSE) seeks to reformulate Software Engineering complex problems as search problems to be, hereafter, optimized through the usage of artificial intelligence techniques. As pointed out by Harman in 2007, in his seminal paper about the current state and future of SBSE, it would be very attractive to have convincing examples of human competitive results in order to champion the field. A landmark effort in this direction was made by Souza and others, in the paper titled “The Human Competitiveness of Search Based Software Engineering”, published at SSBSE’2010, voted by the SBSE community as the most influential paper of the past editions in the 10th anniversary of the SSBSE, in 2018. This paper presents a preliminary systematic mapping study to provide an overview of the current state of human competitiveness of SBSE, carried out via a snowball reading of Souza’s paper. The analyses of the 29 selected papers showed a growing interest in this topic, especially since 2010. Seven of those papers presented relevant experimental results, thus demonstrating the human competitiveness of results produced by SBSE approaches.

[1]  Claes Wohlin,et al.  Guidelines for snowballing in systematic literature studies and a replication in software engineering , 2014, EASE '14.

[2]  Jerffeson Teixeira de Souza,et al.  The Human Competitiveness of Search Based Software Engineering , 2010, 2nd International Symposium on Search Based Software Engineering.

[3]  Yuanyuan Zhang,et al.  Comparing the performance of metaheuristics for the analysis of multi-stakeholder tradeoffs in requirements optimisation , 2011, Inf. Softw. Technol..

[4]  F. Freitas,et al.  Software Next Release Planning Approach through Exact Optimization , 2011 .

[5]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[6]  Mark Harman,et al.  Exact scalable sensitivity analysis for the next release problem , 2014, ACM Trans. Softw. Eng. Methodol..

[7]  Aurora Trinidad Ramirez Pozo,et al.  Search Based Software Engineering: Review and analysis of the field in Brazil , 2013, J. Syst. Softw..

[8]  Yuanyuan Zhang,et al.  Search Based Software Engineering: A Comprehensive Analysis and Review of Trends Techniques and Applications , 2009 .

[9]  Yuanyuan Zhang,et al.  The multi-objective next release problem , 2007, GECCO '07.

[10]  Gordon Fraser,et al.  Does Automated Unit Test Generation Really Help Software Testers? A Controlled Empirical Study , 2015, ACM Trans. Softw. Eng. Methodol..

[11]  Mark Harman,et al.  Cooperative Co-evolutionary Optimization of Software Project Staff Assignments and Job Scheduling , 2011, SSBSE.

[12]  Andrea Arcuri,et al.  Improving the performance of OCL constraint solving with novel heuristics for logical operations: a search-based approach , 2016, Empirical Software Engineering.

[13]  Rakesh Roshan,et al.  Review of Search based Techniques in Software Testing , 2012 .

[14]  Pearl Brereton,et al.  Using Mapping Studies in Software Engineering , 2008, PPIG.

[15]  Siti Hafizah Ab Hamid,et al.  Cost and Effectiveness of Search-Based Techniques for Model-Based Testing: An Empirical Analysis , 2017, Int. J. Softw. Eng. Knowl. Eng..

[16]  Mark Harman,et al.  The Current State and Future of Search Based Software Engineering , 2007, Future of Software Engineering (FOSE '07).

[17]  Mariela Inés Cortés,et al.  A Multiobjective Optimization Approach to the Software Release Planning with Undefined Number of Releases and Interdependent Requirements , 2011, ICEIS.

[18]  Allysson Allex Araújo,et al.  Incorporating user preferences in ant colony optimization for the next release problem , 2016, Appl. Soft Comput..

[19]  Mark Harman,et al.  Search Based Software Engineering for Program Comprehension , 2007, 15th IEEE International Conference on Program Comprehension (ICPC '07).

[20]  Mark Harman,et al.  API-Constrained Genetic Improvement , 2016, SSBSE.

[21]  Gordon Fraser,et al.  EvoSuite: automatic test suite generation for object-oriented software , 2011, ESEC/FSE '11.

[22]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[23]  Des Greer,et al.  MultiRefactor: Automated Refactoring To Improve Software Quality , 2017, PROFES.

[24]  Jerffeson Teixeira de Souza,et al.  A New Approach to the Software Release Planning , 2009, 2009 XXIII Brazilian Symposium on Software Engineering.

[25]  Shin Yoo,et al.  Evolving Human Competitive Spectra-Based Fault Localisation Techniques , 2012, SSBSE.

[26]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[27]  Mark Harman,et al.  Search Based Approaches to Component Selection and Prioritization for the Next Release Problem , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[28]  Mark Harman,et al.  Search Based Software Engineering: Techniques, Taxonomy, Tutorial , 2010, LASER Summer School.

[29]  Gordon Fraser,et al.  Does automated white-box test generation really help software testers? , 2013, ISSTA.

[30]  Mark Harman,et al.  An Empirical Study of Cohesion and Coupling: Balancing Optimization and Disruption , 2018, IEEE Transactions on Evolutionary Computation.

[31]  Andres J. Ramirez,et al.  Automatically RELAXing a Goal Model to Cope with Uncertainty , 2012, SSBSE.

[32]  Arthur L. Samuel,et al.  AI, Where It Has Been and Where It Is Going , 1983, IJCAI.

[33]  Ali Saeed,et al.  Test case generation from state machine with OCL constraints using search-based techniques / Aneesa Ali Ali Saeed , 2017 .

[34]  John R. Koza,et al.  Human-competitive results produced by genetic programming , 2010, Genetic Programming and Evolvable Machines.

[35]  Aurora Trinidad Ramirez Pozo,et al.  Search Based Software Engineering: A Review from the Brazilian Symposium on Software Engineering , 2011, 2011 25th Brazilian Symposium on Software Engineering.

[36]  Mark Harman,et al.  GPGPU test suite minimisation: search based software engineering performance improvement using graphics cards , 2013, Empirical Software Engineering.

[37]  Fan Wu,et al.  Mutation-based genetic improvement of software , 2017 .

[38]  Mark Harman,et al.  Provably Optimal and Human-Competitive Results in SBSE for Spectrum Based Fault Localisation , 2013, SSBSE.

[39]  Mark Harman,et al.  Icpc 2007: 15Th Ieee International Conference on Program Comprehension , Proceedings , 2007 .

[40]  Mark Harman,et al.  The relationship between search based software engineering and predictive modeling , 2010, PROMISE '10.

[41]  Claes Wohlin,et al.  Software Project Management: Setting the Context , 2014, Software Project Management in a Changing World.

[42]  Lionel C. Briand,et al.  Generating Test Data from OCL Constraints with Search Techniques , 2013, IEEE Transactions on Software Engineering.

[43]  Barbara Kitchenham,et al.  What's up with software metrics? - A preliminary mapping study , 2010, J. Syst. Softw..

[44]  Mark Harman,et al.  The role of Artificial Intelligence in Software Engineering , 2012, 2012 First International Workshop on Realizing AI Synergies in Software Engineering (RAISE).