SERP-test: a taxonomy for supporting industry–academia communication

This paper presents the construction and evaluation of SERP-test, a taxonomy aimed to improve communication between researchers and practitioners in the area of software testing. SERP-test can be utilized for direct communication in industry academia collaborations. It may also facilitate indirect communication between practitioners adopting software engineering research and researchers who are striving for industry relevance. SERP-test was constructed through a systematic and goal-oriented approach which included literature reviews and interviews with practitioners and researchers. SERP-test was evaluated through an online survey and by utilizing it in an industry–academia collaboration project. SERP-test comprises four facets along which both research contributions and practical challenges may be classified: Intervention, Scope, Effect target and Context constraints. This paper explains the available categories for each of these facets (i.e., their definitions and rationales) and presents examples of categorized entities. Several tasks may benefit from SERP-test, such as formulating research goals from a problem perspective, describing practical challenges in a researchable fashion, analyzing primary studies in a literature review, or identifying relevant points of comparison and generalization of research.

[1]  Ina Schieferdecker,et al.  A taxonomy of risk-based testing , 2014, International Journal on Software Tools for Technology Transfer.

[2]  Klaus Pohl,et al.  Agreeing Upon SOA Terminology - Lessons Learned , 2009, Future Internet Assembly.

[3]  Prabhakar Raghavan,et al.  Using Taxonomy, Discriminants, and Signatures for Navigating in Text Databases , 1997, VLDB.

[4]  Lionel C. Briand,et al.  A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation , 2010, IEEE Transactions on Software Engineering.

[5]  Per Runeson,et al.  A survey of unit testing practices , 2006, IEEE Software.

[6]  Claes Wohlin Empirical software engineering research with industry: Top 10 challenges , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).

[7]  Natalia Juristo Juzgado,et al.  Maturing Software Engineering Knowledge through Classifications: A Case Study on Unit Testing Techniques , 2009, IEEE Transactions on Software Engineering.

[8]  Ricardo de Almeida Falbo,et al.  Ontologies in Software Testing: A Systematic Literature Review , 2013, ONTOBRAS.

[9]  Natalia Juristo Juzgado,et al.  In Search of What We Experimentally Know about Unit Testing , 2006, IEEE Software.

[10]  Michael P. Hagerty,et al.  Development of Software. , 1972 .

[11]  Per Runeson,et al.  Get the cogs in synch: time horizon aspects of industry--academia collaboration , 2014, WISE@ASE.

[12]  Alain Abran,et al.  Guide to the Software Engineering Body of Knowledge : 2004 Version , 2005 .

[13]  Christian Reinisch Academia-industry collaboration: ways to a strong and beneficial partnership , 2014, WISE@ASE.

[14]  Adoption Indirect Effects in Evidential Assessment: A Case Study on Regression Test Technology Adoption , 2012 .

[15]  Wei Zhao,et al.  A Framework of Testing as a Service , 2009, 2009 International Conference on Management and Service Science.

[16]  Tharam S. Dillon,et al.  Ieee Transactions on Knowledge and Data Engineering, Manuscript Id 1 Development of a Software Engineering Ontology for Multi-site Software Development , 2022 .

[17]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[18]  Alain Abran,et al.  Software engineering ontology : a development methodology , 2004 .

[19]  A Straw,et al.  Guide to the Software Engineering Body of Knowledge , 1998 .

[20]  Claes Wohlin,et al.  An empirically based terminology and taxonomy for global software engineering , 2014, Empirical Software Engineering.

[21]  Tony Gorschek,et al.  A taxonomy for requirements engineering and software test alignment , 2014, ACM Trans. Softw. Eng. Methodol..

[22]  Ricardo Britto,et al.  Knowledge Classification for Supporting Effort Estimation in Global Software Engineering Projects , 2015 .

[23]  Leonardo Mariani,et al.  A Fault Taxonomy for Component-Based Software , 2003, TACoS.

[24]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[25]  Miguel-Ángel Sicilia,et al.  Ontologies of Software Artifacts and Activities: Resource Annotation and Application to Learning Technologies , 2005, SEKE.

[26]  Klaas Sikkel,et al.  Generalizing by similarity: Lessons learnt from industrial case studies , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).

[27]  Hong Zhu,et al.  A Framework for Service-Oriented Testing of Web Services , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[28]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[29]  Muhammad Ali Babar,et al.  Conducting empirical studies in industry: Balancing rigor and relevance , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).

[30]  H. D. Rombach,et al.  THE EXPERIENCE FACTORY , 1999 .

[31]  Thomas Arts,et al.  Agile Collaborative Research: Action Principles for Industry-Academia Collaboration , 2011, IEEE Software.

[32]  Giancarlo Succi,et al.  The Experience Factory , 2014 .

[33]  Marvin V. Zelkowitz,et al.  Maintaining software with a security perspective , 2002, International Conference on Software Maintenance, 2002. Proceedings..

[34]  Rajesh Subramanyan,et al.  A survey on model-based testing approaches: a systematic review , 2007, WEASELTech '07.

[35]  Ilene Burnstein,et al.  Practical Software Testing: A Process-Oriented Approach , 2003 .

[36]  Standard Glossary of Terms used in Software Testing Version 3 . 1 Foundation Terms , .

[37]  Walid Maalej,et al.  Applications of Ontologies in Collaborative Software Development , 2010, Collaborative Software Engineering.

[38]  Krassie Petrova,et al.  Bridging the Research-Practice Gap in Requirements Engineering through Effective Teaching and Peer Learning , 2009, 2009 Sixth International Conference on Information Technology: New Generations.

[39]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[40]  Guilherme Horta Travassos,et al.  Supporting the Combined Selection of Model-Based Testing Techniques , 2014, IEEE Transactions on Software Engineering.

[41]  Sussy Bayona Oré,et al.  Critical success factors taxonomy for software process deployment , 2012, Software Quality Journal.

[42]  Wolfgang Hesse,et al.  Ontologies in the Software Engineering Process , 2005, EAI.

[43]  Claes Wohlin,et al.  Context in industrial software engineering research , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[44]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[45]  Kai Petersen,et al.  Finding relevant research solutions for practical problems: the serp taxonomy architecture , 2014, WISE@ASE.

[46]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[47]  Andrej Krajnc,et al.  Taxonomy of static code analysis tools , 2010, The 33rd International Convention MIPRO.

[48]  A. Jefferson Offutt,et al.  Introduction to Software Testing , 2008 .

[49]  Victor R. Basili,et al.  The software engineering laboratory - an operational software experience factory , 1992, International Conference on Software Engineering.

[50]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[51]  Hareton K. N. Leung,et al.  A survey of combinatorial testing , 2011, CSUR.

[52]  Kai Petersen,et al.  Mapping software testing practice with software testing research — SERP-test taxonomy , 2015, 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[53]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[54]  José Ramón Hilera,et al.  Using Ontologies in Software Engineering and Technology , 2006, Ontologies for Software Engineering and Software Technology.

[55]  Guilherme Horta Travassos,et al.  Model-based testing approaches selection for software projects , 2009, Inf. Softw. Technol..

[56]  Elisa Yumi Nakagawa,et al.  Towards the Establishment of an Ontology of Software Testing , 2006, SEKE.