Selecting the Right Topics for Industry-Academia Collaborations in Software Testing: An Experience Report

The global software industry and the Software Engineering (SE) academia are two large communities. However, unfortunately, the level of joint industry-academia collaborations (IAC) in SE is still relatively very low, compared to the amount of activity in each of the two communities. Selecting the right topic for a new IAC has been reported to be challenging and often a deal-maker or-breaker for the start of IACs. Motivated by the above need, the goal of this paper is to propose experience-based guidelines from our 10+ software testing IACs in the past several years in Canada and Turkey to effectively and efficiently select right topics for IACs in software testing (also easily generalizable to other areas of SE), for the benefit of SE researchers and practitioners in starting new IACs. The experience and evidence supporting the guidelines in this paper are drawn from the authors' past projects and also seven on-going software-testing projects in the context of a large Turkish software and systems company. The topic-selection process has involved interaction with company representatives in the form of both multiple group discussions and separate face-to-face meetings while utilizing grounded-theory to find (converge to) topics which would be 'interesting' and useful from both industrial and academic perspectives. To increase the success of our topic selection process, we also utilized two other sources of information from the literature: (1) a set of four fitness criteria for topic selection in industry experiments, and (2) challenges and best practices for IAC, specific to project inception, as synthesized in a recent systematic literature review. We believe the results of this paper would be helpful for other researchers and practitioners not only in software testing but also in software engineering in general in increasing their chances of success in project inception and topic selection phase.

[1]  Natalia Juristo Juzgado,et al.  Topic selection in industry experiments , 2014, CESI 2014.

[2]  Wasif Afzal,et al.  Software test process improvement approaches: A systematic literature review and an industrial case study , 2016, J. Syst. Softw..

[3]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[4]  Vahid Garousi,et al.  When to automate software testing? decision support based on system dynamics: an industrial case study , 2014, ICSSP 2014.

[5]  Per Runeson,et al.  The 4+1 view model of industry--academia collaboration , 2014, WISE@ASE.

[6]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[7]  S. Ankrah,et al.  Universities-Industry Collaboration: A Systematic Review , 2015 .

[8]  David Lo,et al.  How practitioners perceive the relevance of software engineering research , 2015, ESEC/SIGSOFT FSE.

[9]  Vahid Garousi,et al.  Automated Unit Testing of a SCADA Control Software: An Industrial Case Study Based on Action Research , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[10]  Maria Teresa Baldassarre,et al.  Empirical studies for innovation dissemination: ten years of experience , 2013, EASE '13.

[11]  Eduard Paul Enoiu,et al.  Enablers and impediments for collaborative research in software testing: an empirical exploration , 2014, WISE@ASE.

[12]  Vahid Garousi,et al.  When to automate software testing? A decision‐support approach based on process simulation , 2016, J. Softw. Evol. Process..

[13]  Nuno Silva,et al.  10 Years of ISVV: What's Next? , 2012, 2012 IEEE 23rd International Symposium on Software Reliability Engineering Workshops.

[14]  Vahid Garousi,et al.  A Search-Based Approach for Cost-Effective Software Test Automation Decision Support and an Industrial Case Study , 2014, 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops.

[15]  Lefteris Angelis,et al.  The Success Factors Powering Industry-Academia Collaboration , 2012, IEEE Software.

[16]  Sridhar Chimalakonda,et al.  Moving Beyond: Insights from 1st International Workshop on Software Engineering Research and Industrial Practices (SER&IPs 2014) , 2015, SOEN.

[17]  Lionel Briand,et al.  Embracing the Engineering Side of Software Engineering , 2012, IEEE Softw..

[18]  Everett M. Rogers,et al.  Communication Networks: Toward a New Paradigm for Research , 1980 .

[19]  Ali Kanso,et al.  Foundations for long-term collaborative research , 2014, WISE@ASE.

[20]  A. Salter,et al.  Academic Engagement and Commercialisation: A Review of the Literature on University-Industry Relations , 2012 .

[21]  Vahid Garousi,et al.  An Open-Source Tool for Automated Generation of Black-Box xUnit Test Code and Its Industrial Evaluation , 2010, TAIC PART.

[22]  Kai Petersen,et al.  Finding relevant research solutions for practical problems: the serp taxonomy architecture , 2014, WISE@ASE.

[23]  Andrew Begel,et al.  Analyze this! 145 questions for data scientists in software engineering , 2013, ICSE.

[24]  Vahid Garousi,et al.  Introducing Automated Environment Configuration Testing in an Industrial Setting , 2010, SEKE.

[25]  Claes Wohlin Empirical software engineering research with industry: Top 10 challenges , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).