Exploring the industry's challenges in software testing: An empirical study

Context Software testing is an important and costly software engineering activity in the industry. Despite the efforts of the software testing research community in the last several decades, variou ...

[1]  Austen Rainer,et al.  Using argumentation theory to analyse software practitioners' defeasible evidence, inference and belief , 2017, Inf. Softw. Technol..

[2]  Vahid Garousi,et al.  What We Know about Testing Embedded Software , 2018, IEEE Software.

[3]  Vahid Garousi,et al.  Introducing Automated GUI Testing and Observing Its Benefits: An Industrial Case Study in the Context of Law-Practice Management Software , 2018, 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[4]  David Lo,et al.  How practitioners perceive the relevance of software engineering research , 2015, ESEC/SIGSOFT FSE.

[5]  Vahid Garousi,et al.  Automated Unit Testing of a SCADA Control Software: An Industrial Case Study Based on Action Research , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[6]  Vahid Garousi,et al.  When to automate software testing? decision support based on system dynamics: an industrial case study , 2014, ICSSP 2014.

[7]  PetersenKai,et al.  Challenges and best practices in industry-academia collaborations in software engineering , 2016 .

[8]  Vahid Garousi,et al.  Challenges and best practices in industry-academia collaborations in software engineering: A systematic literature review , 2016, Inf. Softw. Technol..

[9]  Vahid Garousi,et al.  Characterizing industry-academia collaborations in software engineering: evidence from 101 projects , 2019, Empirical Software Engineering.

[10]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[11]  Vahid Garousi,et al.  A replicated survey of software testing practices in the Canadian province of Alberta: What has changed from 2004 to 2009? , 2010, J. Syst. Softw..

[12]  Andrea Arcuri,et al.  An experience report on applying software testing academic results in industry: we need usable automated test generation , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[13]  Gerardo Canfora,et al.  Testing services and service-centric systems: challenges and opportunities , 2006, IT Professional.

[14]  Ruth Breu,et al.  Integrating a Lightweight Risk Assessment Approach into an Industrial Development Process , 2016, SWQD.

[15]  GarousiVahid,et al.  Software test maturity assessment and test process improvement , 2017 .

[16]  Stanley Presser,et al.  Context Effects on Survey Responses to Questions About Abortion , 1981 .

[17]  F. Strack,et al.  “Order Effects” in Survey Research: Activation and Information Functions of Preceding Questions , 1992 .

[18]  T. Lunsford,et al.  The Research Sample, Part I: Sampling , 1995 .

[19]  Andreia Santos,et al.  Mobile Testing in Software Industry Using Agile: Challenges and Opportunities , 2015, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST).

[20]  Robert L. Glass,et al.  The software-research crisis , 1994, IEEE Software.

[21]  R. Ferber.  Research By Convenience , 1977 .

[22]  Vahid Garousi,et al.  Selecting the Right Topics for Industry-Academia Collaborations in Software Testing: An Experience Report , 2016, 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST).

[23]  Vahid Garousi,et al.  Hybrid software and system development in practice: waterfall, scrum, and beyond , 2017, ICSSP.

[24]  Mary Shaw,et al.  Bridging the Gap: From Research to Practical Advice , 2018, IEEE Software.

[25]  H.-G. Gross,et al.  Testing Challenges of Maritime Safety and Security Systems-of-Systems , 2008, Testing: Academic & Industrial Conference - Practice and Research Techniques (taic part 2008).

[26]  Kai Petersen,et al.  Survey Guidelines in Software Engineering: An Annotated Review , 2016, ESEM.

[27]  Vahid Garousi.  Incorporating real-world industrial testing projects in software testing courses: Opportunities, challenges, and lessons learned , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[28]  Robert L. Glass,et al.  The Standish report: does it really describe a software crisis? , 2006, CACM.

[29]  Vahid Garousi,et al.  Citations, research topics and active countries in software engineering: A bibliometrics study , 2016, Comput. Sci. Rev..

[30]  Per Runeson,et al.  Towards a framework to support large scale sampling in software engineering surveys , 2014, ESEM '14.

[31]  Miguel A. Fernández,et al.  MDE Adoption in Industry: Challenges and Success Criteria , 2009, MoDELS.

[32]  Michael Felderer,et al.  Integrating risk-based testing in industrial test processes , 2013, Software Quality Journal.

[33]  Richard Torkar,et al.  Challenges with Software Verification and Validation Activities in the Space Industry , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[34]  Vahid Garousi,et al.  Software test maturity assessment and test process improvement: A multivocal literature review , 2017, Inf. Softw. Technol..

[35]  Austen Rainer,et al.  Toward the use of blog articles as a source of evidence for software engineering research , 2017, EASE.

[36]  Tor Stålhane,et al.  Challenges and strategies for motivating software testing personnel , 2016, Inf. Softw. Technol..

[37]  Mehrdad Sabetzadeh,et al.  Software Engineering Research and Industry: A Symbiotic Relationship to Foster Impact , 2018, IEEE Software.

[38]  Vahid Garousi,et al.  When and what to automate in software testing? A multi-vocal literature review , 2016, Inf. Softw. Technol..

[39]  Vahid Garousi,et al.  Hybrid Software Development Approaches in Practice: A European Perspective , 2019, IEEE Software.

[40]  Michael Felderer,et al.  Experiences and Challenges of Introducing Risk-Based Testing in an Industrial Project , 2013, SWQD.

[41]  Vahid Garousi,et al.  A Survey of Software Engineering Practices in Turkey (extended version) , 2014, J. Syst. Softw..

[42]  Vahid Garousi,et al.  A survey of software testing practices in Canada , 2013, J. Syst. Softw..

[43]  Vahid Garousi,et al.  Software test-code engineering: A systematic mapping , 2015, Inf. Softw. Technol..

[44]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[45]  George Mathew,et al.  Finding Trends in Software Research , 2016, IEEE Transactions on Software Engineering.

[46]  Guilherme Horta Travassos,et al.  Sampling improvement in software engineering surveys , 2014, ESEM '14.

[47]  Mark Keil,et al.  Understanding software project risk: a cluster analysis , 2004, Inf. Manag..

[48]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[49]  Jeffrey C. Carver,et al.  Industry-Academia Collaboration in Software Engineering , 2018, IEEE Softw..

[50]  Thomas Arts,et al.  Agile Collaborative Research: Action Principles for Industry-Academia Collaboration , 2011, IEEE Software.

[51]  Vahid Garousi,et al.  Industry–academia collaborations in software testing: experience and success stories from Canada and Turkey , 2016, Software Quality Journal.

[52]  Jane Wardle,et al.  Evaluation and Design of Nutrition Knowledge Measures , 2000 .

[53]  Vahid Garousi,et al.  What industry wants from academia in software testing?: Hearing practitioners' opinions , 2017, EASE.

[54]  Mary Jean Harrold,et al.  Testing: a roadmap , 2000, ICSE '00.

[55]  Daniela E. Damian,et al.  Addressing the challenges of software industry globalization: the workshop on global software development , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[56]  Vahid Garousi.  An Open Modern Software Testing Laboratory Courseware – An Experience Report , 2010, 2010 23rd IEEE Conference on Software Engineering Education and Training.

[57]  Mehrdad Sabetzadeh,et al.  The Case for Context-Driven Software Engineering Research: Generalizability Is Overrated , 2017, IEEE Softw..

[58]  Chris Verhoef,et al.  The rise and fall of the Chaos report figures , 2010, IEEE Software.

[59]  Vahid Garousi,et al.  Industry-academia collaborations in software engineering: An empirical analysis of challenges, patterns and anti-patterns in research projects , 2017, EASE.

[60]  Michael Felderer,et al.  Estimating the Cost and Benefit of Model-Based Testing: A Decision Support Procedure for the Application of Model-Based Testing in Industry , 2015, 2015 41st Euromicro Conference on Software Engineering and Advanced Applications.

[61]  Vahid Garousi,et al.  A systematic mapping study of web application testing , 2013, Inf. Softw. Technol..

[62]  Vahid Garousi,et al.  Worlds Apart: Industrial and Academic Focus Areas in Software Testing , 2017, IEEE Software.

[63]  Vahid Garousi,et al.  Test Automation: Not Just for Test Execution , 2017, IEEE Software.

[64]  Vahid Garousi,et al.  The need for multivocal literature reviews in software engineering: complementing systematic literature reviews with grey literature , 2016, EASE.

[65]  Vahid Garousi,et al.  Current State of the Software Testing Education in North American Academia and Some Recommendations for the New Educators , 2010, 2010 23rd IEEE Conference on Software Engineering Education and Training.

[66]  Kai Petersen,et al.  Action research as a model for industry-academia collaboration in the software engineering context , 2014, WISE@ASE.

[67]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[68]  S. J. Lamprecht,et al.  Models for technology research collaboration between industry and academia in South Africa , 2012, Proceedings of the 2012 4th IEEE Software Engineering Colloquium (SE).

[69]  Michael Felderer,et al.  Software Quality Assurance During Implementation: Results of a Survey in Software Houses from Germany, Austria and Switzerland , 2017, SWQD.