Improving software testing by observing practice

The objective of this qualitative study was to understand the complex practice of software testing, and based on this knowledge, to develop process improvement propositions that could concurrently reduce development and testing costs and improve software quality. First, a survey of testing practices was onducted and 26 organizational units (OUs) were interviewed. From this sample, five OUs were further selected for an in-depth case study. The study used grounded theory as its research method and the data was collected from 41 theme-based interviews. The analysis yielded improvement propositions that included enhanced testability of software components, efficient communication and interaction between development and testing, early involvement of testing, and risk-based testing. The connective and central improvement proposition was that testing ought to adapt to the business orientation of the OU. Other propositions were integrated around this central proposition. The results of this study can be used in improving development and testing processes.

[1]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[2]  Pekka Abrahamsson,et al.  Commitment development in software process improvement: critical misconceptions , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[3]  Jan Pries-Heje,et al.  How Internet software companies negotiate quality , 2001, Computer.

[4]  Sandeep Purao,et al.  Going beyond the Blueprint: Unravelling the Complex Reality of Software Architectures , 2005, ECIS.

[5]  Balaji Rajagopalan,et al.  Information flow parameters for managing organizational processes , 2003, CACM.

[6]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[7]  Ossi Taipale,et al.  Factors affecting software testing time schedule , 2006, Australian Software Engineering Conference (ASWEC'06).

[8]  Linda M. Northrop.  Software Product Lines: Reuse That Makes Business Sense , 2006, ASWEC.

[9]  Béatrix Barafort,et al.  Benefits Resulting from the Combined Use of ISO/IEC 15504 with the Information Technology Infrastructure Library (ITIL) , 2002, PROFES.

[10]  Monica J. Garfield,et al.  Managing conflict in software testing , 2004, CACM.

[11]  Leon J. Osterweil,et al.  Software Processes Are Software Too, Revisited: An Invited Talk on the Most Influential Paper of ICSE 9 , 1997, Proceedings of the (19th) International Conference on Software Engineering.

[12]  Guy Paré,et al.  Using case study research to build theories of IT implementation , 1997 .

[13]  Ståle Amland Hulda Garborgsv.  Risk Based Testing and Metrics Risk Analysis Fundamentals and Metrics for software testing including a Financial Application case study , 2002 .

[14]  Richard Torkar,et al.  A survey on testing and reuse , 2003, Proceedings 2003 Symposium on Security and Privacy.

[15]  Dorothy R. Graham,et al.  Requirements and Testing: Seven Missing-Link Myths , 2002, IEEE Softw..

[16]  Ståle Amland.  Risk-based testing: : Risk analysis fundamentals and metrics for software testing including a financial application case study , 2000, J. Syst. Softw..

[17]  Craig R. Carter,et al.  Purchasing's Role in Environmental Management: Cross-Functional Development of Grounded Theory , 2001 .

[18]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[19]  Mayuram S. Krishnan,et al.  Evaluating the cost of software quality , 1998, CACM.

[20]  Sandra Slaughter,et al.  Process maturity and software quality: a field study , 2000, ICIS.

[21]  Kai-Yuan Cai,et al.  Adaptive testing of software components , 2005, SAC '05.

[22]  Mary Jean Harrold,et al.  Testing: a roadmap , 2000, ICSE '00.

[23]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[24]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[25]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[26]  Pamela Jordan.  Basics of qualitative research: Grounded theory procedures and techniques , 1994 .