Factors with Negative Influence on Software Testing Practice in Spain: A Survey

Software testing is the commonest technique for software quality assurance. It is present in every development project and concentrates a large percentage of effort, there are still not many studies which address the real practice of individuals and organizations. Anyway, practitioners usually agree with the idea that software testing efficiency and effectiveness in their organizations might be improved. Two previous studies in Spain have revealed implemented testing practices in organizations and individual performance of software professionals when designing test cases should be improved. This paper presents the results of a survey designed to know if 23 factors determined by a panel of experts in 2007 may explain this situation of testing practice. Data collected reveal that none of the factors is clearly rejected as a negative influence for testing although some of them are not generally accepted. Exploratory statistical analysis reveals relations between certain pairs of items as well as a new grouping in factors.

[1]  T. Capers Jones,et al.  Estimating software costs , 1998 .

[2]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[3]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[4]  E.P.W.M. van Veenendaal,et al.  Software Testing: A guide to the TMap Approach , 2001 .

[5]  E.P.W.M. van Veenendaal.  Guidelines for testing maturity , 2002 .

[6]  Lindsay Groves,et al.  A survey of software development practices in the New Zealand software industry , 2000, Proceedings 2000 Australian Software Engineering Conference.

[7]  Martin Pol,et al.  Test process improvement: a practical step-by-step guide to structured testing , 1999 .

[8]  Luis Fernández Sanz,et al.  Test case generation, UML, and Eclipse , 2008 .

[9]  James A. Whittaker,et al.  What is software testing? And why is it so hard? , 2000 .

[10]  M.R. Smith,et al.  A survey of software testing practices in alberta , 2004, Canadian Journal of Electrical and Computer Engineering.

[11]  Antonio Amescua,et al.  Ten factors that impede improvement of verification and validation processes in software intensive organizations , 2008 .

[12]  Per Runeson,et al.  A survey of unit testing practices , 2006, IEEE Software.

[13]  Ron Patton,et al.  Software Testing , 2000 .

[14]  Barry Boehm,et al.  An Empirical Study on MBASE and LeanMBASE , 2007, ESEM 2007.

[15]  Luis Fernández Sanz,et al.  Un experimento sobre hábitos de prueba artesanales de software: resultados y conclusiones , 2007 .

[16]  Rolph E. Anderson,et al.  Nederlandse samenvatting en bewerking van 'Multivariate data analysis, 4th Edition, 1995' , 1998 .

[17]  Katja Karhu,et al.  Observing Software Testing Practice from the Viewpoint of Organizations and Knowledge Management , 2007, ESEM 2007.

[18]  Ilene Burnstein,et al.  Practical Software Testing , 2003, Springer Professional Computing.

[19]  Gerard O’Regan,et al.  The Capability Maturity Model , 2002 .

[20]  Luis Fernández Sanz.  Un sondeo sobre la prctica actual de pruebas de software en Espaa , 2005 .

[21]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[22]  Leo van der Aalst,et al.  TMap Next, for result-driven testing , 2006 .

[23]  David B. Martin,et al.  'Good' Organisational Reasons for 'Bad' Software Testing: An Ethnographic Study of Testing in a Small Software Company , 2007, 29th International Conference on Software Engineering (ICSE'07).

[24]  J. Hair.  Multivariate data analysis , 1972 .