How good are your testers? An assessment of testing ability

During our previous research conducted in the Sheffield Software Engineering Observatory [11], we found that test first programmers spent a higher percentage of their time testing than those testing after coding. However as the team allocation was based on subjects ' academic records and their preference, it was unclear if they were simply better testers. Thus this paper proposes two questionnaires to assess the testing ability of subjects, in order to reveal the factors that contribute to the previous findings. Preliminary results show that the testing ability of subjects, as measured by the survey, varies based on their professional skill level.

[1]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[2]  Laurie A. Williams,et al.  Assessing test-driven development at IBM , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[3]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[4]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[5]  Francisco Javier Macias,et al.  Empirical assessment of extreme programming , 2004 .

[6]  Victor R. Basili,et al.  Iterative and incremental developments. a brief history , 2003, Computer.

[7]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[8]  Kent Beck,et al.  Extreme Programming Explained: Embrace Change (2nd Edition) , 2004 .

[9]  Liang Huang,et al.  Empirical Assessment of Test-First Approach , 2006, Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06).

[10]  Michael S. Deutsch,et al.  Software Quality Engineering , 1988 .

[11]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[12]  Mark Pilgrim Test-First Programming , 2004 .

[13]  Alex M. Andrew,et al.  Software Quality Engineering , 1998 .

[14]  Matthias M. Müller,et al.  Experiment about test-first programming , 2002, IEE Proc. Softw..

[15]  Boby George,et al.  A structured experiment of test-driven development , 2004, Inf. Softw. Technol..

[16]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[17]  Marco Torchiano,et al.  On the effectiveness of the test-first approach to programming , 2005, IEEE Transactions on Software Engineering.