An empirical study of the effects of personality on software testing

The effectiveness of testing is a major determinant of software quality. It is believed that individual testers vary in their effectiveness, but so far the factors contributing to this variation have not been well studied. In this study, we examined whether personality traits, as described by the five-factor model, affect performance on a software testing task. ICT students were given a small software testing task at which their effectiveness was assessed using several different criteria, including bug location rate, weighted fault density, and bug report quality. Their personality was assessed using the NEO PI-3 personality questionnaire. We then compared testing performance according to individual and aggregate measures against different five-factor personality traits. Several weak correlations between two of these personality traits, extraversion and conscientiousness, and testing effectiveness were found.

[1]  Ian Sommerville,et al.  Testing in the Wild: The Social and Organisational Dimensions of Real World Practice , 2009, Computer Supported Cooperative Work (CSCW).

[2]  Diane B. Walz,et al.  Identifying Exceptional Application Software Developers: A Comparison of Students and Professionals , 2003, Commun. Assoc. Inf. Syst..

[3]  Shari Lawrence Pfleeger,et al.  Software metrics (2nd ed.): a rigorous and practical approach , 1997 .

[4]  J. M. Digman,et al.  Factors In The Natural Language Of Personality: Re-Analysis, Comparison, And Interpretation Of Six Major Studies. , 1981, Multivariate behavioral research.

[5]  Dianne Hall,et al.  What makes a good programmer? , 2006, CACM.

[6]  John R. Harrald,et al.  Predicting Debugging Successs: An Investigation of the Relationship between Learning Styles, Personality Traits, and Computer Program Debugging , 2009 .

[7]  Elaine J. Weyuker,et al.  Clearing a Career Path for Software Testers , 2000, IEEE Softw..

[8]  Marnie L. Hutcheson,et al.  Software testing fundamentals - methods and metrics , 2003 .

[9]  Rudolf Ramler,et al.  The Role of Experience in Software Testing Practice , 2008, 2008 34th Euromicro Conference Software Engineering and Advanced Applications.

[10]  CapretzLuiz Fernando,et al.  Making Sense of Software Development and Personality Types , 2010 .

[11]  David Greathead,et al.  Does personality matter?: an analysis of code-review ability , 2007, CACM.

[12]  Aamer Nadeem,et al.  An empirical evaluation of the influence of human personality on exploratory software testing , 2009, 2009 IEEE 13th International Multitopic Conference.

[13]  Shayma Alkobaisi,et al.  Learning & Personality Types: A Case Study of a Software Design Course , 2010, J. Inf. Technol. Educ. Innov. Pract..

[14]  Luiz Fernando Capretz,et al.  Making Sense of Software Development and Personality Types , 2010, IT Professional.

[15]  D. McAdams,et al.  The Person: An Integrated Introduction to Personality Psychology , 2000 .

[16]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[17]  Mika V. Mäntylä,et al.  How do testers do it? An exploratory study on manual testing practices , 2009, ESEM 2009.

[18]  Wilhelm Hasselbring,et al.  Research issues in software fault categorization , 2007, SOEN.

[19]  Michael Lyons.  The DP psyche , 1985 .

[20]  P. Costa,et al.  NEO inventories for the NEO Personality Inventory-3 (NEO-PI-3), NEO Five-Factor Inventory-3 (NEO-FFI-3), NEO Personality Inventory-Revised (NEO PI-R) : professional manual , 2010 .

[21]  Malcolm James Ree,et al.  Intelligence Is the Best Predictor of Job Performance , 1992 .

[22]  John C. Grundy,et al.  Lessons learned from conducting industry surveys in software testing , 2013, 2013 1st International Workshop on Conducting Empirical Studies in Industry (CESI).

[23]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .

[24]  David C. McClelland,et al.  Intelligence Is Not the Best Predictor of Job Performance , 1993 .

[25]  Hina Shah,et al.  Studying human and social aspects of testing in a service-based software company: case study , 2010, CHASE '10.

[26]  Cem Kaner,et al.  Measuring the Effectiveness of Software Testers , 2003 .

[27]  Luiz Fernando Capretz.  Personality types in software engineering , 2003, Int. J. Hum. Comput. Stud..

[28]  Luiz Fernando Capretz,et al.  Why do we need personality diversity in software engineering? , 2010, SOEN.

[29]  Lefteris Angelis,et al.  Links between the personalities, views and attitudes of software engineers , 2010, Inf. Softw. Technol..

[30]  Paul A. Watters,et al.  Statistics in a nutshell , 2008 .

[31]  John Grundy,et al.  A Preliminary Study on Factors Affecting Software Testing Team Performance , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[32]  A. Furnham.  The big five versus the big four: the relationship between the Myers-Briggs Type Indicator (MBTI) and NEO-PI five factor model of personality , 1996 .

[33]  R. R. Abidin.  Psychological Assessment Resources , 1995 .

[34]  E.P.W.M. van Veenendaal,et al.  Software Testing: A guide to the TMap Approach , 2001 .

[35]  C. M. Bush,et al.  In search of the perfect programmer , 1985 .

[36]  David B. Martin,et al.  'Good' Organisational Reasons for 'Bad' Software Testing: An Ethnographic Study of Testing in a Small Software Company , 2007, 29th International Conference on Software Engineering (ICSE'07).

[37]  Cem Kaner,et al.  Don''t Use Bug Counts to Measure Testers , 1999 .

[38]  David Greathead.  MBTI Personality Type and Student Code Comprehension Skill , 2008, PPIG.

[39]  Phillip G. Armour.  The unconscious art of software testing , 2005, CACM.

[40]  G. Boyle.  Myers‐Briggs Type Indicator (MBTI): Some Psychometric Limitations , 1995 .

[41]  David P. Darcy,et al.  Exploring Individual Characteristics and Programming Performance: Implications for Programmer Selection , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[42]  A. S. Sodiya,et al.  An Improved Assessment of Personality Traits in Software Engineering , 2007 .