Tester Experience: Concept, Issues and Definition

Testing is a very essential activity for software development. It is the act of executing a software product in order to validate whether it behaves as intended and identify possible malfunctions. Studies have shown that testing makes up more than 50% of the development cost. Besides, much effort and emphasis have now been placed on tasks related to automation with the purpose of reducing cost and the participation of the human element in software testing activities. Testing is still a human-based activity. Therefore, efficient ways of testing software products for quality assurance will require a better and more comprehensive understanding of testers' feelings, perceptions and motivations, in this paper referred to as Tester Experience (TX). Thus, the better the tester's experience during the software testing process, the better the result. TX can be defined as a means of capturing how testers think and feel about their activities within the software testing environment, with the assumption that an improvement of the tester's experience has positive impact on quality assurance. This paper motivates the importance of TX, highlights related approaches from other domains, proposes a definition based on similar concepts in other domains, and proposes future research activities.

[1]  Fabian Fagerholm,et al.  Developer experience: Concept and definition , 2012, 2012 International Conference on Software and System Process (ICSSP).

[2]  Sira Vegas,et al.  A Characterisation Schema for Software Testing Techniques , 2005, Empirical Software Engineering.

[3]  Susumu Saito,et al.  Ergonomics of human-system interaction , 1994 .

[4]  Risa B. Hyman.  Creative chaos in high-performance teams: an experience report , 1993, CACM.

[5]  Audris Mockus,et al.  Organizational volatility and its effects on software defects , 2010, FSE '10.

[6]  C. Meyer,et al.  Understanding customer experience. , 2007, Harvard business review.

[7]  John Grundy,et al.  A Preliminary Survey of Factors Affecting Software Testers , 2014, 2014 23rd Australian Software Engineering Conference.

[8]  E. E. Grant,et al.  Exploratory experimental studies comparing online and offline programming performance , 1968, CACM.

[9]  Stewart Hase.  Measuring organisational capability: beyond competence , 2000 .

[10]  Katherine N. Lemon,et al.  Customer Experience Creation: Determinants, Dynamics and Management Strategies , 2009 .

[11]  Robin S. Poston,et al.  Alignment within the software development unit: Assessing structural and relational dimensions between developers and testers , 2011, J. Strateg. Inf. Syst..

[12]  E. Hilgard.  The trilogy of mind: cognition, affection, and conation. , 1980, Journal of the history of the behavioral sciences.

[13]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[14]  Rudolf Ramler,et al.  The Role of Experience in Software Testing Practice , 2008, 2008 34th Euromicro Conference Software Engineering and Advanced Applications.

[16]  Richa Sharma,et al.  Development Platforms for Mobile Applications : Status and Trends , 2012 .

[17]  George S. Day.  ¿Es real? ¿Podemos ganar? ¿Vale la pena hacerlo?: la gestión sel riesgo y las recompensas en un portafolio de innovación , 2007 .

[18]  John Grundy,et al.  Performance appraisal of software testers , 2014, Inf. Softw. Technol..

[19]  Bernd H. Schmitt,et al.  Brand Experience: What is It? How is it Measured? Does it Affect Loyalty? , 2009 .

[20]  John C. Grundy,et al.  An Empirical Investigation of Personality Traits of Software Testers , 2015, 2015 IEEE/ACM 8th International Workshop on Cooperative and Human Aspects of Software Engineering.

[21]  Barry W. Boehm,et al.  Software Defect Reduction Top 10 List , 2001, Computer.

[22]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[23]  Tom DeMarco,et al.  Programmer performance and the effects of the workplace , 1985, ICSE '85.

[24]  Monica J. Garfield,et al.  Managing conflict in software testing , 2004, CACM.

[25]  David J. Panzl.  Test procedures: A new approach to software verification , 1976, ICSE '76.

[26]  Pilar Rodríguez Marín,et al.  The Interpretation and Legitimization of Values in Agile's Organizing Vision , 2012, ECIS.

[27]  John Grundy,et al.  A Preliminary Study on Factors Affecting Software Testing Team Performance , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[28]  Sandra Slaughter,et al.  Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects , 2006, Manag. Sci..

[29]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[30]  Pekka Abrahamsson,et al.  Performance Alignment Work: How software developers experience the continuous adaptation of team performance in Lean and Agile environments , 2015, Inf. Softw. Technol..

[31]  A. Palmer.  Customer experience management: a critical review of an emerging idea , 2010 .