Effects of Automated Competency Evaluation on Software Engineers’ Emotions and Motivation: A Case Study

Software development consulting companies must be able to select the best suited developers for their clients. A method of doing this is through competence evaluation. Sigma IT Consulting uses manual methods consisting of heavy documentation for employees to fill in their competence. Problems such as data inconsistencies in documentation of competency might cause difficulties for managers while making decisions to assign right developer to the right job. Such difficulties may lead to frustration in managers and negatively affect their decision-making process. Similarly, developers might feel themselves under pressure always having to fill in the competency documents whenever the manager makes requests among all the tasks the developers are busy with and feeling under pressure might have negative effects on developers’ performance. Researchers have shown that negative emotions lead to poor software development performance, while positive emotions improve developers’ performance. Competency evaluation is an integral part of the daily routine at Sigma IT Consulting. Therefore, negative effects of competency sheets on developers and managers cannot be tolerated. In this case study, having investigated how competency is evaluated at Sigma IT and what employees think about competency evaluation in general, we implemented a web-based competency evaluation platform. When supplemented with qualitative data, the results of the Self-Assessment Manikin (SAM) and Intrinsic Motivation Inventory (IMI) we conducted show that automation of competency evaluation as a web-based platform has positive effects on developers’ and managers’ emotions and motivations. Interviews we conducted with developers and managers also include their positive thoughts about automation of the competency evaluation.

[1]  Helen Sharp,et al.  Motivation in Software Engineering: A systematic literature review , 2008, Inf. Softw. Technol..

[2]  R. Ryan,et al.  Intrinsic motivation and the effects of self-consciousness, self-awareness, and ego-involvement: An investigation of internally controlling styles , 1985 .

[3]  Ted Boren,et al.  Thinking aloud: reconciling theory and practice , 2000 .

[4]  Sven Apel,et al.  Measuring programming experience , 2012, 2012 20th IEEE International Conference on Program Comprehension (ICPC).

[5]  R. Bornstein,et al.  Stimulus recognition and the mere exposure effect. , 1992, Journal of personality and social psychology.

[6]  C. Prahalad,et al.  The core competence of the corporation’, Harvard Business Review, Vol. pp. . , 1990 .

[7]  Thomas Fritz,et al.  Stuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[8]  C. Prahalad,et al.  The Core Competence of the Corporation , 1990 .

[9]  Pekka Abrahamsson,et al.  Understanding the affect of developers: theoretical background and guidelines for psychoempirical software engineering , 2015, SSE@SIGSOFT FSE.

[10]  Pekka Abrahamsson,et al.  Software Developers, Moods, Emotions, and Performance , 2014, IEEE Software.

[11]  Gunnar R. Bergersen,et al.  Programming Skill, Knowledge, and Working Memory Among Professional Software Developers from an Investment Theory Perspective , 2011 .

[12]  Sven Apel,et al.  Measuring and modeling programming experience , 2013, Empirical Software Engineering.

[13]  Stan Franklin,et al.  Motivations, Values and Emotions: 3 sides of the same coin , 2006 .

[14]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[15]  Helen Sharp,et al.  Models of motivation in software engineering , 2009, Inf. Softw. Technol..

[16]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[17]  John A. van der Poll,et al.  Accommodating Soft Skills in Software Project Management , 2005 .

[18]  Frederick Toates,et al.  Models of Motivation , 1983 .