Towards Recognizing the Emotions of Developers Using Biometrics: The Design of a Field Study

During their daily working activities, developers experience a wide range of emotions that are known to impact their personal wellbeing and, consequently, their work performance. As such, being aware of own and collaborators' emotions is crucial to enhance the collaborative development process. In this paper we present the design of a field study aimed at i) assessing the feasibility of emotion detection using non-invasive biometric sensors and ii) investigating the correlation between daily working activities and positive/negative emotions experienced by software developers. The long-term goal of our research is to provide recommendations to improve developers' mental well-being and productivity based on the emotions they experience.

[1]  S. Murugappan,et al.  Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT) , 2013, 2013 IEEE 9th International Colloquium on Signal Processing and its Applications.

[2]  Thomas D. LaToza,et al.  Maintaining mental models: a study of developer work habits , 2006, ICSE.

[3]  Mika Mäntylä,et al.  Mining Valence, Arousal, and Dominance - Possibilities for Detecting Burnout and Productivity? , 2016, 2016 IEEE/ACM 13th Working Conference on Mining Software Repositories (MSR).

[4]  Thomas Fritz,et al.  Design Recommendations for Self-Monitoring in the Workplace , 2017, Proc. ACM Hum. Comput. Interact..

[5]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[6]  Thierry Pun,et al.  Multimodal Emotion Recognition in Response to Videos , 2012, IEEE Transactions on Affective Computing.

[7]  Pekka Abrahamsson,et al.  Do feelings matter? On the correlation of affects and the self‐assessed productivity in software engineering , 2014, J. Softw. Evol. Process..

[8]  Thomas Fritz,et al.  Stuck and Frustrated or in Flow and Happy: Sensing Developers' Emotions and Progress , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[9]  Hugo Silva,et al.  Multimodal biosignal sensor data handling for emotion recognition , 2011, 2011 IEEE SENSORS Proceedings.

[10]  Nicole Novielli,et al.  Emotion detection using noninvasive low cost sensors , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[11]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[12]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[13]  Bonita Sharif,et al.  On the use of eye tracking in software traceability , 2011, TEFSE '11.

[14]  Andrew Begel,et al.  Using psycho-physiological measures to assess task difficulty in software development , 2014, ICSE.

[15]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[16]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Pekka Abrahamsson,et al.  Consequences of Unhappiness while Developing Software , 2017, 2017 IEEE/ACM 2nd International Workshop on Emotion Awareness in Software Engineering (SEmotion).

[18]  Nicole Novielli,et al.  Bootstrapping a Lexicon for Emotional Arousal in Software Engineering , 2017, 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR).

[19]  Miikka Kuutila,et al.  Using experience sampling to link software repositories with emotions and work well-being , 2018, ESEM.

[20]  Fethi Bereksi-Reguig,et al.  Negative emotion detection using EMG signal , 2014, 2014 International Conference on Control, Decision and Information Technologies (CoDIT).

[21]  Thomas Fritz,et al.  Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors , 2018, CHI.

[22]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[23]  Ali E. Akgün,et al.  Antecedents and Results of Emotional Capability in Software Development Project Teams , 2011 .

[24]  J. Russell A circumplex model of affect. , 1980 .

[25]  Minhaz Fahim Zibran,et al.  DEVA: sensing emotions in the valence arousal space in software engineering text , 2018, SAC.

[26]  Thomas Zimmermann,et al.  Supplementary Material For The Paper "Design Recommendations For Self-Monitoring In The Workplace: Studies In Software Development" , 2017 .