Expressions of Sentiments during Code Reviews: Male vs. Female

As most of the software development organizations are male-dominated, many female developers encounter negative workplace experiences and report feeling like they “do not belong”. Exposures to discriminatory expletives or negative critiques from their male colleagues may further exacerbate those feelings. The primary goal of this study is to identify the differences in expressions of sentiments between male and female developers during various software engineering tasks. On this goal, we mined the code review repositories of six popular open source projects. We used a semi-automated approach leveraging the name as well as multiple social networks to identify the gender of a developer. Using SentiSE, a customized and state-of-the-art sentiment analysis tool for the software engineering domain, we classify each communication as negative, positive, or neutral. We also compute the frequencies of sentiment words, emoticons, and expletives used by each developer.Our results suggest that the likelihood of using sentiment words, emoticons, and expletives during code reviews varies based on the gender of a developer, as females are significantly less likely to express sentiments than males. Although female developers were more neutral to their male colleagues than to another female, male developers from three out of the six projects were not only writing more frequent negative comments but also withholding positive encouragements from their female counterparts. Our results provide empirical evidence of another factor behind the negative work place experiences encountered by the female developers that may be contributing to the diminishing number of females in the SE industry.

[1]  Ronen Feldman,et al.  Techniques and applications for sentiment analysis , 2013, CACM.

[2]  Michele Marchesi,et al.  Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time , 2015, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories.

[3]  Alecia Wolf,et al.  Emotional Expression Online: Gender Differences in Emoticon Use , 2000, Cyberpsychology Behav. Soc. Netw..

[4]  A. Vítores,et al.  The trouble with ‘women in computing’: a critical examination of the deployment of research on the gender gap in computer science , 2016 .

[5]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[6]  Alberto Bacchelli,et al.  Expectations, outcomes, and challenges of modern code review , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[7]  A. Manstead,et al.  The relation between gender and emotion in different cultures , 2000 .

[8]  Premkumar T. Devanbu,et al.  Gender and Tenure Diversity in GitHub Teams , 2015, CHI.

[9]  Allan Fisher,et al.  Unlocking the Clubhouse : Women in Computing by Allan Fisher , 2015 .

[10]  Emerson Murphy-Hill,et al.  Gender differences and bias in open source: pull request acceptance of women versus men , 2017, PeerJ Comput. Sci..

[11]  I. R. Pierce Emotion and Personality, Vol. I: Psychological Aspects , 1961 .

[12]  Alice E. Marwick Silicon Valley and the Social Media Industry , 2018 .

[13]  Michael Gertz,et al.  Mining email social networks , 2006, MSR '06.

[14]  Harvie Ramsay,et al.  The status of women in the UK IT industry: an empirical study , 1999 .

[15]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[16]  Michele Marchesi,et al.  How diverse is your team? Investigating gender and nationality diversity in GitHub teams , 2017, Journal of Software Engineering Research and Development.

[17]  Tuomo Kakkonen,et al.  Investigating the Role of Emotion-Based Features in Author Gender Classification of Text , 2014, CICLing.

[18]  V. Klerk Expletives: Men only? , 1991 .

[19]  Anindya Iqbal,et al.  SentiCR: A customized sentiment analysis tool for code review interactions , 2017, 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE).

[20]  Bernd Brügge,et al.  Towards emotional awareness in software development teams , 2013, ESEC/FSE 2013.

[21]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[22]  Kevin Campbell,et al.  Gender Diversity in the Boardroom and Firm Financial Performance , 2008 .

[23]  Alexander Serebrenik,et al.  Gender, Representation and Online Participation: A Quantitative Study of StackOverflow , 2012, 2012 International Conference on Social Informatics.

[24]  Jeffrey C. Carver,et al.  Process Aspects and Social Dynamics of Contemporary Code Review: Insights from Open Source Development and Industrial Practice at Microsoft , 2017, IEEE Transactions on Software Engineering.

[25]  Mike Thelwall,et al.  Data mining emotion in social network communication: Gender differences in MySpace , 2010, J. Assoc. Inf. Sci. Technol..

[26]  David N. Beede,et al.  Women in STEM: A Gender Gap to Innovation , 2011 .

[27]  C. Herring Does Diversity Pay?: Race, Gender, and the Business Case for Diversity , 2009 .

[28]  James R. Curran Proceedings of the COLING/ACL on Interactive presentation sessions , 2006 .

[29]  David Notkin,et al.  Proceedings of the 43rd International Conference on Software Engineering , 2013, ICSE 2013.

[30]  Jeffrey C. Carver,et al.  Impact of Peer Code Review on Peer Impression Formation: A Survey , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[31]  Bram Adams,et al.  Do developers feel emotions? an exploratory analysis of emotions in software artifacts , 2014, MSR 2014.

[32]  W. G. Parrott,et al.  Emotions in social psychology : essential readings , 2001 .

[33]  Lei Zhang,et al.  A Survey of Opinion Mining and Sentiment Analysis , 2012, Mining Text Data.

[34]  Marcelo Serrano Zanetti,et al.  The Role of Emotions in Contributors Activity: A Case Study on the GENTOO Community , 2013, 2013 International Conference on Cloud and Green Computing.

[35]  Karyn Stapleton,et al.  Gender and Swearing: A Community Practice * , 2003 .

[36]  Kelly Blincoe,et al.  What Is the Perception of Female and Male Software Professionals on Performance, Team Dynamics and Job Satisfaction? Insights from the Trenches , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP).

[37]  Gregorio Robles,et al.  Free/Libre and Open Source Software: Survey and Study - FLOSS FINAL REPORT , 2002 .

[38]  Nathan Ensmenger,et al.  The Computer Boys Take Over: Computers, Programmers, and the Politics of Technical Expertise , 2010 .

[39]  Pablo Gervás,et al.  SentiSense: An easily scalable concept-based affective lexicon for sentiment analysis , 2012, LREC.

[40]  R. Plutchik,et al.  Emotion: Theory, Research, and Experience. Vol. 1. Theories of Emotion , 1981 .

[41]  Alexander Serebrenik,et al.  Security and emotion: sentiment analysis of security discussions on GitHub , 2014, MSR 2014.

[42]  Yang Li,et al.  Sentiment analysis of commit comments in GitHub: an empirical study , 2014, MSR 2014.

[43]  Janet Abbate,et al.  Recoding Gender: Women's Changing Participation in Computing , 2012 .

[44]  Aniruddha Das Sexual Harassment at Work in the United States , 2009, Archives of sexual behavior.

[45]  Sapna Cheryan,et al.  Why Are Some STEM Fields More Gender Balanced Than Others? , 2017, Psychological bulletin.

[46]  Minhaz Fahim Zibran,et al.  Exploration and Exploitation of Developers' Sentimental Variations in Software Engineering , 2016, Int. J. Softw. Innov..

[47]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[48]  Minhaz Fahim Zibran,et al.  Leveraging Automated Sentiment Analysis in Software Engineering , 2017, 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR).

[49]  Nicole Novielli,et al.  Sentiment Polarity Detection for Software Development , 2017, Empirical Software Engineering.

[51]  Ulf Mellström The Intersection of Gender, Race and Cultural Boundaries, or Why is Computer Science in Malaysia Dominated by Women? , 2009 .