Women and men — Different but equal: On the impact of identifier style on source code reading

Program comprehension is preliminary to any program evolution task. Researchers agree that identifiers play an important role in code reading and program understanding activities. Yet, to the best of our knowledge, only one work investigated the impact of gender on the memorability of identifiers and thus, ultimately, on program comprehension. This paper reports the results of an experiment involving 15 male subjects and nine female subjects to study the impact of gender on the subjects' visual effort, required time, as well as accuracy to recall Camel Case versus Underscore identifiers in source code reading. We observe no statistically-significant difference in term of accuracy, required time, and effort. However, our data supports the conjecture that male and female subjects follow different comprehension strategies: female subjects seem to carefully weight all options and spend more time to rule out wrong answers while male subjects seem to quickly set their minds on some answers, possibly the wrong ones. Indeed, we found that the effort spent on wrong answers is significantly higher for female subjects and that there is an interaction between the effort that female subjects invested on wrong answers and their higher percentages of correct answers when compared to male subjects.

[1]  Yann-Gaël Guéhéneuc.  Taupe: Visualising and Analysing Eye-tracking Data , 2012 .

[2]  Paolo Tonella,et al.  Restructuring program identifier names , 2000, Proceedings 2000 International Conference on Software Maintenance.

[3]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[4]  David W. Binkley,et al.  To camelcase or under_score , 2009, 2009 IEEE 17th International Conference on Program Comprehension.

[5]  Derek M. Jones.  The New C Standard An Economic and Cultural Commentary , 2004 .

[6]  Jonathan I. Maletic,et al.  An eye-tracking study on the role of scan time in finding source code defects , 2012, ETRA.

[7]  Ed O'Donnell,et al.  The Effects of Auditor Gender and Task Complexity on Information Processing Efficiency , 2001 .

[8]  Markus Pizka,et al.  Concise and consistent naming , 2005, 13th International Workshop on Program Comprehension (IWPC'05).

[9]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[10]  Margaret M. Burnett,et al.  Effectiveness of end-user debugging software features: are there gender issues? , 2005, CHI.

[11]  David W. Binkley,et al.  Effective identifier names for comprehension and memory , 2007, Innovations in Systems and Software Engineering.

[12]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[13]  Lin Zhao,et al.  Using Sex Differences to Link Spatial Cognition and Program Comprehension , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[14]  Terri L. Moore,et al.  Regression Analysis by Example , 2001, Technometrics.

[15]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[16]  M. Harris.  Cannibals and Kings , 1977 .

[17]  Margaret M. Burnett,et al.  Males' and Females' Script Debugging Strategies , 2009, IS-EUD.

[18]  André P. Calitz,et al.  The evaluation of information visualisation techniques using eye tracking , 2009 .

[19]  Kathleen S. Hartzel.  How self-efficacy and gender issues affect software adoption and use , 2003, CACM.

[20]  Akito Monden,et al.  Analyzing individual performance of source code review using reviewers' eye movement , 2006, ETRA.

[21]  Markus Pizka,et al.  Concise and Consistent Naming , 2005, IWPC.

[22]  Helen E. Fisher,et al.  Anatomy of Love: A Natural History of Mating, Marriage, and Why We Stray , 1994 .

[23]  Jonathan I. Maletic,et al.  An Eye Tracking Study on camelCase and under_score Identifier Styles , 2010, 2010 IEEE 18th International Conference on Program Comprehension.

[24]  Mary Czerwinski,et al.  Gender differences and programming environments: across programming populations , 2010, ESEM '10.

[25]  Alice M. Tybout,et al.  Cognitive and Affective Responses to Advertising , 1988 .

[26]  G. Torkzadeh,et al.  Factorial Validity of a Computer Self-Efficacy Scale and the Impact of Computer Training , 1994 .

[27]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[28]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .