Impact of Peer Code Review on Peer Impression Formation: A Survey

Peer code review has been adopted as an effective quality improvement practice by many Open Source Software (OSS) communities. In addition to increasing software quality, there is anecdotal evidence that peer code review has other benefits, including: sharing knowledge, sharing expertise, sharing development techniques, and most importantly building accurate peer impressions between the code review participants. To further investigate the presence of these benefits, we surveyed members of popular OSS communities who were involved with peer code review. We used established scales from Psychology, Information science, and Organizational Behavior to create survey questions. We also enforced multiple reliability and validity measures to ensure higher confidence in the survey results. In this paper, we present a subset of the surveys results focused on better understanding four aspects of peer impression formation: trust, reliability, perception of expertise, and friendship. The results indicate that there is indeed a high level of trust, reliability, perception of expertise, and friendship between OSS peers who have participated in code review for a period of time. Because code review involves examining someone else's code, unsurprisingly, peer code review helped most in building a perception of expertise between code review partners.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Jeffrey C. Carver,et al.  Peer impressions in open source organizations: A survey , 2014, J. Syst. Softw..

[3]  D. Streiner Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency , 2003, Journal of personality assessment.

[4]  Nils Brede Moe,et al.  Understanding Lacking Trust in Global Software Teams: A Multi-case Study , 2007, PROFES.

[5]  Daniel J. McAllister Affect- and Cognition-Based Trust as Foundations for Interpersonal Cooperation in Organizations , 1995 .

[6]  R. Cialdini,et al.  Online persuasion: An examination of gender differences in computer-mediated interpersonal influence. , 2002 .

[7]  James D. Herbsleb,et al.  Global Software Engineering: The Future of Socio-technical Coordination , 2007, Future of Software Engineering (FOSE '07).

[8]  J. Rotter A new scale for the measurement of interpersonal trust. , 1967, Journal of personality.

[9]  Sandra Slaughter,et al.  Why Developers Participate in Open Source Software Projects: An Empirical Investigation , 2004, ICIS.

[10]  Philip M. Johnson Reengineering inspection , 1998, CACM.

[11]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[12]  D. Watson,et al.  Constructing validity: Basic issues in objective scale development , 1995 .

[13]  A. Oram,et al.  Making Software: What Really Works, and Why We Believe It , 2010 .

[14]  Howard B. Lee,et al.  A first course in factor analysis , 1973 .

[15]  Audris Mockus,et al.  An Empirical Study of Speed and Communication in Globally Distributed Software Development , 2003, IEEE Trans. Software Eng..

[16]  Eric S. Raymond,et al.  Homesteading the Noosphere , 1998, First Monday.

[17]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[18]  Mark S. Litwin,et al.  How to Measure Survey Reliability and Validity , 1995 .

[19]  Arlene Fink,et al.  The Survey Handbook , 1995 .

[20]  W. Bukowski,et al.  Measuring Friendship Quality During Pre- and Early Adolescence: The Development and Psychometric Properties of the Friendship Qualities Scale , 1994 .

[21]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[22]  D. A. Kenny,et al.  Interpersonal Perception: A Social Relations Analysis , 1988 .

[23]  Michael J. Muller,et al.  Motivations for social networking at work , 2008, CSCW.

[24]  Steve McConnell What Does 10x Mean? Measuring Variations in Programmer Productivity , 2011, Making Software.

[25]  Andy Huber,et al.  Peer reviews in software: a practical guide , 2002, SOEN.

[26]  Pär J. Ågerfalk,et al.  Global Software Development Challenges: A Case Study on Temporal, Geographical and Socio-Cultural Distance , 2006, 2006 IEEE International Conference on Global Software Engineering (ICGSE'06).

[27]  C. Johnson-George,et al.  Measurement of specific interpersonal trust: Construction and validation of a scale to assess trust in a specific other. , 1982 .

[28]  Kristen Olson,et al.  Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias , 2006 .

[29]  Suzanne P. Mikawa,et al.  Removing barriers to trust in distributed teams: understanding cultural differences and strengthening social ties , 2009, IWIC '09.

[30]  Katelyn Y. A. McKenna,et al.  The internet and social life. , 2004, Annual review of psychology.

[31]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[32]  Michael E. Fagan Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..