Factors Influencing Research Contributions and Researcher Interactions in Software Engineering: An Empirical Study

Research into software engineering (SE) education is largely concentrated on teaching and learning issues in coursework programs. This paper, in contrast, provides a meta analysis of research publications in software engineering to help with research education in SE. Studying publication patterns in a discipline will assist research students and supervisors gain a deeper understanding of how successful research has occurred in the discipline. We present results from a large scale empirical study covering over three and a half decades of software engineering research publications. We identify how different factors of publishing relate to the number of papers published as well as citations received for a researcher, and how the most successful researchers collaborate and co-cite one another. Our results show that authors with high publication rates do not concentrate on a few selected venues to publish, researchers with high publication rates behave differently from researchers of high citation rates (with the latter group co-authoring and citing their peers to a much lesser extent than the former), and collaborators citing each other's works is not a significant phenomenon in SE research.

[1]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[2]  Laurie Williams,et al.  Extreme programming for software engineering education? , 2001, 31st Annual Frontiers in Education Conference. Impact on Engineering and Science Education. Conference Proceedings (Cat. No.01CH37193).

[3]  Orit Hazzan,et al.  The reflective practitioner perspective in software engineering education , 2002, J. Syst. Softw..

[4]  David C. Roberts,et al.  Mapping the Evolution of Scientific Fields , 2009, PloS one.

[5]  M E Newman,et al.  Scientific collaboration networks. I. Network construction and fundamental results. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Santonu Sarkar,et al.  The social network of software engineering research , 2012, ISEC.

[7]  Peter B. Henderson Mathematical reasoning in software engineering education , 2003, CACM.

[8]  Venkataraman Ramesh,et al.  An analysis of research in computing disciplines , 2004, CACM.

[9]  Kal Toth,et al.  Experiences with Open Source Software Engineering Tools , 2006, IEEE Software.

[10]  Richard C. Holt,et al.  The small world of software reverse engineering , 2004, 11th Working Conference on Reverse Engineering.

[11]  M. Newman,et al.  Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Carlos Castillo-Chavez,et al.  Population modeling of the emergence and development of scientific fields , 2008, Scientometrics.

[13]  David Lorge Parnas,et al.  Stop the numbers game , 2007, CACM.

[14]  Mary Shaw,et al.  Writing good software engineering research papers , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[15]  Jesús Favela,et al.  An Experience in Collaborative Software Engineering Education , 2001, IEEE Softw..

[16]  Mary Shaw,et al.  Continuing Prospects for an Engineering Discipline of Software , 2009, IEEE Software.

[17]  C. Johansson,et al.  A practice driven approach to software engineering education , 1995 .

[18]  E. Fehr,et al.  Fairness and Retaliation: The Economics of Reciprocity , 2000, SSRN Electronic Journal.

[19]  Weimao Ke,et al.  Studying the emerging global brain: Analyzing and visualizing the impact of co-authorship teams , 2005, Complex..

[20]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[21]  Premkumar T. Devanbu,et al.  Structure and Dynamics of Research Collaboration in Computer Science , 2009, SDM.

[22]  J.A. Polack-Wahl,et al.  Enhancing software engineering education using teaching aids in 3-D online virtual worlds , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[23]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[24]  John Todman,et al.  Approaching multivariate analysis : a practical introduction , 2010 .

[25]  Venkataraman Ramesh,et al.  Research in software engineering: an analysis of the literature , 2002, Inf. Softw. Technol..

[26]  L. Stanca Measuring Indirect Reciprocity: Whose Back Do We Scratch? , 2009 .

[27]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[28]  Sean Gerrish,et al.  A Language-based Approach to Measuring Scholarly Impact , 2010, ICML.

[29]  Mary Shaw,et al.  Writing good software engineering research papers: minitutorial , 2003, ICSE 2003.

[30]  C. Lee Giles,et al.  Collaboration over time: characterizing and modeling network evolution , 2008, WSDM '08.