Network analysis to measure academic performance in economics

Network analysis allows us to introduce different metrics that complement the traditional indicators to measure academic performance, generally based on individual production. In this paper, we show how the use of these techniques provides a more global point of view, introducing indicators that, beyond individual merits, measure the capacity of researchers to generate more intangible assets. We focus on collaboration among groups that can enrich the potential of the research ecosystem as a whole. We present not only numerical indicators, but also several visualisation schemes to see how this approach can help in the academic evaluation and decision-making process of research managers. We have used, as a case study, the research ecosystem formed by more than five thousand economists from Spanish institutions.

[1]  Sameer Kumar,et al.  Co-authorship networks: a review of the literature , 2015, Aslib J. Inf. Manag..

[2]  Márcia Siqueira Rapini,et al.  Growth patterns of the network of international collaboration in science , 2017, Scientometrics.

[3]  S. Goyal,et al.  Economics: An Emerging Small World , 2004, Journal of Political Economy.

[4]  Eva Gallardo-Gallardo,et al.  Understanding scientific communities: a social network approach to collaborations in Talent Management research , 2017, Scientometrics.

[5]  I. Moosa.  Citations, journal ranking and multiple authorships: evidence based on the top 300 papers in economics , 2017 .

[6]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Alfredo Ferrer,et al.  Analysis of academic productivity based on Complex Networks , 2015, Scientometrics.

[8]  R. Claude,et al.  Bibliometric overview of the utilization of artificial neural networks in medicine and biology , 2004 .

[9]  J. Ruiz-Castillo,et al.  The Evolution of the Scientific Productivity of Highly Productive Economists , 2014 .

[10]  D. Hamermesh.  Citations in Economics: Measurement, Uses and Impacts , 2015, SSRN Electronic Journal.

[11]  Stelios Katranidis,et al.  Economists, Research Performance and National Inbreeding: North Versus South , 2017 .

[12]  Alexandros Polycarpou,et al.  Peer Review vs Metric‐Based Assessment: Testing for Bias in the Rae Ratings of UK Economics Departments , 2009 .

[13]  S. Liebowitz,et al.  Assessing the Relative Impacts of Economic Journals , 1984 .

[14]  James Caverlee,et al.  PageRank for ranking authors in co-citation networks , 2009 .

[15]  José Alexandre Felizola Diniz-Filho,et al.  The roles of geographic distance and socioeconomic factors on international collaboration among ecologists , 2017, Scientometrics.

[16]  Pantelis Kalaitzidakis,et al.  European economics: An analysis based on publications in the core journals , 1999 .

[17]  András Schubert.  Sentences to remember from the first 100 volumes of the journal Scientometrics , 2014, Scientometrics.

[18]  Elsa Fontainha,et al.  The specific shapes of gender imbalance in scientific authorships: A network approach , 2016, J. Informetrics.

[19]  Lorenzo Ductor.  Does Co‐Authorship Lead to Higher Academic Productivity? , 2015 .

[20]  Pantelis Kalaitzidakis,et al.  An Updated Ranking of Academic Journals in Economics (Une Mise À Jour De L'Ordonnancement Des Revues Scientifiques En Économie)  , 2011 .

[21]  Theodore Panagiotidis,et al.  An Evaluation of the Greek Universities’ Economics Departments , 2014 .

[22]  José Alexandre Felizola Diniz-Filho,et al.  Weak evidence for determinants of citation frequency in ecological articles , 2010, Scientometrics.

[23]  Thomas Scherngell,et al.  Bridging centrality as an indicator to measure the 'bridging role' of actors in networks: An application to the European Nanotechnology co-publication network , 2017, J. Informetrics.

[24]  Svein Kyvik,et al.  Research collaboration in groups and networks: differences across academic fields , 2017, Scientometrics.

[25]  Joseph Macri,et al.  Rankings Methodology for International Comparisons of Institutions and Individuals: An Application to Economics in Australia and New Zealand , 2006 .

[26]  Therese C. Grijalva,et al.  Trends in co-authorship in economics since 1985 , 2011 .

[27]  Lutz Bornmann,et al.  Excellence networks in science: A Web-based application based on Bayesian multilevel logistic regression (BMLR) for the identification of institutions collaborating successfully , 2015, J. Informetrics.

[28]  Md Sayed Iftekhar,et al.  Does academic collaboration equally benefit impact of research across topics? The case of agricultural, resource, environmental and ecological economics , 2017, Scientometrics.

[29]  D J PRICE,et al.  NETWORKS OF SCIENTIFIC PAPERS. , 1965, Science.

[30]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[31]  András Schubert,et al.  Incremental citation impact due to international co-authorship in Hungarian higher education institutions , 2007, Scientometrics.

[32]  A. Andrikopoulos,et al.  Coauthorship and subauthorship patterns in financial economics , 2016 .

[33]  Ludo Waltman,et al.  Counting publications and citations: Is more always better? , 2013, J. Informetrics.

[34]  Katharina Rath,et al.  Recent trends in co-authorship in economics: evidence from RePEc , 2015, SSRN Electronic Journal.

[35]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[36]  A. Oswald.  An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers , 2006, SSRN Electronic Journal.

[37]  María Bordons,et al.  The relationship between the research performance of scientists and their position in co-authorship networks in three fields , 2015, J. Informetrics.

[38]  Francisco Herrera,et al.  Science mapping software tools: Review, analysis, and cooperative study among tools , 2011, J. Assoc. Inf. Sci. Technol..

[39]  M. Kocher,et al.  Patterns of co-authorship among economics departments in the USA , 2004 .

[40]  Giovanni Colavizza,et al.  The structural role of the core literature in history , 2017, Scientometrics.

[41]  Ludo Waltman,et al.  Constructing bibliometric networks: A comparison between full and fractional counting , 2016, J. Informetrics.

[42]  Pantelis Kalaitzidakis,et al.  RANKINGS OF ACADEMIC JOURNALS AND INSTITUTIONS IN ECONOMICS , 2003 .

[43]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[44]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[45]  Alberto Cambrosio,et al.  Oncology research in late twentieth century and turn of the century Portugal: a scientometric approach to its institutional and semantic dimensions , 2017, Scientometrics.

[46]  Kuang-hua Chen,et al.  A longitudinal study of intellectual cohesion in digital humanities using bibliometric analyses , 2017, Scientometrics.

[47]  Srebrenka Letina,et al.  Network and actor attribute effects on the performance of researchers in two fields of social science in a small peripheral community , 2016, J. Informetrics.

[48]  Matjaz Perc,et al.  Growth and structure of Slovenia's scientific collaboration network , 2010, J. Informetrics.

[49]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[50]  La investigación española en Economía 1995-1999 , 2002 .

[51]  R. Dusansky,et al.  Rankings of U.S. Economics Departments , 1998 .