Ranking Economists on the Basis of Many Indicators: An Alternative Approach Using RePEc Data

In economics the Research Papers in Economics (RePEc) network has become an essential source for the gathering and the spread of both existing and new economic research. Furthermore, it is currently the largest bibliometric database in economic sciences containing 33 different indicators for more than 30,000 economists. Based on this bibliographic information RePEc calculates well-known rankings for authors and academic institutions. We provide some cautionary remarks concerning the interpretation of some provided bibliometric measures in RePEc. Moreover, we show how individual and aggregated rankings can be biased due to the employed ranking methodology. In order to select key indicators describing and assessing research performance of scientist, we propose to apply principal component analysis in this data-rich environment. This approach allows us to assign weights to each indicator prior to aggregation. We illustrate the approach by providing a new overall ranking of economists based on RePEc data.

[1]  Henk F. Moed,et al.  Journal impact measures in bibliometric research , 2004, Scientometrics.

[2]  Marco Gonzalez-Navarro,et al.  Urban Infrastructure and Economic Development: Experimental Evidence from Street Pavement , 2010, SSRN Electronic Journal.

[3]  S. Liebowitz,et al.  Assessing the Relative Impacts of Economic Journals , 1984 .

[4]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[5]  Richard S. J. Tol,et al.  A Hirsch measure for the quality of research supervision, and an illustration with trade economists , 2009, Scientometrics.

[6]  Domingo Docampo,et al.  On using the Shanghai ranking to assess the research performance of university systems , 2010, Scientometrics.

[7]  Charles Oppenheim,et al.  Comparing alternatives to the Web of Science for coverage of the social sciences' literature , 2007, J. Informetrics.

[8]  Christian Zimmermann,et al.  Academic Rankings with RePEc , 2012 .

[9]  José Luis Ortega,et al.  Multivariate approach to classify research institutes according to their outputs: The case of the CSIC's institutes , 2011, J. Informetrics.

[10]  P. Graves,et al.  Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency , 1982 .

[11]  R. Portes,et al.  Economics in Europe , 1987 .

[12]  Pantelis Kalaitzidakis,et al.  RANKINGS OF ACADEMIC JOURNALS AND INSTITUTIONS IN ECONOMICS , 2003 .

[13]  Anne-Wil Harzing,et al.  The publication and citation impact profiles of Angewandte Chemie and the Journal of the American Chemical Society based on the sections of Chemical Abstracts: A case study on the limitations of the Journal Impact Factor , 2009 .

[14]  R. Dusansky,et al.  Rankings of U.S. Economics Departments , 1998 .

[15]  Badi H. Baltagi,et al.  WORLDWIDE INSTITUTIONAL AND INDIVIDUAL RANKINGS IN ECONOMETRICS OVER THE PERIOD 1989–1999: AN UPDATE , 2003, Econometric Theory.

[16]  Magnus Henrekson,et al.  How Should Research Performance Be Measured? A Study of Swedish Economists , 2008 .

[17]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[18]  Klaus F. Zimmermann,et al.  Publications: German Economic Research Institutes on Track , 2008 .

[19]  Massimo Franceschet,et al.  A cluster analysis of scholar and journal bibliometric indicators , 2009, J. Assoc. Inf. Sci. Technol..

[20]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[21]  Joseph Macri,et al.  Rankings of Economists in Teaching Economics Departments in Australia, 1988-2000 , 2004 .

[22]  B. Hirsch,et al.  Economics Departmental Rankings: Comment [Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency] , 1984 .

[23]  Rodrigo Costas,et al.  The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level , 2007, J. Informetrics.

[24]  T. Coupé.  REVEALED PERFORMANCES: WORLDWIDE RANKINGS OF ECONOMISTS AND ECONOMICS DEPARTMENTS, 1990–2000 , 2003 .

[25]  Richard S. J. Tol,et al.  Rational (successive) h-indices: An application to economics in the Republic of Ireland , 2008, Scientometrics.

[26]  H. Ursprung,et al.  Who is the ”Platz-Hirsch“ of the German Economics Profession? , 2007 .

[27]  Richard S. J. Tol,et al.  The h-index and its alternatives: An application to the 100 most prolific economists , 2009, Scientometrics.

[28]  Dan Ben-David.  Ranking Israel’s economists , 2009, Scientometrics.

[29]  Peter Vinkler,et al.  Composite scientometric indicators for evaluating publications of research institutes , 2006, Scientometrics.

[30]  Badi H. Baltagi,et al.  Applied Econometrics Rankings: 1989-1995 , 1999 .

[31]  Antonio García-Romero,et al.  Publishing performance in economics: Spanish rankings (1990-1999) , 2003 .

[32]  P. Combes,et al.  Where Are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications , 2003 .

[33]  A. Ramesh Babu,et al.  Determinants of research productivity , 1998, Scientometrics.

[34]  R. Hofmeister,et al.  Das Handelsblatt Ökonomen-Ranking 2007: Eine kritische Beurteilung , 2008 .

[35]  John Mingers,et al.  Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management , 2010, Scientometrics.

[36]  Marshall H. Medoff,et al.  The Ranking of Economists. , 1989 .

[37]  James G. Corrigan,et al.  Programmatic evaluation and comparison based on standardized citation scores , 1983, IEEE Transactions on Engineering Management.

[38]  Hans-Dieter Daniel,et al.  Data sources for performing citation analysis: an overview , 2008, J. Documentation.