Ranking Economists and Economic Institutions Using RePEc: Some Remarks

In socio-economic sciences the RePEc network (Research Papers in Economics) has become an essential source both for the spread of existing and new economic research. Furthermore the calculation of rankings for authors and academic institutions play a central role. We provide some cautionary remarks on the ranking methodology employed by RePEc and show how the aggregated rankings maybe biased. Furthermore we offer a new ranking approach, based on standardization of scores, which allows interpersonal comparisons and is less sensitive to outliers. We illustrate our new approach with a large data set provided by RePEc based on 24,500 authors.

[1]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[2]  Klaus F. Zimmermann,et al.  Publications: German Economic Research Institutes on Track , 2008 .

[3]  Anne-Wil Harzing,et al.  Changing of the guard , 2009 .

[4]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[5]  Bernd Süssmuth,et al.  Elfenbeinligen und ihre Erfassung: Ein Kommentar und eine neuerliche Messung der Publikationstätigkeit der Wirtschaftsforschungsinstitute im deutschsprachigen Raum: 1989–2003* , 2005 .

[6]  Richard S. J. Tol,et al.  A rational, successive g-index applied to economics departments in Ireland , 2008, J. Informetrics.

[7]  R. Hofmeister,et al.  Das Handelsblatt Ökonomen-Ranking 2007: Eine kritische Beurteilung , 2008 .

[8]  John Mingers,et al.  Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management , 2010, Scientometrics.

[9]  Volker Meier,et al.  Education, Unemployment and Migration , 2007, SSRN Electronic Journal.

[10]  P. Graves,et al.  Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency , 1982 .

[11]  Joseph Macri,et al.  Rankings of Economists in Teaching Economics Departments in Australia, 1988-2000 , 2004 .

[12]  John D. Tressler,et al.  Research Output in New Zealand Economics Department 2000-2006 , 2008 .

[13]  Pantelis Kalaitzidakis,et al.  European economics: An analysis based on publications in the core journals , 1999 .

[14]  Marco Gonzalez-Navarro,et al.  Urban Infrastructure and Economic Development: Experimental Evidence from Street Pavement , 2010, SSRN Electronic Journal.

[15]  K. Wohlrabe,et al.  RePEc – An Independent Platform for Measuring Output in Economics , 2010 .

[16]  Hans-Dieter Daniel,et al.  Data sources for performing citation analysis: an overview , 2008, J. Documentation.

[17]  A. Kirman,et al.  Economic research in Europe , 1994 .

[18]  Wido Geis.  Does Educational Choice Erode the Immigration Surplus , 2009 .

[19]  Antonio García-Romero,et al.  Publishing performance in economics: Spanish rankings (1990-1999) , 2003 .

[20]  P. Combes,et al.  Where Are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications , 2003 .

[21]  Badi H. Baltagi,et al.  Applied Econometrics Rankings: 1989-1995 , 1999 .

[22]  Glenn Ellison.  The Slowdown of the Economics Publishing Process , 2000 .

[23]  Charles Oppenheim,et al.  Comparing alternatives to the Web of Science for coverage of the social sciences' literature , 2007, J. Informetrics.

[24]  Christian Zimmermann,et al.  Academic Rankings with RePEc , 2012 .

[25]  L. C. Scott,et al.  Trends in Rankings of Economics Departments in the U.S.: An Update , 1996 .

[26]  J. Courtault,et al.  Research in economics and management in France: A bibliometric study using the h-index , 2010 .

[27]  Richard S. J. Tol,et al.  The h-index and its alternatives: An application to the 100 most prolific economists , 2009, Scientometrics.

[28]  Richard S. J. Tol,et al.  Rational (successive) h-indices: An application to economics in the Republic of Ireland , 2008, Scientometrics.

[29]  Badi H. Baltagi.  WORLDWIDE INSTITUTIONAL AND INDIVIDUAL RANKINGS IN ECONOMETRICS OVER THE PERIOD 1989–1999: AN UPDATE , 2003, Econometric Theory.

[30]  Bruno S. Frey,et al.  American and European Economics and Economists , 1993 .

[31]  Henk F. Moed,et al.  Journal impact measures in bibliometric research , 2004, Scientometrics.

[32]  R. Portes,et al.  Economics in Europe , 1987 .

[33]  Pantelis Kalaitzidakis,et al.  RANKINGS OF ACADEMIC JOURNALS AND INSTITUTIONS IN ECONOMICS , 2003 .

[34]  Richard S. J. Tol,et al.  A Hirsch measure for the quality of research supervision, and an illustration with trade economists , 2009, Scientometrics.

[35]  P. Huber,et al.  „Wo die Luft dünn wird…”– Zur Publikationstätigkeit der Wirtschaftsforschungsinstitute Österreichs und Deutschlands , 2004 .

[36]  Dan Ben-David.  Ranking Israel’s economists , 2009, Scientometrics.