Citations in Economics: Measurement, Uses and Impacts

I describe and compare sources of data on citations in economics and the statistics that can be constructed from them. Constructing data sets of the post-publication citation histories of articles published in the "Top 5" journals in the 1970s and the 2000s, I examine distributions and life cycles of citations, compare citation histories of articles in different sub-specialties in economics and present evidence on the history and heterogeneity of those journals' impacts and the marginal citation productivity of additional coauthors. I use a new data set of the lifetime citation histories of over 1000 economists from 30 universities to rank economics departments by various measures and to demonstrate the importance of intra- and interdepartmental heterogeneity in productivity. Throughout, the discussion summarizes earlier work. I survey research on the impacts of citations on salaries and non-monetary rewards and discuss how citations reflect judgments about research quality in economics.

[1]  L. Bornmann,et al.  Normalisation of citation impact in economics , 2019, Scientometrics.

[2]  J. Masur,et al.  Affirmative Action in Law Reviews , 2018 .

[3]  Jorge E. Camargo,et al.  Topics and methods in economics, finance, and business journals: A content analysis enquiry☆ , 2018, Heliyon.

[4]  A. Josephson,et al.  Viewpoint: Beasts of the field? Ethics in agricultural and applied economics , 2018, Food Policy.

[5]  Derek C. Jones The economics of Participation and Employee Ownership (PEO): an assessment , 2018, Journal of Participation and Employee Ownership.

[6]  Jeffry Netter,et al.  Observations on research and publishing from nineteen years as editors of the Journal of Corporate Finance , 2018 .

[7]  Andrew J. Seltzer Publication Trends and Future Challenges for The Australian Economic History Review: A Bibliometric Analysis , 2018 .

[8]  Claudia Kemfert,et al.  On the economics of electrical storage for variable renewable energy sources , 2018, European Economic Review.

[9]  John Gibson,et al.  Citations or Journal Quality: Which is Rewarded More in the Academic Labor Market? , 2017 .

[10]  S. Orazbayev Diversity and Collaboration in Economics , 2017 .

[11]  A. Alam,et al.  A measure of authorship by publications , 2017, Managerial and Decision Economics.

[12]  D. Hamermesh,et al.  Co-Authorship in Economic History and Economics: Are We Any Different? , 2017, Explorations in Economic History.

[13]  Tommaso Colussi,et al.  Social Ties in Academia: A Friend Is a Treasure , 2017, Review of Economics and Statistics.

[14]  William W. Olney English Proficiency and Labor Market Performance: Evidence from the Economics Profession , 2017 .

[15]  François Claveau,et al.  Macrodynamics of Economics: A Bibliometric History , 2016 .

[16]  Philip J. Reny,et al.  How To Count Citations If You Must , 2016 .

[17]  Lea-Rachel D. Kosnik,et al.  JEL Codes: What Do They Mean and Are They Used Consistently? , 2016 .

[18]  Rafael Treibich,et al.  Co-Authorship and the Measurement of Individual Productivity , 2015 .

[19]  Jian Wang,et al.  Bias Against Novelty in Science: A Cautionary Tale for Users of Bibliometric Indicators , 2015 .

[20]  Marion Fourcade,et al.  The Superiority of Economists , 2015 .

[21]  Christiana E. Hilmer,et al.  Fame and the Fortune of Academic Economists: How the Market Rewards Influential Research in Economics , 2015, SSRN Electronic Journal.

[22]  Ramiro H. Gálvez,et al.  Quantifying the Life Cycle of Scholarly Articles Across Fields of Economic Research , 2015 .

[23]  Inder M Verma,et al.  Impact, not impact factor , 2015, Proceedings of the National Academy of Sciences.

[24]  Beatrice Cherrier,et al.  Classifying Economics: A History of the JEL Codes , 2015 .

[25]  Vincenzo Scoppa,et al.  Gender Discrimination and Evaluators’ Gender: Evidence from Italian Academia , 2015 .

[26]  Ho Fai Chan,et al.  Academic honors and performance , 2014 .

[27]  Christis G. Tombazos,et al.  Formulating research policy on expert advice , 2014 .

[28]  Ho Fai Chan,et al.  Do the best scholars attract the highest speaking fees? An exploration of internal and external influence , 2014, Scientometrics.

[29]  E. Choi,et al.  Citations of Most Often Cited Economists: Do Scholarly Books Matter More than Quality Journals? , 2014 .

[30]  Clément Bosquet,et al.  Are academics who publish more also more cited? Individual determinants of publication and citation records , 2013, Scientometrics.

[31]  D. Laband On the Use and Abuse of Economics Journal Rankings , 2013 .

[32]  S. Liebowitz,et al.  Willful Blindness: The Inefficient Reward Structure in Academic Research , 2013 .

[33]  Christopher M. Snyder,et al.  Does Online Availability Increase Citations? Theory and Evidence from a Panel of Economics and Business Journals , 2013, Review of Economics and Statistics.

[34]  Tom Coupé,et al.  Peer Review versus Citations - An Analysis of Best Paper Prizes , 2013 .

[35]  David I. Stern,et al.  Uncertainty Measures for Economics Journal Impact Factors , 2012 .

[36]  D. Hamermesh Six Decades of Top Economics Publishing: Who and How? , 2012 .

[37]  Franklin G. Mixon,et al.  The Economics Olympics: Ranking U.S. Economics Departments Based on Prizes, Medals, and Other Awards , 2012 .

[38]  Joseph Engelberg,et al.  Networks and Productivity: Causal Evidence from Editor Rotations , 2012 .

[39]  K. Hoover On the Reception of Haavelmo’s Econometric Thought , 2012, Journal of the History of Economic Thought.

[40]  D. Hamermesh,et al.  Reputation and Earnings: The Roles of Quality and Quantity in Academe , 2012 .

[41]  J. McDowell,et al.  On (And Off) the Hot Seat: An Analysis of Entry into and Out of University Administration , 2011 .

[42]  Jakob Kapeller,et al.  Citation Metrics: Serious Drawbacks, Perverse Incentives, and Strategic Options for Heterodox Economics , 2010 .

[43]  Anindya Sen,et al.  Hot or Not: How Appearance Affects Earnings and Productivity in Academia , 2010 .

[44]  Glenn Ellison,et al.  How Does the Market Use Citation Data? The Hirsch Index in Economics , 2010, SSRN Electronic Journal.

[45]  R. Margo The Economic History of the "American Economic Review": A Century's Explosion of Economics Research , 2010 .

[46]  Hugo M. Mialon,et al.  What's in a Title? Predictors of the Productivity of Publications , 2010 .

[47]  S. Moreau,et al.  What Is Discrimination , 2010 .

[48]  Daniel Waldenström,et al.  Citation Success: Evidence from Economic History Journal Publications , 2009 .

[49]  James F. Ragan,et al.  Does Raiding Explain the Negative Returns to Faculty Seniority? , 2009 .

[50]  Christiana E. Hilmer,et al.  Fishes, Ponds, and Productivity: Student-Advisor Matching and Early Career Publishing Success for Economics PhDs , 2009 .

[51]  Magnus Henrekson,et al.  How Should Research Performance Be Measured? A Study of Swedish Economists , 2008 .

[52]  J. Aizenman,et al.  The life cycle of scholars and papers in economics – the ‘citation death tax’ , 2008 .

[53]  H. Ursprung,et al.  Life Cycle and Cohort Productivity in Economic Research: The Case of Germany , 2007, SSRN Electronic Journal.

[54]  Arthur M. Diamond,et al.  The determinants of election to the Presidency of the American Economic Association: Evidence from a cohort of distinguished 1950’s economists , 2007, Scientometrics.

[55]  John Hudson,et al.  Be known by the company you keep: Citations — quality or chance? , 2007, Scientometrics.

[56]  L. Egghe,et al.  Theory and practise of the g-index , 2006, Scientometrics.

[57]  Marshall H. Medoff,et al.  The efficiency of self-citations in economics , 2006, Scientometrics.

[58]  Stephen G. Donald,et al.  What is Discrimination? Gender in the American Economic Association, 1935-2004 , 2006 .

[59]  J. Drèze,et al.  Research and Higher Education in Economics: Can We Deliver the Lisbon Objectives? , 2006 .

[60]  A. Oswald An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers , 2006, SSRN Electronic Journal.

[61]  Luigi Zingales,et al.  Are Elite Universities Losing Their Competitive Edge? , 2006 .

[62]  Leeat Yariv,et al.  What's in a Surname? The Effects of Surname Initials on Academic Success , 2006 .

[63]  Charles Auffray,et al.  F1000Prime recommendation of An index to quantify an individual's scientific research output. , 2005 .

[64]  Rabah Amir,et al.  Ranking Economics Departments Worldwide on the Basis of PhD Placement , 2005, The Review of Economics and Statistics.

[65]  Donna K. Ginther,et al.  Women in Economics: Moving Up or Falling Off the Academic Career Ladder? , 2004 .

[66]  A. Diamond Zvi Griliches's contributions to the economics of technology and growth , 2004 .

[67]  Pantelis Kalaitzidakis,et al.  RANKINGS OF ACADEMIC JOURNALS AND INSTITUTIONS IN ECONOMICS , 2003 .

[68]  Marshall H. Medoff,et al.  Collaboration and the quality of economics research , 2003 .

[69]  O. Baser,et al.  The return of publications for economics faculty , 2003 .

[70]  K. Clements,et al.  Who Cites What? , 2003 .

[71]  Robert D. Tollison,et al.  Dry Holes in Economic Research , 2003 .

[72]  Steven D. Levitt,et al.  An Examination of the Influence of Theory and Individual Theorists on Empirical Research in Microeconomics , 2003 .

[73]  Kostas Axarloglou,et al.  Diversity in Economics: An Analysis of Journal Quality Perceptions , 2003 .

[74]  H. Bodenhorn Economic Scholarship at Elite Liberal Arts Colleges: A Citation Analysis with Rankings , 2003 .

[75]  R. Pieters,et al.  Who talks to whom? Intra-and interdisciplinary communication of economics journals , 2002 .

[76]  Oscar Volij,et al.  The Measurement of Intellectual Influence , 2002 .

[77]  J. Wight The Rise of Adam Smith: Articles and Citations, 1970-1997 , 2002 .

[78]  A. Hollis Co-authorship and the output of academic economists , 2001 .

[79]  Jerry G. Thursby What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research , 2000 .

[80]  Richard A. Posner,et al.  An Economic Analysis of the Use of Citations in the Law , 2000 .

[81]  John T. Warren,et al.  How similar are pay structures in 'similar' departments of economics? , 1999 .

[82]  Geoffrey M. Hodgson,et al.  The Editors and Authors of Economics Journals: A Case of Institutional Oligopoly? , 1999 .

[83]  Joshua S. Gans,et al.  First Author Conditions , 1998 .

[84]  Jeff E. Biddle,et al.  A Citation Analysis of the Sources and Extent of Wesley Mitchell's Reputation , 1996 .

[85]  L. C. Scott,et al.  Trends in Rankings of Economics Departments in the U.S.: An Update , 1996 .

[86]  Joel Waldfogel,et al.  A Citation-Based Test for Discrimination at Economics and Finance Journals , 1996 .

[87]  B. Maher,et al.  Research-doctorate programs in the United States: continuity and change , 1996 .

[88]  L. Kenny,et al.  Economists’ salaries and lifetime productivity , 1995 .

[89]  Daniel S. Hamermesh,et al.  Gender Discrimination by Gender: Voting in a Professional Society , 1994 .

[90]  David N. Laband,et al.  Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors , 1994, Journal of Political Economy.

[91]  Paula E. Stephan,et al.  Research Productivity over the Life Cycle: Evidence for Academic Scientists , 1991 .

[92]  M. Trajtenberg A Penny for Your Quotes : Patent Citations and the Value of Innovations , 1990 .

[93]  Daniel S. Hamermesh,et al.  Why Do Individual-Effects Models Perform so Poorly? The Case of Academic Salaries , 1989 .

[94]  David M. Levy,et al.  The Half-Life of Dead Economists , 1989 .

[95]  J. Tschirhart Ranking Economics Departments in Areas of Expertise , 1989 .

[96]  Raymond D. Sauer,et al.  Estimates of the Returns to Quality and Coauthorship in Economic Academia , 1988, Journal of Political Economy.

[97]  M. Ferber,et al.  CITATIONS AND NETWORKING , 1988 .

[98]  A. Diamond The Empirical Progressiveness of the General Equilibrium Research Program , 1988 .

[99]  George J. Borjas,et al.  Assimilation, Changes in Cohort Quality, and the Earnings of Immigrants , 1985, Journal of Labor Economics.

[100]  D. Hamermesh,et al.  Scholarships, Citations and Salaries: Economic Rewards in Economics , 1982 .

[101]  Richard B. McKenzie,et al.  The Ranking of Southern Economics Departments: New Criterion and Further Evidence , 1978 .

[102]  Burton A. Weisbrod,et al.  Modeling the Earnings and Research Productivity of Academic Economists , 1978, Journal of Political Economy.

[103]  George J. Stigler,et al.  THE LITERATURE OF ECONOMICS: THE CASE OF THE KINKED OLIGOPOLY DEMAND CURVE , 1978 .

[104]  R. Quandt Some Quantitative Aspects of the Economics Journal Literature , 1976, Journal of Political Economy.

[105]  H. Tuckman,et al.  What Is an Article Worth? , 1975, Journal of Political Economy.

[106]  George J. Stigler,et al.  The Citation Practices of Doctorates in Economics , 1975, Journal of Political Economy.

[107]  J. R. Cole,et al.  Social Stratification in Science , 1974 .

[108]  Frank P. Stafford,et al.  Lifetime Earnings in a Professional Labor Market: Academic Economists , 1974, Journal of Political Economy.

[109]  R. Merton The Matthew Effect in Science , 1968, Science.

[110]  Allan M. Cartter,et al.  An Assessment of Quality in Graduate Education , 1966 .

[111]  Z. Griliches HYBRID CORN: AN EXPLORATION IN THE ECONOMIC OF TECHNOLOGICAL CHANGE , 1957 .

[112]  D. Schiereck,et al.  Confused But Convinced: Article Complexity and the Number of Citations , 2017 .

[113]  Wei Huang,et al.  DO ABCs GET MORE CITATIONS THAN XYZs , 2015 .

[114]  Kevin E. Staub,et al.  Online accessibility of scholarly literature, and academic innovation , 2014 .

[115]  Victor Ginsburgh,et al.  Are Leading Papers of Better Quality? Evidence from a Natural Experiment , 2009 .

[116]  Pedro Duarte The Growing of Ramsey's Growth Model , 2009 .

[117]  E. H. Kim,et al.  Are Elite Universities Losing Their Competitive Edge ? , 2006 .

[118]  Eric P. Chiang,et al.  Citation Counts and SSCI in Personnel Decisions: A Survey of Economics Departments , 2004 .

[119]  Peter Schmidt,et al.  The determinants of econometric society fellows elections , 2003 .

[120]  A. Diamond,et al.  What is a Citation Worth ? , 2001 .

[121]  R. Dusansky,et al.  Rankings of U.S. Economics Departments , 1998 .

[122]  Orley Ashenfelter,et al.  Theory and measurement , 1996 .

[123]  A. Siow Are First Impressions Important in Academia , 1991 .

[124]  D. Laband A Qualitative Test of Journal Discrimination Against Women , 1987 .

[125]  A. Diamond What is a Citation Worth , 1986 .

[126]  P. Davis,et al.  Faculty Ratings of Major Economics Departments by Citations , 1984 .

[127]  P. Graves,et al.  Economics Departmental Rankings: Research Incentives, Constraints, and Efficiency , 1982 .

[128]  A. Bayer,et al.  Determinants of Professional Income Among Recent Recipients of Natural Science Doctorates , 1970 .

[129]  D. Gale Johnson,et al.  A Rating of Graduate Programs. , 1970 .

[130]  H. Keniston Graduate study and research in the arts and sciences at the University of Pennsylvania , 1959 .

[131]  Alexander Smith Dreamthorp: A Book of Essays Written in the Country , 2022 .