Quantifying the Life Cycle of Scholarly Articles Across Fields of Economic Research

Does the life cycle of economic papers differ across fields of economic research? By constructing and analyzing a large dataset that combines information on 9,672 articles published in the top five economic journals from 1970 to 2000 with detailed yearly citation data obtained from Google Scholar, we find that published articles do have a life cycle that differs across fields of economic research (which we divide into the categories of applied research, applied theory, econometrics methods and theory). Applied research and applied theory papers are the clear winners in terms of citation counts. For the first years after their publication, they receive higher numbers of citations per year than papers in other fields of research do. They also reach a higher peak number of citations per year and apparently sustain those peak levels for longer, in addition to being cited over longer periods of time (i.e., they have a longer lifespan). Citation patterns are much less favorable for theoretical papers, which are the object of fewer citations per annum in the first years following publication, have lower peak numbers and a shorter lifespan. Econometric method papers are a special case; the pattern for most of these papers is similar to the pattern for theory papers, but the most successful papers (as measured by the number of citations) on econometric methods are also the most successful papers in the entire discipline of economics.

[1]  Christiana E. Hilmer,et al.  Fame and the Fortune of Academic Economists: How the Market Rewards Influential Research in Economics , 2015, SSRN Electronic Journal.

[2]  P. J. Huber.  [Uncertainty, Policy Analysis and Statistics]: Comment , 1987 .

[3]  Richard S. J. Tol,et al.  Rational (successive) h-indices: An application to economics in the Republic of Ireland , 2008, Scientometrics.

[4]  J. R. Cole,et al.  Scientific output and recognition: a study in the operation of the reward system in science. , 1967, American sociological review.

[5]  John Gibson,et al.  Which Journal Rankings Best Explain Academic Salaries? Evidence from the University of California , 2012 .

[6]  Jennifer F. Reinganum.  On the diffusion of new technology: A game theoretic approach , 1981 .

[7]  Christian Zimmermann,et al.  Academic Rankings with RePEc , 2012 .

[8]  Stephen J. Rassenti,et al.  Auction Institutional Design: Theory and Behavior of Simultaneous Multiple Unit Generalizations of the Dutch and English Auctions , 1990 .

[9]  M. T. Wasan,et al.  A Theoretical Derivation of the Functional Form of Short Run Money Holdings , 1983 .

[10]  Lokman I. Meho.  The Rise and Rise of Citation Analysis , 2006, ArXiv.

[11]  Lutz Bornmann,et al.  What do citation counts measure? A review of studies on citing behavior , 2008, J. Documentation.

[12]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[13]  S. Stigler.  Citation Patterns in the Journals of Statistics and Probability , 1994 .

[14]  M. Stewart,et al.  Cyclical Fluctuations in Strike Durations , 1989 .

[15]  E. Garfield.  Citation analysis as a tool in journal evaluation. , 1972, Science.

[16]  R. Wets,et al.  Existence Results and Finite Horizon Approximates for Infinite Horizon Optimization Problems , 1987 .

[17]  Per O. Seglen,et al.  The Skewness of Science , 1992, J. Am. Soc. Inf. Sci..

[18]  M. Shapiro,et al.  Forecasting the Depression: Harvard Versus Yale , 1986 .

[19]  J. Dinardo,et al.  Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach , 1996 .

[20]  P. Gross,et al.  COLLEGE LIBRARIES AND CHEMICAL EDUCATION. , 1927, Science.

[21]  C. Lee Giles,et al.  CiteSeer: an automatic citation indexing system , 1998, DL '98.

[22]  Glenn Ellison,et al.  How Does the Market Use Citation Data? The Hirsch Index in Economics , 2010, SSRN Electronic Journal.

[23]  Lung-fei Lee,et al.  Tests for the Bivariate Normal Distribution in Econometric Models with Selectivity , 1984 .

[24]  S. Stigler,et al.  The Journals of Economics , 1995, Journal of Political Economy.

[25]  D. Hamermesh.  Six Decades of Top Economics Publishing: Who and How? , 2012 .

[26]  S. Redner.  How popular is your paper? An empirical study of the citation distribution , 1998, cond-mat/9804163.

[27]  Jonathan Levin,et al.  The Data Revolution and Economic Analysis , 2013, Innovation Policy and the Economy.

[28]  E. Janeba.  Tax Competition When Governments Lack Commitment: Excess Capacity as a Countervailing Threat , 2000 .

[29]  David I. Stern,et al.  Uncertainty Measures for Economics Journal Impact Factors , 2012 .

[30]  Plergiorgio Strata,et al.  Citation analysis , 1995, Nature.

[31]  Helmut A. Abt,et al.  HOW LONG ARE ASTRONOMICAL PAPERS REMEMBERED? , 1996 .

[32]  B. Bental,et al.  Inventories in a Competitive Environment , 1993, Journal of Political Economy.

[33]  D. King.  The scientific impact of nations , 2004, Nature.

[34]  T. Coupé.  REVEALED PERFORMANCES: WORLDWIDE RANKINGS OF ECONOMISTS AND ECONOMICS DEPARTMENTS, 1990–2000 , 2003 .

[35]  James N. Brown,et al.  Why Do Wages Increase with Tenure? On-the-Job Training and Life-Cycle Wage Growth Observed within Firms , 1989 .

[36]  J. Aizenman,et al.  The life cycle of scholars and papers in economics – the ‘citation death tax’ , 2008 .

[37]  Peder Olesen Larsen,et al.  The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index , 2010, Scientometrics.

[38]  Jean-Marie Dufour,et al.  Short-Run and Long-Rub Causality in Time Series: Theory. , 1998 .

[39]  A. Bayer,et al.  Some Correlates of a Citation Measure of Productivity in Science , 1966 .

[40]  C WinterJoost,et al.  The expansion of Google Scholar versus Web of Science , 2014 .

[41]  D. Hamermesh,et al.  Scholarships, Citations and Salaries: Economic Rewards in Economics , 1982 .

[42]  Ellen Hazelkorn,et al.  Rankings and the Reshaping of Higher Education , 2011 .

[43]  Julian D. Olden,et al.  Not So Fast: Inflation in Impact Factors Contributes to Apparent Improvements in Journal Quality , 2010 .

[44]  Anne-Wil Harzing,et al.  A longitudinal study of Google Scholar coverage between 2012 and 2013 , 2013, Scientometrics.

[45]  Christina Courtright,et al.  Context in information behavior research , 2007 .

[46]  Julio J. Rotemberg,et al.  Sticky Prices in the United States , 1982, Journal of Political Economy.

[47]  Steven Stern,et al.  A Method for Smoothing Simulated Moments of Discrete Probabilities in Multinomial Probit Models , 1992 .

[48]  Lee A Vucovich,et al.  Analyzing the impact of an author's publications. , 2008, Journal of the Medical Library Association : JMLA.

[49]  Samuel Bjork,et al.  Time series citation data: the Nobel Prize in economics , 2013, Scientometrics.

[50]  M. Eysenck,et al.  The correlation between RAE ratings and citation counts in psychology Technical Report , 2002 .

[51]  Anthony F. J. van Raan,et al.  On Determinants of Citation Scores: A Case Study in Chemical Engineering , 1994, J. Am. Soc. Inf. Sci..

[52]  Steven D. Levitt,et al.  An Examination of the Influence of Theory and Individual Theorists on Empirical Research in Microeconomics , 2003 .

[53]  D. Hamermesh,et al.  Reputation and Earnings: The Roles of Quality and Quantity in Academe , 2012 .

[54]  P. Cashell,et al.  Rankings and the Reshaping of Higher Education: The Battle for World-Class Excellence , 2011 .

[55]  Joost C. F. de Winter,et al.  The expansion of Google Scholar versus Web of Science: a longitudinal study , 2013, Scientometrics.

[56]  B. Bernanke,et al.  Agency Costs, Net Worth, and Business Fluctuations , 1988 .

[57]  V. Crawford,et al.  What Price Coordination? The Efficiency-Enhancing Effect of Auctioning the Right to Play , 1997 .

[58]  R. Koenker,et al.  The Gaussian hare and the Laplacian tortoise: computability of squared-error versus absolute-error estimators , 1997 .

[59]  Jim Giles,et al.  Science in the web age: Start your engines , 2005, Nature.

[60]  Charles Oppenheim,et al.  The Correlation between citation counts and the 1992 Research Assessment Exercise Ratings for British Library and Information Science University departments , 1995, J. Documentation.