Journals, Preferences, and Publishing in Agricultural and Environmental Economics

Research quality is an increasingly important metric for determining funding allocations, promotion and tenure, and professional prestige. A key metric often used as a proxy for research quality is the ranking of the journal in which a manuscript appears. While citation-based measures of journal quality are commonly used, less is known about other dimensions of journal quality and prestige. We report results from an international study using Best-Worst Scaling to investigate researchers' journal preferences. Respondents used two criteria to assess journals: the impact a paper in the journal would have on career progression, and the impact beyond academia of papers in the journal. Among the sample of journals studied, the American Journal of Agricultural Economics is ranked at the top for career progression for the aggregate sample, while Science was rated at the top for broader impact. We find no significant correlation between the journal scores based on the two criteria, nor between them and the journals' impact factors. These results suggest that impact beyond academia is poorly aligned with career incentives and that citation measures reflect poorly, if at all, peers' esteem of journals. Heteroscedastic scale-adjusted latent class models reveal marked heterogeneity in journal preferences related to researchers' institutional affiliation and geographic region. We find significant differences in error variance over people and choices: people were less consistent when choosing their least, as opposed to their most, preferred journal. This finding has broader implications given the burgeoning use of best-worst surveys.

[1]  Gregory M. Perry,et al.  WAEA Presidential Address Deciding Where to Publish: Some Observations on Journal Impact Factor and Article Influence Score , 2012 .

[2]  Ronald Rousseau,et al.  Interactions between journal attributes and authors' willingness to wait for editorial decisions , 2012, J. Assoc. Inf. Sci. Technol..

[3]  Not-so-deep impact , 2005, Nature.

[4]  Douglas N. Arnold,et al.  Nefarious Numbers , 2010, ArXiv.

[5]  Sheila Wilson,et al.  Research Excellence Framework , 2013 .

[6]  P Cross,et al.  Eliciting expert opinion on the effectiveness and practicality of interventions in the farm and rural environment to reduce human exposure to Escherichia coli O157 , 2011, Epidemiology and Infection.

[7]  Michael McAleer,et al.  How Should Journal Quality be Ranked? An Application to Agricultural, Energy, Environmental and Resource Economics , 2011 .

[8]  S. O’Keefe,et al.  Publishing pays: Economists’ salaries reflect productivity , 2013 .

[9]  E. Garfield.  The history and meaning of the journal impact factor. , 2006, JAMA.

[10]  T. Flynn.  Valuing citizen and patient preferences in health: recent developments in three types of best–worst scaling , 2010, Expert review of pharmacoeconomics & outcomes research.

[11]  Michael Burton,et al.  Core journals: A reappraisal of the Diamond list , 1995 .

[12]  D. Laband,et al.  The Relative Impacts of Economics Journals: 1970-1990 , 1994 .

[13]  D. Rigby,et al.  Investigating Heterogeneity in the Characterization of Risks Using Best Worst Scaling , 2013, Risk analysis : an official publication of the Society for Risk Analysis.

[14]  Zoran Filipi,et al.  Simulation Study of a Series Hydraulic Hybrid Propulsion System for a Light Truck , 2007 .

[15]  D. Laband.  On the Use and Abuse of Economics Journal Rankings , 2013 .

[16]  Jordan J. Louviere,et al.  An introduction to the application of (case 1) best–worst scaling in marketing research , 2013 .

[17]  M. Burton,et al.  THE RANKING OF AGRICULTURAL ECONOMICS JOURNALS , 1996 .

[18]  Howard J. Wall,et al.  A Journal Ranking for the Ambitious Economist , 2009 .

[19]  Sandra Rousseau,et al.  Journal evaluation by environmental and resource economists: A survey , 2007, Scientometrics.

[20]  L. Thurstone.  A law of comparative judgment. , 1994 .

[21]  P. Abelson.  The Ranking of Economics Journals by the Economic Society of Australia , 2009 .

[22]  Maria Paola Scaparra,et al.  Estimating Business and Management Journal Quality from the 2008 UK Research Assessment Exercise , 2011 .

[23]  Paul F. Burke,et al.  The Scale-Adusted Latent Class Model: application to Museum visitation , 2010 .

[24]  Raymond D. Sauer,et al.  Estimates of the Returns to Quality and Coauthorship in Economic Academia , 1988, Journal of Political Economy.

[25]  J. Lusk,et al.  Submission patterns, submission policies, and revealed preferences for agricultural economics journals. , 2009 .

[26]  Maria Paola Scaparra,et al.  Estimating Business and Management journal quality from the 2008 Research Assessment Exercise in the UK , 2012, Inf. Process. Manag..

[27]  Michael McAleer,et al.  What Makes a Great Journal Great in Economics? The Singer Not the Song , 2010 .

[28]  B. Alberts.  Impact Factor Distortions , 2013, Science.

[29]  John Gibson,et al.  Which Journal Rankings Best Explain Academic Salaries? Evidence from the University of California , 2012 .

[30]  A. Marley,et al.  Best-worst scaling: theory and methods , 2014 .

[31]  Christiana E. Hilmer,et al.  How Do Journal Quality, Co‐Authorship, and Author Order Affect Agricultural Economists' Salaries? , 2005 .

[32]  J. Gans,et al.  How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists , 1994 .

[33]  Ronald Rousseau,et al.  Evaluating Environmental and Resource Economics Journals: A TOP-Curve Approach , 2009, Review of Environmental Economics and Policy.

[34]  E. Fong,et al.  Coercive Citation in Academic Publishing , 2012, Science.

[35]  J. Louviere,et al.  Some probabilistic models of best, worst, and best–worst choices , 2005 .

[36]  Steven H. Cohen.  Maximum Difference Scaling: Improved Measures of Importance and Preference for Segmentation , 2003 .

[37]  Symonds Em.  Research assessment exercise , 1998 .

[38]  Gaines H. Liner.  Core Journals in Economics , 2002 .

[39]  J. Louviere,et al.  Determining the Appropriate Response to Evidence of Public Concern: The Case of Food Safety , 1992 .

[40]  David I. Stern,et al.  Uncertainty Measures for Economics Journal Impact Factors , 2012 .

[41]  Jeroen K. Vermunt,et al.  Categorical response data , 2013 .

[42]  Brian C. Briggeman,et al.  Food Values , 2009, Science.

[43]  Sean Howard,et al.  The Research Assessment Exercise , 1998 .

[44]  L. C. Scott,et al.  Trends in Rankings of Economics Departments in the U.S.: An Update , 1996 .

[45]  Kostas Axarloglou,et al.  Diversity in Economics: An Analysis of Journal Quality Perceptions , 2003 .

[46]  H. Tuckman,et al.  What Is an Article Worth? , 1975, Journal of Political Economy.

[47]  Yolanda K. Kodrzycki,et al.  New Approaches to Ranking Economics Journals , 2006 .

[48]  K. Salhofer,et al.  Going Beyond Impact Factors: A Survey‐based Journal Ranking by Agricultural Economists , 2011 .

[49]  A. Oswald.  An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers , 2006, SSRN Electronic Journal.

[50]  Christiana E. Hilmer,et al.  A Comparison of Salary Structures between Economics and Agricultural Economics Departments , 2012 .