Why Do Some Articles in Planning Journals Get Cited More than Others?

The planning literature has taken a recent interest in journal article citation counts, which are often used to measure the scholarly impact of articles, authors, or university departments. However, little is known about the factors that determine citation counts for planning-related articles. We find that citation counts in planning vary across planning topics and are also influenced by other journal, author, and article-related factors. We provide recommendations to planning researchers for increasing the impact of their research, and advise consumers of citation counts in planning to consider making particular adjustments to the counts to make them more meaningful.

[1]  A. J. Meadows.  THE CITATION CHARACTERISTICS OF ASTRONOMICAL RESEARCH LITERATURE , 1967 .

[2]  R. Merton.  The Matthew effect in science. The reward and communication systems of science are considered. , 1968, Science.

[3]  R. Merton.  The Matthew Effect in Science , 1968, Science.

[4]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[5]  M. Rossiter.  The Matthew Matilda Effect in Science , 1993 .

[6]  Ian Ayres,et al.  Determinants of Citations to Articles in Elite Law Reviews , 1999 .

[7]  Mark B. Houston,et al.  The Impact of Article Method Type and Subject Area on Article Citations and Reference Diversity in JM, JMR, and JCR , 2001 .

[8]  Inga Dora Sigfusdottir,et al.  Nordic Impact: Article Productivity and Citation Patterns in Sixteen Nordic Sociology Departments , 2002 .

[9]  R. Wears,et al.  Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. , 2002, JAMA.

[10]  D. Aksnes.  CHARACTERISTICS OF HIGHLY CITED PAPERS , 2003 .

[11]  T. Perneger.  Relation between online “hit counts” and subsequent citations: prospective study of research papers in the BMJ , 2004, BMJ : British Medical Journal.

[12]  Clyde W. Holsapple,et al.  A Citation Analysis of Influences on Collaborative Computing Research , 2004, Computer Supported Cooperative Work (CSCW).

[13]  Tony Dale,et al.  Science from the periphery: Collaboration, networks and 'Periphery Effects' in the citation of New Zealand Crown Research Institutes articles, 1995-2000 , 2003, Scientometrics.

[14]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[15]  Andy R Weale,et al.  The level of non-citation of articles within a journal as a measure of quality: a comparison to the impact factor , 2004, BMC medical research methodology.

[16]  Pentti Nieminen,et al.  The effect of statistical methods and study reporting characteristics on the number of citations: A study of four general psychiatric journals , 2003, Scientometrics.

[17]  Concepción S. Wilson,et al.  Measuring the citation impact of research journals in clinical neurology: A structural equation modelling analysis , 2004, Scientometrics.

[18]  Stephen W. Raudenbush,et al.  Turning Highways into Main Streets: Two Innovations in Planning Methodology , 2005 .

[19]  Debora Shaw,et al.  Web citation data for impact assessment: A comparison of four science disciplines , 2005, J. Assoc. Inf. Sci. Technol..

[20]  Helen Georgas,et al.  A Citation Study of the Characteristics of the Linguistics Literature , 2005 .

[21]  Yuman Fong,et al.  Citation characteristics of basic science research publications in general surgical journals. , 2005, The Journal of surgical research.

[22]  K. Frenken,et al.  The citation impact of research collaborations : the case of European biotechnology and applied microbiology (1988-2002) , 2005 .

[23]  Thed N. van Leeuwen,et al.  Characteristics of journal impact factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors , 2005, Scientometrics.

[24]  J. Koricheva,et al.  What determines the citation frequency of ecological papers? , 2005, Trends in ecology & evolution.

[25]  J. Ioannidis,et al.  Relative Citation Impact of Various Study Designs in the Health Sciences , 2005, JAMA.

[26]  P. Verhoef,et al.  The Quest for Citations: Drivers of Article Impact , 2006 .

[27]  Stephen S. Murray,et al.  Effect of E-printing on Citation Rates in Astronomy and Physics , 2006, ArXiv.

[28]  Glenn D. Walters,et al.  Predicting subsequent citations to articles published in twelve crime-psychology journals: Author impact versus journal impact , 2006, Scientometrics.

[29]  H. Goldstein,et al.  Compact, Diffuse, or Would-be Discipline? , 2006 .

[30]  M. Swiontkowski,et al.  Factors associated with citation rates in the orthopedic literature. , 2007, Canadian journal of surgery. Journal canadien de chirurgie.

[31]  A. Kulkarni,et al.  Characteristics Associated with Citation Rate of the Medical Literature , 2007, PloS one.

[32]  Lutz Bornmann,et al.  Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicine , 2007, J. Assoc. Inf. Sci. Technol..

[33]  Anil Kumar,et al.  Research and citation impact of publications by the Chemistry Division at Bhabha Atomic Research Centre , 2007, Scientometrics.

[34]  Heather A. Piwowar,et al.  Sharing Detailed Research Data Is Associated with Increased Citation Rate , 2007, PloS one.

[35]  Moshe Kon,et al.  Value of Citation Numbers and Impact Factors for Analysis of Plastic Surgery Research , 2007, Plastic and reconstructive surgery.

[36]  K. Filion,et al.  Factors related to the frequency of citation of epidemiologic publications , 2008, Epidemiologic perspectives & innovations : EP+I.

[37]  Rick Ralston,et al.  Do local citation patterns support use of the impact factor for collection development? , 2008, Journal of the Medical Library Association : JMLA.

[38]  K. A. McKibbon,et al.  Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study , 2008, BMJ : British Medical Journal.

[39]  George A. Barnett,et al.  Impact of the internet and scholar age distribution on academic citation age , 2008, J. Assoc. Inf. Sci. Technol..

[40]  S. Sala,et al.  Multi-authors' self-citation: A further impact factor bias? , 2008, Cortex.

[41]  Stephen J. Bensman.  Distributional differences of the impact factor in the sciences versus the social sciences: An analysis of the probabilistic structure of the 2005 journal citation reports , 2008, J. Assoc. Inf. Sci. Technol..

[42]  Daren Yu,et al.  Effect of the age of papers on the preferential attachment in citation networks , 2009 .

[43]  Thed N. van Leeuwen,et al.  Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of individual researchers , 2009, J. Assoc. Inf. Sci. Technol..

[44]  Amber E. Budden,et al.  The Influence of Author Gender, National Language and Number of Authors on Citation Rate in Ecology , 2009 .

[45]  Gregory D. Webster,et al.  Hot Topics and Popular Papers in Evolutionary Psychology: Analyses of Title Words and Citation Counts in Evolution and Human Behavior, 1979 – 2008 , 2009 .

[46]  Philip Berke,et al.  Searching for the Good Plan , 2009 .

[47]  S. Sala,et al.  The impact of self-citation , 2010, Cortex.

[48]  H. Goldstein,et al.  The Use and Valuation of Journals in Planning Scholarship: Peer Assessment versus Impact Factors , 2010 .

[49]  Sanghack Lee,et al.  Author and article characteristics, journal quality and citation in economic research , 2010 .

[50]  Lutz Bornmann,et al.  Citation speed as a measure to predict the attention an article receives: An investigation of the validity of editorial decisions at Angewandte Chemie International Edition , 2010, J. Informetrics.

[51]  Vincent Larivière,et al.  Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research , 2010, PloS one.

[52]  Daniella Meeker,et al.  Assessing the scholarly impact of health psychology: a citation analysis of articles published from 1993 to 2003. , 2010, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[53]  José Alexandre Felizola Diniz-Filho,et al.  Weak evidence for determinants of citation frequency in ecological articles , 2010, Scientometrics.

[54]  Omwoyo Bosire Onyancha,et al.  Knowledge production through collaborative research in sub-Saharan Africa: how much do countries contribute to each other’s knowledge output and citation impact? , 2011, Scientometrics.

[55]  K. Frenken,et al.  The citation impact of research collaboration in science‐based industries: A spatial‐institutional analysis , 2010 .

[56]  Elizabeth S. Vieira,et al.  Citations to scientific articles: Its distribution and dependence on the article features , 2010, J. Informetrics.

[57]  T. Jacques,et al.  The impact of article titles on citation hits: an analysis of general and specialist medical journals , 2010, JRSM short reports.

[58]  Nick Haslam,et al.  Predicting Long-Term Citation Impact of Articles in Social and Personality Psychology , 2010, Psychological reports.

[59]  Lawrence D. Fu,et al.  Using content-based and bibliometric features for machine learning models to predict citation counts in the biomedical literature , 2010, Scientometrics.

[60]  Reid Ewing,et al.  Travel and the Built Environment , 2010 .

[61]  Michael M Bornstein,et al.  Lost in translation: the impact of publication language on citation frequency in the scientific dental literature. , 2011, Swiss medical weekly.

[62]  M. HamidR.Jamali,et al.  Article title type and its relation with the number of downloads and citations , 2011, Scientometrics.

[63]  H. Stephen McMinn,et al.  Tracking the use of engineering conference papers: citation influence of the Stapp Car Crash Conference , 2011 .

[64]  Anthony F. J. van Raan,et al.  Non-alphanumeric characters in titles of scientific publications: An analysis of their occurrence and correlation with citation impact , 2011, J. Informetrics.

[65]  Sei-Ching Joanna Sin.  International coauthorship and citation impact: A bibliometric study of six LIS journals, 1980-2008 , 2011, J. Assoc. Inf. Sci. Technol..

[66]  Kevin Winker,et al.  In scientific publishing at the article level, effort matters more than journal impact factors: hard work and co-authors overshadow journal venue in acquiring citations. , 2011, BioEssays : news and reviews in molecular, cellular and developmental biology.

[67]  Weina Hua,et al.  Scholarly impact measurements of LIS open access journals: based on citations and links , 2011, Electron. Libr..

[68]  Ali Gazni,et al.  Investigating different types of research collaboration and citation impact: a case study of Harvard University’s publications , 2011, Scientometrics.

[69]  D. Faulds,et al.  Abstracts , 2012 .

[70]  Chaomei Chen,et al.  Predictive effects of structural variation on citation counts , 2012, J. Assoc. Inf. Sci. Technol..

[71]  Alberto Ruano-Ravina,et al.  Evidence-based editing: factors influencing the number of citations in a national journal. , 2012, Annals of epidemiology.

[72]  Jiang Wu,et al.  Assessing impact and quality from local dynamics of citation networks , 2012, J. Informetrics.

[73]  F. A. Slama,et al.  Two-year citations of JAPPL original articles: evidence of a relative age effect. , 2012, Journal of applied physiology.

[74]  M. Ginsberg,et al.  Introspection: An Analysis of the Citation Impact of Stroke , 2012, Stroke.

[75]  Vincent Larivière,et al.  A Small World of Citations? The Influence of Collaboration Networks on Citation Practices , 2011, PloS one.

[76]  Concha Bielza,et al.  Relationship among research collaboration, number of documents and number of citations: a case study in Spanish computer science production in 2000–2009 , 2013, Scientometrics.

[77]  Jiang Tang,et al.  Citation characterization and impact normalization in bioinformatics journals , 2012, J. Assoc. Inf. Sci. Technol..

[78]  Lutz Bornmann,et al.  What factors determine citation counts of publications in chemistry besides their quality? , 2012, J. Informetrics.

[79]  Jonathan J. H. Zhu,et al.  Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies , 2012, J. Assoc. Inf. Sci. Technol..

[80]  Karen L. Woolley,et al.  Innovative, evidence-based, practical primer tools for publication professionals working with authors in the Asia-Pacific region , 2012 .

[81]  Fabrice Carrat,et al.  Contribution of Genome-Wide Association Studies to Scientific Research: A Bibliometric Survey of the Citation Impacts of GWAS and Candidate Gene Studies Published during the Same Period and in the Same Journals , 2012, PloS one.

[82]  T. Rees,et al.  Accesses versus citations: why you need to measure both to assess publication impact , 2012 .

[83]  Jesper W. Schneider,et al.  ARE LARGER EFFECT SIZES IN EXPERIMENTAL STUDIES GOOD PREDICTORS OF HIGHER CITATION RATES ? A BAYESIAN EXAMINATION , 2013 .

[84]  Daqing He,et al.  The correlations between article citation and references' impact measures: What can we learn? , 2013, ASIST.

[85]  Barbara F. Walter,et al.  The Gender Citation Gap in International Relations , 2013, International Organization.

[86]  Stéfan Jacques Darmoni,et al.  Is the coverage of google scholar enough to be used alone for systematic reviews , 2013, BMC Medical Informatics and Decision Making.

[87]  Vetle I. Torvik,et al.  Deconstructing the collaborative impact: Article and author characteristics that influence citation count , 2013, ASIST.

[88]  Michael N. Mavros,et al.  The Impact of Article Length on the Number of Future Citations: A Bibliometric Analysis of General Medicine Journals , 2013, PloS one.

[89]  Joost C. F. de Winter,et al.  The expansion of Google Scholar versus Web of Science: a longitudinal study , 2013, Scientometrics.

[90]  Jerome K. Vanclay,et al.  Factors affecting citation rates in environmental science , 2013, J. Informetrics.

[91]  Gaston Heimeriks,et al.  Do more distant collaborations have more citation impact? , 2013, J. Informetrics.

[92]  Cassidy R. Sugimoto,et al.  Do Altmetrics Work? Twitter and Ten Other Social Web Services , 2013, PloS one.

[93]  Hanna-Mari Puuska,et al.  International and domestic co-publishing and their citation impact in different disciplines , 2013, Scientometrics.

[94]  Jens Peter Andersen,et al.  Influence of study design on the citation patterns of Danish, medical research , 2013 .

[95]  Mike Thelwall,et al.  Determinants of research citation impact in nanoscience and nanotechnology , 2013, J. Assoc. Inf. Sci. Technol..

[96]  Mazda Farshad,et al.  Association of scientific and nonscientific factors to citation rates of articles of renowned orthopedic journals , 2013 .

[97]  Clément Bosquet,et al.  Are academics who publish more also more cited? Individual determinants of publication and citation records , 2013, Scientometrics.

[98]  Silvia Knobloch-Westerwick,et al.  The Matilda Effect—Role Congruity Effects on Scholarly Communication , 2013, Commun. Res..

[99]  Mohammad Hajizadeh,et al.  The effect of characteristics of title on citation rates of articles , 2013, Scientometrics.

[100]  Sally Wyatt,et al.  What a difference a colon makes: how superficial factors influence subsequent citation , 2013, Scientometrics.

[101]  Anthony F. J. van Raan,et al.  Citation Analysis May Severely Underestimate the Impact of Clinical Research as Compared to Basic Research , 2012, PloS one.

[102]  Lutz Bornmann,et al.  How to calculate the practical significance of citation impact differences? An empirical example from evaluative institutional bibliometrics using adjusted predictions and marginal effects , 2013, J. Informetrics.

[103]  Ngianga-Bakwin Kandala,et al.  Bibliometrics of systematic reviews: analysis of citation rates and journal impact factors , 2013, Systematic Reviews.

[104]  Mike Thelwall,et al.  The long-term influence of collaboration on citation patterns , 2014 .

[105]  Tomo Cerovsek,et al.  A comparative study of cross-domain research output and citations: Research impact cubes and binary citation frequencies , 2014, J. Informetrics.

[106]  Tian Yu,et al.  Features of scientific papers and the relationships with their citation impact , 2014 .

[107]  Lei Wang,et al.  Why Do IS Scholars Cite Other Scholars? An Empirical Analysis of the Direct and Moderating Effects of Cooperation and Competition among IS Scholars on Individual Citation Behavior , 2014, ICIS.

[108]  Mark R. Stevens,et al.  Measuring and Reporting Intercoder Reliability in Plan Quality Evaluation Research , 2014 .

[109]  Félix de Moya Anegón,et al.  Relationship between downloads and citations at journal and paper levels, and the influence of language , 2014, Scientometrics.

[110]  Jian Wang,et al.  How to improve the prediction based on citation impact percentiles for years shortly after the publication date? , 2013, J. Informetrics.

[111]  Carlo Giupponi,et al.  Co-Authorship and Bibliographic Coupling Network Effects on Citations , 2014, PloS one.

[112]  Mark R. Stevens,et al.  Plan Quality Evaluation 1994–2012 , 2014 .

[113]  R. Jayawardena,et al.  Determinants of the citation rate of medical research publications from a developing country , 2014, SpringerPlus.

[114]  Bhaskar Mukherjee,et al.  Short and amusing: The relationship between title characteristics, downloads, and citations in psychology articles , 2014, J. Inf. Sci..

[115]  R. Lira,et al.  Comparação das características de citação entre os relatos de caso/séries de casos versus demais desenhos de estudos nos artigos publicados em periódicos brasileiros de Oftalmologia , 2014 .

[116]  Tian Yu,et al.  Citation impact prediction for scientific papers using stepwise regression analysis , 2014, Scientometrics.

[117]  Rafael Suárez-Vega,et al.  Journal topic citation potential and between-field comparisons: The topic normalized impact factor , 2014, J. Informetrics.

[118]  Barbara J. Robson,et al.  Predicting citation counts of environmental modelling papers , 2014 .

[119]  Reid Ewing,et al.  Varying influences of the built environment on household travel in 15 diverse regions of the United States , 2015 .

[120]  Alan L. Porter,et al.  Distance and velocity measures: using citations to determine breadth and speed of research impact , 2014, Scientometrics.

[121]  Thomas V Perneger,et al.  Online accesses to medical research articles on publication predicted citations up to 15 years later. , 2015, Journal of clinical epidemiology.

[122]  Fuyuki Yoshikane,et al.  Factors affecting citation rates of research articles , 2015, J. Assoc. Inf. Sci. Technol..

[123]  Christian B. van der Pol,et al.  Is Quality and Completeness of Reporting of Systematic Reviews and Meta-Analyses Published in High Impact Radiology Journals Associated with Citation Rates? , 2015, PloS one.

[124]  Han Woo Park,et al.  Factors affecting citation networks in science and technology: focused on non-quality factors , 2014, Quality & Quantity.

[125]  Reid Ewing,et al.  Traffic Generated by Mixed-Use Developments , 2015 .

[126]  S. Stremersch,et al.  Unraveling scientific impact: Citation types in marketing journals , 2015 .

[127]  G. Antoniou,et al.  Bibliometric analysis of factors predicting increased citations in the vascular and endovascular literature. , 2015, Annals of vascular surgery.

[128]  Li Fang,et al.  Do Clusters Encourage Innovation? A Meta-analysis , 2015 .

[129]  Rodrigo Costas,et al.  Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective , 2014, J. Assoc. Inf. Sci. Technol..

[130]  Iman Tahamtan,et al.  Factors affecting number of citations: a comprehensive review of the literature , 2016, Scientometrics.

[131]  Galen D. Newman,et al.  A Statistical Meta-analysis of the Design Components of New Urbanism on Housing Prices , 2016 .

[132]  R. Ewing,et al.  Traffic Generated by Mixed-Use Developments thirteen-region study Using Consistent measures of Built environment , 2016 .

[133]  Mark R. Stevens,et al.  Does Compact Development Make People Drive Less? , 2017 .

[134]  Emilio Delgado López-Cózar,et al.  Can we use Google Scholar to identify highly-cited documents? , 2017, J. Informetrics.

[135]  Thomas W Sanchez.  Faculty Performance Evaluation Using Citation Analysis , 2017 .

[136]  Normative versus Actual Methodologies in Planning Research: A Hybrid Picture , 2017 .