Quantifying the evolution of individual scientific impact

Scientific impact—that is the Q Are there quantifiable patterns behind a successful scientific career? Sinatra et al. analyzed the publications of 2887 physicists, as well as data on scientists publishing in a variety of fields. When productivity (which is usually greatest early in the scientist's professional life) is accounted for, the paper with the greatest impact occurs randomly in a scientist's career. However, the process of generating a high-impact paper is not an entirely random one. The authors developed a quantitative model of impact, based on an element of randomness, productivity, and a factor Q that is particular to each scientist and remains constant during the scientist's career. Science, this issue p. 596 Productivity, ability, and luck are incorporated into an algorithm describing a scientist’s impact. INTRODUCTION In most areas of human performance, from sport to engineering, the path to a major accomplishment requires a steep learning curve and long practice. Science is not that different: Outstanding discoveries are often preceded by publications of less memorable impact. However, despite the increasing desire to identify early promising scientists, the temporal career patterns that characterize the emergence of scientific excellence remain unknown. RATIONALE How do impact and productivity change over a scientific career? Does impact, arguably the most relevant performance measure, follow predictable patterns? Can we predict the timing of a scientist’s outstanding achievement? Can we model, in quantitative and predictive terms, scientific careers? Driven by these questions, here we quantify the evolution of impact and productivity throughout thousands of scientific careers. We do so by reconstructing the publication record of scientists from seven disciplines, associating to each paper its long-term impact on the scientific community, as quantified by citation metrics. RESULTS We find that the highest-impact work in a scientist’s career is randomly distributed within her body of work. That is, the highest-impact work can be, with the same probability, anywhere in the sequence of papers published by a scientist—it could be the first publication, could appear mid-career, or could be a scientist’s last publication. This random-impact rule holds for scientists in different disciplines, with different career lengths, working in different decades, and publishing solo or with teams and whether credit is assigned uniformly or unevenly among collaborators. The random-impact rule allows us to develop a quantitative model, which systematically untangles the role of productivity and luck in each scientific career. The model assumes that each scientist selects a project with a random potential p and improves on it with a factor Qi, resulting in a publication of impact Qip. The parameter Qi captures the ability of scientist i to take advantage of the available knowledge in a way that enhances (Qi > 1) or diminishes (Qi < 1) the potential impact p of a paper. The model predicts that truly high-impact discoveries require a combination of high Q and luck (p) and that increased productivity alone cannot substantially enhance the chance of a very high impact work. We also show that a scientist’s Q, capturing her sustained ability to publish high-impact papers, is independent of her career stage. This is in contrast with all current metrics of excellence, from the total number of citations to the h-index, which increase with time. The Q model provides an analytical expression of these traditional impact metrics and allows us to predict their future time evolution for each individual scientist, being also predictive of independent recognitions, like Nobel prizes. CONCLUSION The random-impact rule and the Q parameter, representing two fundamental characteristics of a scientific career, offer a rigorous quantitative framework to explore the evolution of individual careers and understand the emergence of scientific excellence. Such understanding could help us better gauge scientific performance and offers a path toward nurturing high-impact scientists, potentially informing future policy decisions. Random-impact rule. The publication history of two Nobel laureates, Frank A. Wilczek (Nobel Prize in Physics, 2004) and John B. Fenn (Nobel Prize in Chemistry, 2002), illustrating that the highest-impact work can be, with the same probability, anywhere in the sequence of papers published by a scientist. Each vertical line corresponds to a research paper. The height of each line corresponds to paper impact, quantified with the number of citations the paper received after 10 years. Wilczek won the Nobel Prize for the very first paper he published, whereas Fenn published his Nobel-awarded work late in his career, after he was forcefully retired by Yale. [Image of Frank A. Wilczek is reprinted with permission of STS/Society for Science & the Public. Image of John B. Fenn is available for public domain use on Wikipedia.org.] Despite the frequent use of numerous quantitative indicators to gauge the professional impact of a scientist, little is known about how scientific impact emerges and evolves in time. Here, we quantify the changes in impact and productivity throughout a career in science, finding that impact, as measured by influential publications, is distributed randomly within a scientist’s sequence of publications. This random-impact rule allows us to formulate a stochastic model that uncouples the effects of productivity, individual ability, and luck and unveils the existence of universal patterns governing the emergence of scientific success. The model assigns a unique individual parameter Q to each scientist, which is stable during a career, and it accurately predicts the evolution of a scientist’s impact, from the h-index to cumulative citations, and independent recognitions, such as prizes.

[1]  D. Simonton Career landmarks in science: Individual differences and interdisciplinary contrasts. , 1991 .

[2]  C. Peng,et al.  Long-range correlations in nucleotide sequences , 1992, Nature.

[3]  Dean Keith Simonton,et al.  Creative productivity: A predictive and explanatory model of career trajectories and landmarks. , 1997 .

[4]  Tamas Vicsek,et al.  A question of scale , 2001, Nature.

[5]  OU Ranj Future , 2002, Discursive Constructions of the Suicidal Process.

[6]  Eric P. Smith,et al.  An Introduction to Statistical Modeling of Extreme Values , 2002, Technometrics.

[7]  Guido Caldarelli,et al.  Universal scaling relations in food webs , 2003, Nature.

[8]  D. R. White,et al.  Structural cohesion and embeddedness: A hierarchical concept of social groups , 2003 .

[9]  Robert L. Goldstone,et al.  The simultaneous evolution of author and paper networks , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  K. Börner,et al.  Mapping topics and topic bursts in PNAS , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[11]  S. Redner Citation statistics from 110 years of physical review , 2005, physics/0506056.

[12]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[13]  David Cyranoski,et al.  Cash for papers: putting a premium on publication , 2006, Nature.

[14]  A. D. Jackson,et al.  Measures for measures , 2006, Nature.

[15]  Sune Lehmann,et al.  A quantitative analysis of indicators of scientific performance , 2008, Scientometrics.

[16]  Benjamin F. Jones,et al.  Supporting Online Material Materials and Methods Figs. S1 to S3 References the Increasing Dominance of Teams in Production of Knowledge , 2022 .

[17]  A. D. Jackson,et al.  A quantitative analysis of measures of quality in science , 2007 .

[18]  Claudio Castellano,et al.  Universality of citation distributions: Toward an objective measure of scientific impact , 2008, Proceedings of the National Academy of Sciences.

[19]  Benjamin F. Jones,et al.  Multi-University Research Teams: Shifting Impact, Geography, and Stratification in Science , 2008, Science.

[20]  Chun-Ting Zhang,et al.  A proposal for calculating weighted citations based on author rank , 2009, EMBO reports.

[21]  Francisco Herrera,et al.  h-Index: A review focused in its variants, computation and standardization for different scientific fields , 2009, J. Informetrics.

[22]  Santo Fortunato,et al.  Diffusion of scientific credits and the ranking of scientists , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  S. Havlin,et al.  Scaling laws of human interaction activity , 2009, Proceedings of the National Academy of Sciences.

[24]  James A. Evans,et al.  Open Access and Global Participation in Science , 2009, Science.

[25]  Pierre Azoulay,et al.  Incentives and Creativity: Evidence from the Academic Life Sciences , 2009 .

[26]  L. Amaral,et al.  The role of mentorship in protégé performance , 2010, Nature.

[27]  Marta Sales-Pardo,et al.  Statistical validation of a global model for the distribution of the ultimate number of citations accrued by papers published in a scientific journal , 2010, J. Assoc. Inf. Sci. Technol..

[28]  Benjamin F. Jones,et al.  Age dynamics in scientific creativity , 2011, Proceedings of the National Academy of Sciences.

[29]  Lutz Bornmann,et al.  A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants , 2011, J. Informetrics.

[30]  Jacob G. Foster,et al.  Metaknowledge , 2011, Science.

[31]  Pierre Azoulay Research efficiency: Turn the scientific method on ourselves , 2012, Nature.

[32]  Harry Eugene Stanley,et al.  Persistence and uncertainty in the academic career , 2012, Proceedings of the National Academy of Sciences.

[33]  Konrad Paul Kording,et al.  Future impact: Predicting scientific success , 2012, Nature.

[34]  Santo Fortunato,et al.  On the Predictability of Future Impact in Science , 2013, Scientific Reports.

[35]  Filippo Menczer,et al.  Universality of scholarly impact metrics , 2013, J. Informetrics.

[36]  Cassidy R. Sugimoto,et al.  Bibliometrics: Global gender disparities in science , 2013, Nature.

[37]  Brian M. Owens Research assessments: Judgement day , 2013, Nature.

[38]  James A. Evans,et al.  Future Science , 2013, Science.

[39]  Albert-László Barabási,et al.  Quantifying Long-Term Scientific Impact , 2013, Science.

[40]  Albert-László Barabási,et al.  Collective credit allocation in science , 2014, Proceedings of the National Academy of Sciences.

[41]  Vincent D. Blondel,et al.  Career on the Move: Geography, Stratification, and Scientific Impact , 2014, Scientific Reports.

[42]  Daniel B. Larremore,et al.  Systematic inequality and hierarchy in faculty hiring networks , 2015, Science Advances.

[43]  S. Rijcke,et al.  Bibliometrics: The Leiden Manifesto for research metrics , 2015, Nature.

[44]  Michael Szell,et al.  A century of physics , 2015, Nature Physics.