A bibliometric measure of translational science

Science funders are increasingly requiring evidence of the broader impacts of even basic research. Initiatives such as NIH’s CTSA program are designed to shift the research focus toward more translational research. However, tracking the effectiveness of such programs depends on developing indicators that can track the degree to which basic research is influencing clinical research. We propose a new bibliometric indicator, the TS score, that is relatively simple to calculate, can be implemented at scale, is easy to replicate, and has good reliability and validity properties. This indicator is broadly applicable in settings where the goal is to estimate the degree to which basic research is used in more applied downstream research, relative to use in basic research. The TS score should be of use for a variety of policy analysis and research evaluation purposes.

[1]  D. Rubio,et al.  Evaluating Translational Research , 2012 .

[2]  S. Wooding,et al.  The answer is 17 years, what is the question: understanding time lags in translational research , 2011, Journal of the Royal Society of Medicine.

[3]  Alexander R. Pico,et al.  From Scientific Discovery to Cures: Bright Stars within a Galaxy , 2015, Cell.

[4]  Xueying Han,et al.  A snapshot of translational research funded by the National Institutes of Health (NIH): A case study using behavioral and social science research awards and Clinical and Translational Science Awards funded publications , 2018, PloS one.

[5]  Cathleen Kane,et al.  Evaluating Translational Research: A Process Marker Model , 2011, Clinical and translational science.

[6]  K. Kolibaba,et al.  Interactions of CBL with BCR-ABL and CRKL in BCR-ABL-transformed Myeloid Cells* , 1997, The Journal of Biological Chemistry.

[7]  Nahid Golafshani,et al.  Understanding Reliability and Validity in Qualitative Research , 2003 .

[8]  M. Meyer.  Does science push technology? Patents citing scientific literature , 2000 .

[9]  Mark A. Lemley,et al.  Do Applicant Patent Citations Matter? , 2012 .

[11]  Isabel Gómez,et al.  An approach to interdisciplinarity through bibliometric indicators , 2001, Scientometrics.

[12]  G. Shaw,et al.  Transdisciplinary translational science and the case of preterm birth , 2012, Journal of Perinatology.

[13]  F. Liu,et al.  Finding Translational Science Publications in MEDLINE/PubMed with Translational Science Filters , 2011, Clinical and translational science.

[14]  Citations in Life Science Patents to Publicly Funded Research at Academic Medical Centers , 2015, Clinical and translational science.

[15]  D. Rubio,et al.  Defining Translational Research: Implications for Training , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[16]  Bryn Lander,et al.  Translational science and the hidden research system in universities and academic hospitals: a case study. , 2011, Social science & medicine.

[17]  K. Myers.  The Elasticity of Science , 2019, American Economic Journal: Applied Economics.

[18]  Bryn Lander,et al.  Translational Science and the Hidden Research System , 2009 .

[19]  C. Lance,et al.  The Sources of Four Commonly Reported Cutoff Criteria , 2006 .

[20]  C Simone Fishburn,et al.  Translational research: the changing landscape of drug discovery. , 2013, Drug discovery today.

[21]  Elizabeth C. Whipple,et al.  Classifying publications from the clinical and translational science award program along the translational research spectrum: a machine learning approach , 2016, Journal of Translational Medicine.

[22]  Chun-Chieh Wang,et al.  Measuring science-based science linkage and non-science-based linkage of patents through non-patent references , 2015, J. Informetrics.

[23]  Mike Thelwall,et al.  Google Scholar, Web of Science, and Scopus: a systematic comparison of citations in 252 subject categories , 2018, J. Informetrics.

[24]  Chaomei Chen,et al.  Tracing knowledge diffusion , 2004, Scientometrics.

[25]  Mu-Hsuan Huang,et al.  Increasing science and technology linkage in fuel cells: A cross citation analysis of papers and patents , 2015, J. Informetrics.

[26]  J. Tsevat,et al.  NIH Grant Awards as a Metric of Clinical and Translational Research Training Effectiveness , 2015, Clinical and translational science.

[27]  Alan L. Porter,et al.  An indicator of cross-disciplinary research , 1985, Scientometrics.

[28]  John P A Ioannidis,et al.  Life Cycle of Translational Research for Medical Interventions , 2008, Science.

[29]  George M. Santangelo,et al.  Predicting translational progress in biomedical research , 2019, PLoS biology.

[30]  Dorothy R. Carter,et al.  Charting the Publication and Citation Impact of the NIH Clinical and Translational Science Awards (CTSA) Program From 2006 Through 2016 , 2018, Academic medicine : journal of the Association of American Medical Colleges.

[31]  Yeon Hak Kim.  Bridging the Valley of Death in Biomedicine with Translational Research: Assessing the Impact of National Institutes of Health's Clinical and Translational Science Award , 2019 .

[32]  H. Akil,et al.  Cellular localization and distribution of the cloned mu and kappa opioid receptors in rat gastrointestinal tract , 1997, Neuroscience.

[33]  Kimberly S. Hamilton,et al.  The increasing linkage between U.S. technology and public science , 1997 .

[34]  Danielle Li,et al.  The applied value of public investments in biomedical research , 2017, Science.

[35]  N. Lorenzi,et al.  Translational research: understanding the continuum from bench to bedside. , 2011, Translational research : the journal of laboratory and clinical medicine.

[36]  Cathy C Sarli,et al.  Using publication metrics to highlight academic productivity and research impact. , 2014, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[37]  D. Luke,et al.  Breaking Down Silos: Mapping Growth of Cross‐Disciplinary Collaboration in a Translational Science Initiative , 2015, Clinical and translational science.

[38]  Karen Antell,et al.  Tracking Cross-Disciplinary Information Use by Author Affiliation: Demonstration of a Method , 2006 .

[39]  F. W. Lancaster,et al.  Types and Levels of Collaboration in Interdisciplinary Research in the Sciences , 1997, J. Am. Soc. Inf. Sci..

[40]  D. Butler.  Translational research: Crossing the valley of death , 2008, Nature.

[41]  M. Schneider,et al.  Feasibility of common bibliometrics in evaluating translational science , 2017, Journal of Clinical and Translational Science.

[42]  G. Weber.  Identifying translational science within the triangle of biomedicine , 2013, Journal of Translational Medicine.

[43]  Gabriel Pinski,et al.  Structure of the Biomedical Literature , 1976, J. Am. Soc. Inf. Sci..

[44]  U. Garg,et al.  Nitric oxide-generating vasodilators inhibit mitogenesis and proliferation of BALB/C 3T3 fibroblasts by a cyclic GMP-independent mechanism. , 1990, Biochemical and biophysical research communications.

[45]  M. Ihli.  Acknowledgement Lag and Impact: Domain Differences in Published Research Supported by the National Science Foundation , 2016 .

[46]  Dorothy R. Carter,et al.  Scope, Influence, and Interdisciplinary Collaboration: The Publication Portfolio of the NIH Clinical and Translational Science Awards (CTSA) Program From 2006 Through 2017 , 2020, Evaluation & the health professions.

[47]  George A. Mashour,et al.  Toward a science of translational science , 2017, Journal of Clinical and Translational Science.

[48]  C. Blümel.  Translational research in the science policy debate: a comparative analysis of documents , 2018 .

[49]  S. Woolf.  The meaning of translational research and why it matters. , 2008, JAMA.

[50]  F. W. Lancaster,et al.  Types and levels of collaboration in interdisciplinary research in the sciences , 1997 .

[51]  Assessing the Impact of the NIH CTSA Program on Institutionally Sponsored Clinical Trials , 2013, Clinical and translational science.

[52]  E. Zerhouni.  Translational and clinical science--time for a new vision. , 2005, The New England journal of medicine.

[53]  Robert Cottrell,et al.  Evaluating “payback” on biomedical research from papers cited in clinical guidelines: applied bibliometric study , 2000, BMJ : British Medical Journal.

[54]  A. Goldberg,et al.  Inhibitors of the proteasome block the degradation of most cell proteins and the generation of peptides presented on MHC class I molecules , 1994, Cell.