Patent Citations Analysis and Its Value in Research Evaluation: A Review and a New Approach to Map Technology-relevant Research

Purpose: First, to review the state-of-the-art in patent citation analysis, particularly characteristics of patent citations to scientific literature (scientific non-patent references,SNPRs). Second, to present a novel mapping approach to identify technology-relevant research based on the papers cited by and referring to the SNPRs. Design/methodology/approach: In the review part we discuss the context of SNPRs such as the time lags between scientific achievements and inventions. Also patent-to-patent citation is addressed particularly because this type of patent citation analysis is a major element in the assessment of the economic value of patents. We also review the research on the role of universities and researchers in technological development, with important issues such as universities as sources of technological knowledge and inventor-author relations. We conclude the review part of this paper with an overview of recent research on mapping and network analysis of the science and technology interface and of technological progress in interaction with science. In the second part we apply new techniques for the direct visualization of the cited and citing relations of SNPRs, the mapping of the landscape around SNPRs by bibliographic coupling and co-citation analysis, and the mapping of the conceptual environment of SNPRs by keyword co-occurrence analysis. Findings: We discuss several properties of SNPRs. Only a small minority of publications covered by the Web of Science or Scopus are cited by patents, about 3%–4%. However, for publications based on university-industry collaboration the number of SNPRs is considerably higher, around 15%. The proposed mapping methodology based on a “second order SNPR approach” enables a better assessment of the technological relevance of research. Research limitations: The main limitation is that a more advanced merging of patent and publication data, in particular unification of author and inventor names, in still a necessity. Practical implications: The proposed mapping methodology enables the creation of a database of technology-relevant papers (TRPs). In a bibliometric assessment the publications of research groups, research programs or institutes can be matched with the TRPs and thus the extent to which the work of groups, programs or institutes are relevant for technological development can be measured. Originality/value: The review part examines a wide range of findings in the research of patent citation analysis. The mapping approach to identify a broad range of technology relevant papers is novel and offers new opportunities in research evaluation practices.

[1]  Henry G. Small,et al.  Emerging research fronts in science and technology: patterns of new knowledge development , 2009, Scientometrics.

[2]  Anthony F. J. van Raan,et al.  Dormitory of Physical and Engineering Sciences: Sleeping Beauties May Be Sleeping Innovations. , 2015, 1506.01540.

[3]  E. C. Engelsman,et al.  A patent-based cartography of technology , 1994 .

[4]  Willy C. Shih,et al.  Bridging Science and Technology through Academic-Industry Partnerships , 2014 .

[5]  Mihail C. Roco,et al.  Longitudinal study on patent citations to academic research articles in nanotechnology (1976–2004) , 2007 .

[6]  Christian Sternitzke,et al.  Knowledge sources, patent protection, and commercialization of pharmaceutical innovations☆ , 2010 .

[7]  Tetsuo Wada Obstacles to prior art searching by the trilateral patent offices: empirical evidence from International Search Reports , 2016, Scientometrics.

[8]  Kimberly S. Hamilton,et al.  The increasing linkage between U.S. technology and public science , 1997 .

[9]  Mu-Hsuan Huang,et al.  Measuring technological performance of assignees using trace metrics in three fields , 2015, Scientometrics.

[10]  R. Tijssen Global and domestic utilization of industrial relevant science: patent citation analysis of science-technology interactions and knowledge flows , 2001 .

[11]  Martin S. Meyer,et al.  Patent citation analysis in a novel field of technology:An exploration of nano-science and nano-technology , 2001, Scientometrics.

[12]  K. Packer,et al.  Patenting Culture in Science: Reinventing the Scientific Wheel of Credibility , 1996 .

[13]  Kristie Briggs,et al.  Co-owner relationships conducive to high quality joint patents , 2015 .

[14]  Xianwen Wang,et al.  Are significant inventions more diversified? , 2014, Scientometrics.

[15]  Stéphane Maraut,et al.  Identifying author–inventors from Spain: methods and a first insight into results , 2014, Scientometrics.

[16]  Robert J. W. Tijssen,et al.  R&D dynamics and scientific breakthroughs in HIV/AIDS drugs development: the case of Integrase Inhibitors , 2014, Scientometrics.

[17]  Janghyeok Yoon,et al.  Assessing coreness and intermediarity of technology sectors using patent co-classification analysis: the case of Korean national R&D , 2013, Scientometrics.

[18]  Martin Meyer,et al.  Patent Citations in a Novel Field of Technology — What Can They Tell about Interactions between Emerging Communities of Science and Technology? , 2000, Scientometrics.

[19]  Bart Van Looy,et al.  Sources of inspiration? Making sense of scientific references in patents , 2014, Scientometrics.

[20]  Henk F. Moed,et al.  An exploration of the science base of recent technology , 1990 .

[21]  Bart Van Looy,et al.  Exploring the feasibility and accuracy of Latent Semantic Analysis based text mining techniques to detect similarity between patent documents and scientific publications , 2010, Scientometrics.

[22]  Jonathan Grant,et al.  Basic research and health: a reassessment of the scientific basis for the support of biomedical science , 2003 .

[23]  Leonardo Costa Ribeiro,et al.  A methodology for unveiling global innovation networks: patent citations as clues to cross border knowledge flows , 2014, Scientometrics.

[24]  D. Harhoff,et al.  Citation Frequency and the Value of Patented Inventions , 1999, Review of Economics and Statistics.

[25]  S. Stankovich,et al.  Graphene-based composite materials , 2006, Nature.

[26]  Jingjing Zhang,et al.  The impact of multilevel networks on innovation , 2015 .

[27]  Marc Rysman,et al.  Identifying the age profile of patent citations: new estimates of knowledge diffusion , 2010 .

[28]  Myong Kee Jeong,et al.  New multi-stage similarity measure for calculation of pairwise patent similarity in a patent citation network , 2015, Scientometrics.

[29]  Koenraad Debackere,et al.  Developing Technology in the Vicinity of Science: An Examination of the Relationship between Science Intensity (of Patents) and Technological Productivity within the Field of Biotechnology , 2006 .

[30]  Alberto Di Minin,et al.  Visualizing the structure and bridges of the intellectual property management and strategy literature: a document co-citation analysis , 2014, Scientometrics.

[31]  Melissa A. Schilling,et al.  Mapping the Technological Landscape: Measuring Technology Distance, Technological Footprints, and Technology Evolution , 2016 .

[32]  Francis Narin,et al.  Citation rates to technologically important patents , 1981 .

[33]  Nadine Roijakkers,et al.  How fast do Chinese firms learn and catch up? Evidence from patent citations , 2013, Scientometrics.

[34]  Sascha G. Walter,et al.  Patenting rationales of academic entrepreneurs in weak and strong organizational regimes , 2016 .

[35]  Bangrae Lee,et al.  Mapping Korea’s national R&D domain of robot technology by using the co-word analysis , 2008, Scientometrics.

[36]  Francis Narin,et al.  Is technology becoming science? , 1985, Scientometrics.

[37]  John S. Liu,et al.  Exploring knowledge diffusion among nations: a study of core technologies in fuel cells , 2014, Scientometrics.

[38]  Arvids A. Ziedonis,et al.  Markets versus Spillovers in Outflows of University Research , 2014 .

[39]  M. Trajtenberg A Penny for Your Quotes : Patent Citations and the Value of Innovations , 1990 .

[40]  Andre K. Geim,et al.  Electric Field Effect in Atomically Thin Carbon Films , 2004, Science.

[41]  W. S. Hummers,et al.  Preparation of Graphitic Oxide , 1958 .

[42]  Anthony Breitzman,et al.  The Emerging Clusters Model: A tool for identifying emerging technologies across multiple patent systems , 2015 .

[43]  Myong Kee Jeong,et al.  Inter-cluster connectivity analysis for technology opportunity discovery , 2014, Scientometrics.

[44]  B. Looy,et al.  Does involvement in patenting jeopardize one’s academic footprint? An analysis of patent-paper pairs in biotechnology , 2015 .

[45]  Yuya Kajikawa,et al.  The effect of patent family information in patent citation network analysis: a comparative case study in the drivetrain domain , 2015, Scientometrics.

[46]  Andre K. Geim,et al.  The rise of graphene. , 2007, Nature materials.

[47]  Fiona E. Murray The role of academic inventors in entrepreneurial firms: sharing the laboratory life , 2004 .

[48]  Sameeksha Desai,et al.  A new industry creation and originality: Insight from the funding sources of university patents , 2014 .

[49]  Bart Van Looy,et al.  Science or graduates: How do firms benefit from the proximity of universities? , 2014 .

[50]  Tong Liu,et al.  Using the comprehensive patent citation network (CPC) to evaluate patent value , 2015, Scientometrics.

[51]  Hariolf Grupp,et al.  Exploring the science and technology interface: inventor-author relations in laser medicine research , 1994 .

[52]  Ismael Rafols,et al.  Local emergence and global diffusion of research technologies: An exploration of patterns of network formation , 2010, J. Assoc. Inf. Sci. Technol..

[53]  J A Grobler,et al.  Inhibitors of strand transfer that prevent integration and inhibit HIV-1 replication in cells. , 2000, Science.

[54]  Bart Van Looy,et al.  Patent citation indicators: One size fits all? , 2015, Scientometrics.

[55]  Kevin W. Boyack,et al.  Measuring science-technology interaction using rare inventor-author names , 2008, J. Informetrics.

[56]  H. Small,et al.  Identifying emerging topics in science and technology , 2014 .

[57]  Pete Philipson,et al.  Measuring the Impact of Research: Lessons from the UK’s Research Excellence Framework 2014 , 2016, PloS one.

[58]  Ugo Finardi,et al.  Time relations between scientific production and patenting of knowledge: the case of nanotechnologies , 2011, Scientometrics.

[59]  A. Salter,et al.  Accounting for Universities’ Impact: Using Augmented Data to Measure Academic Engagement and Commercialization by Academic Scientists , 2015 .

[60]  Thed N. van Leeuwen,et al.  Scientific capabilities and technological performance of national innovation systems: An exploration of emerging industrial relevant research domains , 2006, Scientometrics.

[61]  Xianwen Wang,et al.  Patent co-citation networks of Fortune 500 companies , 2011, Scientometrics.

[62]  Christopher L. Magee,et al.  Quantitative Determination of Technological Improvement from Patent Data , 2015, PloS one.

[63]  Bart Van Looy,et al.  Delineating the scientific footprint in technology: Identifying scientific publications within non-patent references , 2011, Scientometrics.

[64]  Anthony F. J. van Raan,et al.  Exploring the Relationship between the Engineering and Physical Sciences and the Health and Life Sciences by Advanced Bibliometric Methods , 2014, PloS one.

[65]  M. Gittelman,et al.  Applicant and Examiner Citations in US Patents: An Overview and Analysis , 2008 .

[66]  Péter Érdi,et al.  Recognition of emerging technology trends: class-selective study of citations in the U.S. Patent Citation Network , 2016, Scientometrics.

[67]  Shih-Chang Hung,et al.  Is small actually big? The chaos of technological change , 2014 .

[68]  Wonjoon Kim,et al.  Dynamic patterns of technological convergence in printed electronics technologies: patent citation network , 2013, Scientometrics.

[69]  Bart Van Looy,et al.  Measuring Industry-Science Links Through Inventor-Author Relations: A Profiling Method , 2006 .

[70]  Bart Verspagen,et al.  Does it matter where patent citations come from? Inventor versus examiner citations in European patents , 2005 .

[71]  Koenraad Debackere,et al.  Traces of Prior Art: An analysis of non-patent references found in patent documents , 2006, Scientometrics.

[72]  Szu-chia S. Lo,et al.  Scientific linkage of science research and technology development: a case of genetic engineering research , 2009, Scientometrics.

[73]  H. Roberts Coward,et al.  Identifying the Science-Technology Interface: Matching Patent Data to a Bibliometric Model , 1989 .

[74]  Bronwyn H Hall,et al.  Market value and patent citations , 2005 .

[75]  Reinhilde Veugelers,et al.  Measuring Technological Novelty with Patent-Based Indicators , 2015 .

[76]  F. Narin,et al.  Direct validation of citation counts as indicators of industrially important patents , 1991 .

[77]  Thed N. van Leeuwen,et al.  Technological Relevance of Science: An Assessment of Citation Linkages between Patents and Research Papers , 2000, Scientometrics.

[78]  Doyeon Kim,et al.  Analyzing technology impact networks for R&D planning using patents: combined application of network approaches , 2014, Scientometrics.

[79]  Anthony F. J. van Raan,et al.  Bibliometric cartography of scientific and technological developments of an R & D field , 1994, Scientometrics.

[80]  Massimo Riccaboni,et al.  Networks of innovators within and across borders. Evidence from patent data , 2013 .

[81]  Robert J. W. Tijssen,et al.  Early stage identification of breakthroughs at the interface of science and technology: lessons drawn from a landmark publication , 2014, Scientometrics.

[82]  Koenraad Debackere,et al.  Linking science to technology: Using bibliographic references in patents to build linkage schemes , 2004, Scientometrics.

[83]  Minsung Kim,et al.  Entropy and Gravity Concepts as New Methodological Indexes to Investigate Technological Convergence: Patent Network-Based Approach , 2014, PloS one.

[84]  Yu Jun,et al.  Functionalized Graphene Oxide Nanocomposite Membrane for Low Humidity and High Temperature Proton Exchange Membrane Fuel Cells , 2011 .

[85]  Francis Narin,et al.  Validation study: Patent citations as indicators of science and foreign dependence , 1983 .

[86]  Ulrich Schmoch,et al.  Tracing the knowledge transfer from science to technology as reflected in patent indicators , 2005, Scientometrics.

[87]  Sherwin Cw,et al.  Project hindsight. A Defense Department study of the utility of research. , 1967, Science.

[88]  Cherng G. Ding,et al.  Evaluating and comparing the university performance in knowledge utilization for patented inventions , 2014, Scientometrics.

[89]  Naomi Fukuzawa,et al.  Science linkages between scientific articles and patents for leading scientists in the life and medical sciences field: the case of Japan , 2015, Scientometrics.

[90]  S. Breschi,et al.  Networks of inventors and the role of academia: an exploration of Italian patent data , 2004 .