A historical reflection on research evaluation studies, their recurrent themes and challenges

in this work. This electronic representation of RAND intellectual property is provided for non-commercial use only. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. Permission is required from RAND to reproduce, or reuse in another form, any of our research documents for commercial use. For information on reprint and linking permissions, please see RAND Permissions. Limited Electronic Distribution Rights This PDF document was made available from www.rand.org as a public service of the RAND Corporation.

[1]  Z. Griliches.  Research Costs and Social Returns: Hybrid Corn and Related Innovations , 1958, Journal of Political Economy.

[2]  Richard A Collins,et al.  A systematic evaluation of payback of publicly funded health and health services research in Hong Kong , 2007, BMC Health Services Research.

[3]  Kevin M. Murphy,et al.  The Economic Value of Medical Research , 2000 .

[4]  Jonathan Grant,et al.  Health Research Evaluation Frameworks: An International Comparison , 2008 .

[5]  J. Vaizey,et al.  The economics of research and technology , 1973 .

[6]  I. Nonaka.  A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[7]  John Sizer,et al.  The rôle of performance indicators in higher education , 1992 .

[8]  Steve Hanney,et al.  How Can Payback from Health Services Research Be Assessed? , 1996, Journal of health services research & policy.

[9]  C. Clarke,et al.  The Sources of Invention , 1969 .

[10]  R. Wakeford,et al.  The correlates of research success. , 1987, British medical journal.

[11]  Henk W. Volberda,et al.  Co-evolution of Firm Absorptive Capacity and Knowledge Environment: Organizational Forms and Combinative Capabilities , 1999 .

[12]  M. Buxton,et al.  From bench to bedside: Tracing the payback forwards from basic or early clinical research – A preliminary exercise and proposals for a future study , 2010 .

[13]  Steven Wooding,et al.  Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign' , 2004, Health research policy and systems.

[14]  Z. Griliches.  The Search for R&D Spillovers , 1991 .

[15]  P. Knapp.  Evolution, Complex Systems and the Dialectic , 1999 .

[16]  L. Georghiou,et al.  Evaluation of Research: A Selection of Current Practices , 1987 .

[17]  J Raftery,et al.  An assessment of the impact of the NHS Health Technology Assessment Programme. , 2007, Health technology assessment.

[18]  Mark de Rond,et al.  Choice, chance, and inevitability in strategy , 2007 .

[19]  J. Kenneth Benson,et al.  Organizations: A Dialectical View. , 1977 .

[20]  Stuart Blackman.  The right research mix , 2004 .

[21]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[22]  Sonja Marjanovic,et al.  The Legitimacy of Messiness: Interdisciplinary Research, Systems of Innovation, and Strategic Alliances , 2006 .

[23]  Edwin Mansfield,et al.  Academic research and industrial innovation , 1991 .

[24]  B. Martin,et al.  Foresight in Science: Picking the Winners , 1984 .

[25]  Steven Wooding,et al.  Assessing the impact of health technology assessment in the Netherlands , 2008, International Journal of Technology Assessment in Health Care.

[26]  D. Stryer,et al.  The outcomes of outcomes and effectiveness research: impacts and lessons from the first decade. , 2000, Health services research.

[27]  Robert Fildes,et al.  Research Foresight: priority setting in science , 1991 .

[28]  J. Landefeld,et al.  Biomedical research: Costs and benefits , 1979 .

[29]  Roy Rothwell,et al.  The characteristics of successful innovators and technically progressive firms (with some comments on innovation research) , 1977 .

[30]  J. Grant,et al.  From bedside to bench: Comroe and dripps revisited , 2010 .

[31]  M. Henkel,et al.  Government and Research: The Rothschild Experiment in a Government Department , 1983 .

[32]  Ritu Sadana,et al.  Knowledge for better health: a conceptual framework and foundation for health research systems. , 2003, Bulletin of the World Health Organization.

[33]  Henry R. Hertzfeld,et al.  Measuring Returns to Space Research and Development , 1992 .

[34]  R Smith,et al.  The roots of innovation. , 1987, British medical journal.

[35]  B. Weisbrod.  Costs and Benefits of Medical Research: A Case Study of Poliomyelitis , 1971, Journal of Political Economy.

[36]  Benno Müller-Hill,et al.  Quality and efficiency of basic research in molecular biology: a bibliometric analysis of thirteen excellent research institutes , 1995 .

[37]  C. Edquist,et al.  Institutions and Organizations in Systems of Innovation , 2013 .

[38]  Luke Georghiou,et al.  Evaluating technology programs: tools and methods , 2000 .

[39]  Eliezer Geisler.  The measurement of scientific activity: Research directions in linking philosophy of science and metrics of science and technology outputs , 2005, Scientometrics.

[40]  Jordi Molas-Gallart,et al.  Assessing the non-academic impact of grant-funded socio-economic research: results from a pilot study. , 2000 .

[41]  H. Cameron,et al.  RTD Evaluation Toolbox - Assessing The Socio-Economic Impact of RTD Policies , 2002 .

[42]  M. Henkel,et al.  Government and Research: Thirty Years of Evolution , 2010 .

[43]  S. Rynes,et al.  ‘Organization Studies as Applied Science: The Generation and Use of Academic Knowledge about Organizations’ , 2006 .

[44]  J. H. Comroe,et al.  Retrospectroscope: Insights into Medical Discovery , 1977 .

[45]  Stephen Hanney,et al.  The Returns from Arthritis Research Volume 1: Approach, Analysis and Recommendations , 2004 .

[46]  Barry Bozeman,et al.  The case study as research heuristic: lessons from the R&D value mapping project , 1999 .

[47]  L Leiserson,et al.  Project hindsight. , 1967, Science.

[48]  Karl Kreilkamp.  Hindsight and the Real World of Science Policy , 1971 .

[49]  Michael Gibbons,et al.  The roles of science in technological innovation , 1993 .

[50]  Jonathan Grant,et al.  Basic research and health: a reassessment of the scientific basis for the support of biomedical science , 2003 .

[51]  Outcomes from NHMRC public health research project grants awarded in 1993 , 2001, Australian and New Zealand journal of public health.

[52]  W. Powell,et al.  Interorganizational Collaboration and the Locus of Innovation: Networks of Learning in Biotechnology. , 1996 .

[53]  M. Mcgregor,et al.  Assessing the Impact of Health Technology Assessment , 1997, International Journal of Technology Assessment in Health Care.

[54]  Martin J Buxton,et al.  The utilisation of health research in policy-making : concepts , examples and methods of assessment , 2003 .

[55]  I. Byatt,et al.  An attempt to quantify the economic benefits of scientific research , 1969 .