Public Value Mapping and Science Policy Evaluation

Here we present the framework of a new approach to assessing the capacity of research programs to achieve social goals. Research evaluation has made great strides in addressing questions of scientific and economic impacts. It has largely avoided, however, a more important challenge: assessing (prospectively or retrospectively) the impacts of a given research endeavor on the non-scientific, non-economic goals—what we here term “public values”—that often are the core public rationale for the endeavor. Research programs are typically justified in terms of their capacity to achieve public values, and that articulation of public values is pervasive in science policy-making. We outline the elements of a case-based approach to “public value mapping” of science policy, with a particular focus on developing useful criteria and methods for assessing “public value failure,” with an intent to provide an alternative to “market failure” thinking that has been so powerful in science policy-making. So long as research evaluation avoids the problem of public values, science policy decision makers will have little help from social science in making choices among competing paths to desired social outcomes.

[1]  R. Solow TECHNICAL CHANGE AND THE AGGREGATE PRODUCTION FUNCTION , 1957 .

[2]  Fritz Machlup The Production and Distribution of Knowledge in the United States , 1962 .

[3]  M. Polanyi The Republic of Science: Its Political and Economic Theory , 1962 .

[4]  M. Polanyi The Republic of science , 1962 .

[5]  S. Toulmin The complexity of scientific choice: A stocktaking , 1964 .

[6]  Kenneth J. Arrow,et al.  A Strategy of Decision, Policy Evaluation as a Social Process. , 1964 .

[7]  David Braybrooke,et al.  A Strategy of Decision: Policy Evaluation As a Social Process. , 1964 .

[8]  Federal support of basic research: Some economic issues , 1965 .

[9]  The complexity of scientific choice , 1966 .

[10]  L. Elton,et al.  Public Knowledge—The Social Dimension of Science , 1968 .

[11]  Criteria for Scientific Development: Public Policy and National Goals , 1968 .

[12]  Effectiveness of Federal Civilian‐Oriented R&D Programs* , 1976 .

[13]  D. Kevles,et al.  The Physicists: The History of a Scientific Community in Modern America , 1977 .

[14]  Nathan Rosenberg,et al.  Inside the black box: How exogenous is science? , 1983 .

[15]  T. Luukkonen-Gronow,et al.  Scientific research evaluation: a review of methods and various contexts of their application , 1987 .

[16]  Value and Justification: The Foundations of Liberal Theory , 1990 .

[17]  Bryan D. Jones,et al.  Agenda Dynamics and Policy Subsystems , 1991, The Journal of Politics.

[18]  Guy B. Adams Enthralled with Modernity: The Historical Context of Knowledge and Theory Development in Public Administration. , 1992 .

[19]  Christopher Freeman,et al.  The Economics of Hope: Essays on Technical Change, Economic Growth, and the Environment , 1992 .

[20]  Elizabeth Anderson,et al.  Value in Ethics and Economics , 1996 .

[21]  Julia Melkers,et al.  Evaluating R&D impacts : methods and practice , 1993 .

[22]  Evaluating Federal R&D in Canada , 1993 .

[23]  Stuart W. Leslie,et al.  The Cold War and American science , 1994 .

[24]  Paul Weirich,et al.  Value in Ethics and Economics , 1995 .

[25]  John J. Kirlin What Government Must Do Well: Creating Value for Society , 1996 .

[26]  Albert N. Link,et al.  Evaluating Public Sector Research and Development , 1996 .

[27]  Daniel Sarewitz,et al.  Frontiers of illusion , 1996 .

[28]  P. Shields,et al.  Pragmatism , 1996 .

[29]  Rosalie Ruegg Guidelines for economic evaluation of the Advanced Technology Program , 1996 .

[30]  Joseph S. Nye join In Government We Don't Trust , 1997 .

[31]  Lynn Silipigni Connaway,et al.  University Faculty and Networked Information: Results of a Survey , 1997, J. Am. Soc. Inf. Sci..

[32]  C. I. Jones,et al.  Measuring the Social Return to R&D , 1997 .

[33]  Jan W. van Deth,et al.  The impact of values , 1998 .

[34]  E. Marmolo A constitutional theory of public goods , 1999 .

[35]  Beauty and the beast : the aesthetic moment in science / Ernst Peter Fischer ; translated from German by Elizabeth Oehlkers. , 1999 .

[36]  R. G. Cummings,et al.  Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method , 1999 .

[37]  J. Garrison Pragmatism and Public Administration , 2000 .

[38]  A. Weinberg Criteria for scientific choice , 1963, Minerva.

[39]  Monica Gaughan,et al.  Scientific and technical human capital: an alternative model for research evaluation , 2001, Int. J. Technol. Manag..

[40]  Kathryn L. Combs,et al.  The Economics of Science and Technology , 2012 .

[41]  Terttu Luukkonen,et al.  Research evaluation in Europe: state of the art , 2002 .

[42]  R. Middleton,et al.  Solow, Robert M , 2002 .

[43]  Juan D. Rogers,et al.  A churn model of scientific knowledge value: Internet researchers as a knowledge value collective , 2002 .

[44]  Barry Bozeman,et al.  Public‐Value Failure: When Efficient Markets May Not Do , 2002 .

[45]  B. Bozeman Public Value Mapping of Science Outcomes : Theory and Method Executive Summary , 2003 .

[46]  Ronald N. Kostoff,et al.  The metrics of science and technology , 2001, Scientometrics.

[47]  A. N. Link,et al.  Economic performance measures for evaluating government-sponsored research , 1996, Scientometrics.

[48]  Barry Bozeman,et al.  Public values and public failure in US science policy , 2005 .

[49]  J. C. Juergensmeyer American Planning Association , 2005 .

[50]  Stephen Rayner,et al.  Clumsy Solutions for a Complex World , 2006 .

[51]  J. Perl,et al.  Is War Necessary for Economic Growth , 2006 .

[52]  J. Adams The Failure of Seat Belts Legislation , 2006 .

[53]  Barry Bozeman,et al.  Public Values and Public Interest: Counterbalancing Economic Individualism , 2007 .

[54]  Mary K. Feeney,et al.  Public Values and Public Failure: Implications of the 2004-2005 Flu Vaccine Case , 2007 .

[55]  E. Woodhouse,et al.  Science policies for reducing societal inequities , 2007 .

[56]  B. Bozeman Public Values and Public Interest , 2007 .

[57]  On Public Value , 2008 .

[58]  Frank M. Andrews,et al.  Scientific Productivity: The Effectiveness of Research Groups in Six Countries , 2009 .

[59]  Equity Concerns and Cost-Benefit Analysis: Opening the Black Box , 2009 .

[60]  Erik Fisher,et al.  The public value of nanotechnology? , 2010, Scientometrics.