Science Use in Regulatory Impact Analysis: The Effects of Political Attention and Controversy

Scholars, policymakers, and research sponsors have long sought to understand the conditions under which scientific research is used in the policymaking process. Recent research has identified a resource that can be used to trace the use of science across time and many policy domains. US federal agencies are mandated by executive order to justify all economically significant regulations by regulatory impact analyses (RIAs), in which they present evidence of the scientific underpinnings and consequences of the proposed rule. To gain new insight into when and how regulators invoke science in their policy justifications, we ask: does the political attention and controversy surrounding a regulation affect the extent to which science is utilized in RIAs? We examine scientific citation activity in all 101 economically significant RIAs from 2008-2012 and evaluate the effects of attention -- from the public, policy elites and the media -- on the degree of science use in RIAs. Our main finding is that regulators draw more heavily on scientific research when justifying rules subject to a high degree of attention from outside actors. These findings suggest that scientific research plays an important role in the justification of regulations, especially those that are highly salient to the public and other policy actors.

[1]  J. V. Ver Hoef,et al.  Quasi-Poisson vs. negative binomial regression: how should we model overdispersed count data? , 2007, Ecology.

[2]  Steven P. Croley.  White House Review of Agency Rulemaking: An Empirical Investigation , 2002 .

[3]  YackeeJason Webb,et al.  A Bias Towards Business? Assessing Interest Group Influence on the U.S. Bureaucracy , 2015 .

[4]  Stuart W. Shulman.  The Case Against Mass E-mails: Perverse Incentives and Low Quality Public Participation in U.S. Federal Rulemaking , 2009 .

[5]  Robert Braam,et al.  Everything about genes: Some results on the dynamics of genomics research , 2009, Scientometrics.

[6]  Jason Webb Yackee,et al.  A Bias Towards Business? Assessing Interest Group Influence on the U.S. Bureaucracy , 2006, The Journal of Politics.

[7]  B. Noveck.  The Future of Citizen Participation in the Electronic State , 2004 .

[8]  Elizabeth S. Vieira,et al.  The journal relative impact: an indicator for journal assessment , 2011, Scientometrics.

[9]  Klaus Jacob,et al.  The Production and Use of Knowledge in Regulatory Impact Assessment - An Empirical Analysis , 2009 .

[10]  Frank Vibert.  The Rise of the Unelected: Democracy and the New Separation of Powers , 2007 .

[11]  Rebecca J. Romsdahl.  Political Deliberation and E-Participation in Policy-Making , 2005 .

[12]  John Turnpenny,et al.  THE POLICY AND POLITICS OF POLICY APPRAISAL: EMERGING TRENDS AND NEW DIRECTIONS , 2009 .

[13]  M. Kraft,et al.  Environmental Policy in the Reagan Presidency , 1984 .

[14]  C. Weiss.  The many meanings of research utilization. , 1979 .

[15]  S. Shapiro,et al.  The Politics of Regulatory Reform , 2013 .

[16]  Mathew D. McCubbins,et al.  Who Controls? Information and the Structure of Legislative Decision Making , 1994 .

[17]  W. Gormley.  Regulatory Issue Networks in a Federal System , 1986, Polity.

[18]  Gary King,et al.  Event Count Models for International Relations: Generalizations and Applications , 1989 .

[19]  Frank Vibert.  The Rise of the Unelected: The Rise of the Unelected , 2007 .

[20]  Stuart Shapiro,et al.  Does the amount of participation matter? Public comments, agency responses and the time to finalize a regulation , 2008 .

[21]  D. Whiteman.  The Fate of Policy Analysis in Congressional Decision Making: Three Types of Use in Committees , 1985 .

[22]  Bruce A. Desmarais,et al.  Public policy's bibliography: The use of research in US regulatory impact analyses , 2014 .

[23]  Mathew D. McCubbins,et al.  Learning from Oversight: Fire Alarms and Police Patrols Reconstructed , 1994 .

[24]  Does Analysis Matter? Economics and Planning in the Department of the Interior , 1991 .

[25]  J. Weiss.  Regulation And The Courts The Case Of The Clean Air Act , 2016 .

[26]  Jean-Louis Denis,et al.  Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. , 2010, The Milbank quarterly.

[27]  J. Morrall,et al.  Continuity, Change, and Priorities: The Quality and Use of Regulatory Analysis Across US Administrations , 2013 .

[28]  C. Blondin,et al.  Office of the White House Press Secretary , 1976 .

[29]  Steven J. Balla,et al.  Information technology and public commenting on agency regulations , 2007 .

[30]  Agency Design, the Mass Media, and the Blame for Agency Scandals , 2015 .

[31]  Stuart W. Shulman,et al.  Democracy and the Environment on the Internet: Electronic Citizen Participation in Regulatory Rulemaking , 2006 .

[32]  Itzhak Yanovitzky,et al.  Effects of News Coverage on Policy Attention and Actions , 2002, Commun. Res..

[33]  Ismael Rafols,et al.  Global maps of science based on the new Web-of-Science categories , 2012, Scientometrics.

[34]  Susan Webb Yackee.  Sweet-Talking the Fourth Branch: The Influence of Interest Group Comments on Federal Agency Rulemaking , 2006 .

[35]  D. Karpf.  Online Political Mobilization from the Advocacy Group's Perspective: Looking Beyond Clicktivism , 2010 .

[36]  Jerry Ellig,et al.  The Quality and Use of Regulatory Analysis in 2008 , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[37]  X. Zhan,et al.  Understanding commenter influence during agency rule development , 2009 .

[38]  Miron L. Straf,et al.  Using Science as Evidence in Public Policy , 2013 .

[39]  H. Doremus.  Scientific and Political Integrity in Environmental Policy , 2008 .

[40]  James G. McGann.  Think Tanks, Public Policy, and the Politics of Expertise , 2005, Perspectives on Politics.

[41]  Jonathan R. Olson,et al.  Connecting Research and Policymaking: Implications for Theory and Practice from the Family Impact Seminars , 2000 .

[42]  B. Obama.  Memorandum for the Heads of Executive Departments and Agencies: Open Data Policy--Managing Information as an Asset , 2013 .