The "Too Few Cases/Too Many Variables" Problem in Implementation Research

1F 5IRST GENERATION studies of implementation were, for the most part, detailed accounts of how a single authoritative decision was carried out, either at a single location (Derthick 1970; Pressman and Wildavsky 1973) or at multiple sites (Derthick 1972).1 Implementation was conceptualized as a complex and dynamic process, characterized by a variety of participants with a wide range of perspectives whose interpretation and operationalization of earlier authoritative decisions had multiple effects, some anticipated, others not. With few exceptions (e.g., Sapolsky 1972), most first generation authors were pessimistic about a program's chances of being implemented successfully.2 For example, in 1977, Eugene Bardach (1977: 5) observed that "even the most robust policy one that is well designed to survive the implementation process will tend to go awry. The classic symptoms of underperformance, delay, and escalating costs are bound to appear" (emphasis added). With the publication of additional empirical studies of implementation, however, the picture of implementation as inevitable failure began to fade.3 Whereas faulty execution may have been the rule, there emerged a more eclectic view of implementation, one that acknowledged its variability and stressed the political as well as managerial dimensions of implementation behavior.4 The lead, or orienting, questions of these second generation studies became, and still are, "Why was X so well implemented, particularly in comparison with the less successful implementation of Y?" (Mazmanian and Sabatier 1983: 3) or "Why was X so well implemented in state A, compared to state B?" (Abolafia 1979; Goggin forthcoming).

[1]  L. O'toole,et al.  TOWARD A THEORY OF POLICY IMPLEMENTATION: AN ORGANIZATIONAL PERSPECTIVE , 1979 .

[2]  R. Putnam,et al.  Explaining Institutional Success: The Case of Italian Regional Government , 1983, American Political Science Review.

[3]  Carl E. Van Horn,et al.  The Policy Implementation Process: A Conceptual Framework , 1975 .

[4]  Paul Diesing,et al.  Patterns of Discovery in the Social Sciences. , 1972 .

[5]  Clarence N. Stone The Implementation of Social Programs: Two Perspectives , 1980 .

[6]  P. Berman,et al.  The study of macro- and micro-implementation. , 1978, Public policy.

[7]  Paul Y. Hammond,et al.  Strategy, politics, and defense budgets , 1962 .

[8]  Janice M. Beyer,et al.  Implementing Change: Alcoholism Policies in Work Organizations , 1978 .

[9]  M. Zelditch,,et al.  Some Methodological Problems of Field Studies , 1962, American Journal of Sociology.

[10]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[11]  H. Ingram,et al.  Policy implementation through bargaining: the case of federal grants-in-aid. , 1977, Public policy.

[12]  H. Stretton The political sciences: General principles of selection in social science and history , 1969 .

[13]  S. Sieber The Integration of Fieldwork and Survey Methods , 1973, American Journal of Sociology.

[14]  A. Przeworski,et al.  The logic of comparative social inquiry , 1970 .

[15]  J. Spengler,et al.  Systematic Thinking for Social Action. , 1973 .

[16]  J. Tropman,et al.  Studying implementation: Methodological and administrative issues, by Walter Williams et al. Chatham, NJ: Chatham House Publishers, 1982. No price given , 1983 .

[17]  Eugene Bardach,et al.  The Implementation Game: What Happens After a Bill Becomes a Law. , 1977 .

[18]  Randall B. Ripley,et al.  Bureaucracy and Policy Implementation , 1983 .

[19]  R. Elmore,et al.  Organizational models of social program implementation. , 1978, Public policy.

[20]  Daniel A. Mazmanian,et al.  Effective policy implementation , 1981 .

[21]  D. F. Musto Whatever happened to "community mental health"? , 1975, The Public interest.

[22]  A. George The Limits Of Coercive Diplomacy , 1971 .

[23]  George C. Homans The Strategy of Industrial Sociology , 1949, American Journal of Sociology.

[24]  Edward W. Pauly,et al.  Federal Programs Supporting Educational Change, Vol. 2: Factors Affecting Change Agent Projects. , 1975 .

[25]  Richard Jung,et al.  The Utility of a Longitudinal Approach in Assessing Implementation: A Thirteen-Year View of Title I, ESEA , 1980 .

[26]  N. Polsby,et al.  Case Study and Theory in Political Science , 1975 .

[27]  Charles S. Bullock THE OFFICE FOR CIVIL RIGHTS AND IMPLEMENTATION OF DESEGREGATION PROGRAMS IN THE PUBLIC SCHOOLS , 1980 .

[28]  H. Stretton,et al.  The Political Sciences , 1969 .

[29]  A. Bowman,et al.  Hazardous Wastes, Politics, and Public Policy: a Comparative State Analysis , 1983, The Western political quarterly.

[30]  E. Bardach The implementation game , 1977 .

[31]  Mitchel Y. Abolafia Coordinating for the Collective Good , 1979 .

[32]  F. R. Eisele,et al.  Modern Social Politics in Britain and Sweden: From Relief to Income Maintenance. , 1975 .

[33]  Timothy J. Conlan The Politics of Federal Block Grants: From Nixon to Reagan , 1984 .

[34]  John P. Frendreis,et al.  Explanation of Variation and Detection of Covariation , 1983 .

[35]  P. Sabatier,et al.  The conditions of effective implementation: a guide to accomplishing policy objectives. , 1979, Policy analysis.

[36]  S. Verba Some Dilemmas in Comparative Research , 1967, World Politics.

[37]  Carl E. Van Horn,et al.  Policy implementation in the Federal system , 1979 .

[38]  Richard F. Elmore,et al.  The politics of policy implementation , 1980 .

[39]  D. Campbell,et al.  Unobtrusive Measures: Nonreactive Research in the Social Sciences , 1966 .

[40]  H. Sapolsky The Polaris System Development: Bureaucratic and Programmatic Success in Government , 1972 .

[41]  M. Miles Qualitative Data as an Attractive Nuisance: The Problem of Analysis , 1979 .

[42]  Theodore J. Lowi,et al.  American Business, Public Policy, Case-Studies, and Political Theory , 1964 .

[43]  C. M. Lamb,et al.  Implementation of Civil Rights Policy , 1984 .

[44]  R. Yin The Case Study Crisis: Some Answers , 1981 .

[45]  Richard Smoke,et al.  Deterrence in American Foreign Policy: Theory and Practice , 1974 .

[46]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .