Toward the Development of More Robust Policy Models

The current state of the world suggests we have some difficulty in developing effective policy. This paper demonstrates two methods for the objective analysis of logic models within policy documents. By comparing policy models, we will be better able to compare policies and so determine which policy is best.Our ability to develop effective policy is reflected across the social sciences where our ability to create effective theoretical models is being called into question. The broad scope of this issue suggests a source as deep as our unconscious ways of thinking. Specifically, our reliance on modern and postmodern thinking has limited our ability to develop more effective policy, and more particularly, logic models.The move in some quarters toward “integral” thinking may provide insights that support the creation of more useful policy models. However, some versions of that thinking seem to be unwittingly mired in modern and postmodern thinking. This paper identifies how integral thought may be clarified, allowing us to advance beyond postmodern thinking. Usefully, this “neo-integral” form of thinking supports the creation of more mature policy models by encompassing greater complexity and a careful understanding of interrelationships that may be identified within the logic models that are commonly found in policy analyses.Neo-integral thinking is related to more complex forms of systems thinking and both are found in recent conversations within the nascent field of metatheory. And, to some extent, a logic model within a policy operates as a kind of theoretical model because both may be used to inform understanding and decision-making. Therefore, it seems reasonable to apply neo-integral thinking and metatheoretical methodologies to conduct critical comparisons of logic models.In the present paper, these methodologies are applied to critically compare two logic models. The structure of each model is analyzed to objectively determine its complexity and formal robustness. The complexity is determined by quantifying the concepts and connections within each model. The robustness of a model is a measure of its internal integrity, based on the ratio between the total number of aspects and the number of concatenated aspects. In this analysis, one policy model is found to have a robustness of 0.08, while another is found to have a robustness of 0.67. The more robust policy is expected to be much more effective in application. Implications for policy development and policy application are discussed.

[1]  J. Mackie,et al.  The Conduct of Inquiry: Methodology for Behavioural Science , 1965 .

[2]  G. Bateson,et al.  Mind and Nature: A Necessary Unity , 1979 .

[3]  Euel Elliott,et al.  Nonlinear dynamics, complexity and public policy , 1999 .

[4]  Steven E. Wallis Validation of Theory: Exploring and Reframing Popper's Worlds , 2008 .

[5]  A. Lamborn Theory and the Politics in World Politics , 1997 .

[6]  Linda Smith,et al.  Decolonizing Methodologies: Research and Indigenous Peoples , 2000 .

[7]  L. Bolman,et al.  Reframing Organizations: Artistry, Choice, and Leadership. Jossey-Bass Management Series, Social and Behavioral Science Series, and Higher and Adult Education Series. , 1991 .

[8]  P. Sabatier Theories of the Policy Process , 1999 .

[9]  David Detomasi The Multinational Corporation and Global Governance: Modelling Global Public Policy Networks , 2007 .

[10]  M. Serres The Troubadour of Knowledge , 1997 .

[11]  Graham Mathieson Full spectrum analysis: Practical OR in the face of the human variable * , 2004 .

[12]  H. Smalley The systems approach. , 1972, Hospitals.

[13]  A. V. D. Ven,et al.  Engaged Scholarship: A Guide for Organizational and Social Research , 2007 .

[14]  P. Meehl Cliometric Metatheory: II. Criteria Scientists Use in Theory Appraisal and why it is Rational to do so , 2002, Psychological reports.

[15]  Michael N. Bastedo Metapolicy: Institutional Change and the Rationalization of Public Higher Education , 2005 .

[16]  John H. Holland,et al.  Hidden Order: How Adaptation Builds Complexity , 1995 .

[17]  R. Hoppe,et al.  Cultures of Public Policy Problems , 2002 .

[18]  Kurt A. Richardson,et al.  Complexity and policy analysis : tools and concepts for designing robust policies in a complex world , 2008 .

[19]  Steven E. Wallis The Structure of Theory and the Structure of Scientific Revolutions: What Constitutes an Advance in Theory? , 2010 .

[20]  John W. Kingdon Agendas, alternatives, and public policies , 1984 .

[21]  John R. Koza,et al.  Hidden Order: How Adaptation Builds Complexity. , 1995, Artificial Life.

[22]  R. Stacey Complexity and Creativity in Organizations , 1996 .

[23]  A. Kakabadse,et al.  From Tacit Knowledge to Knowledge Management: Leveraging Invisible Assets , 2001 .

[24]  Luc Bernier,et al.  The Changing Nature of Public Entrepreneurship , 2007 .

[25]  Robert MacIntosh,et al.  Conditioned emergence: a dissipative structures approach to transformation , 1999 .

[26]  John A. McLaughlin,et al.  Logic models: a tool for telling your programs performance story , 1999 .

[27]  Steven E. Wallis From Reductive to Robust: Seeking the Core of Complex Adaptive Systems Theory , 2008 .

[28]  P. Senge The Fifth Discipline Fieldbook: Strategies and Tools for Building a Learning Organization , 2014 .

[29]  Diana Leat,et al.  Theories of Social Change , 2005 .

[30]  S. Fuller The Philosophy of Science and Technology Studies , 2005 .

[31]  Steven E. Wallis Seeking the robust core of organisational learning theory , 2009 .

[32]  L. Jacobs Politics of America's supply state: health reform and technology. , 1995, Health Affairs.

[33]  Martin E. Smith Changing an organisation’s culture: correlates of success and failure , 2003 .

[34]  Louise K. Comfort,et al.  Taking complexity seriously: Policy analysis, triangulation, and sustainable development , 1999 .

[35]  D. Kerr The logic of ‘Policy’ and successful policies , 1976 .

[36]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[37]  Nicholas Rescher,et al.  Cognitive Harmony: The Role of Systemic Harmony in the Constitution of Knowledge , 2005 .

[38]  Gibson Burrell,et al.  Antonio Haro, pandemonium. Towards a retro-organizational theory, Londres, sage publications, 1997 , 2000 .

[39]  Emery Roe,et al.  Taking Complexity Seriously: Policy Analysis, Triangulation and Sustainable Development , 1997 .

[40]  P. Meehl Cliometric metatheory : the actuarial approach to empirical, history-based philosophy of science , 1992 .

[41]  Charles François Complexity, a challenge to governance—postscript from a friend , 2008 .

[42]  A. Stinchcombe Constructing Social Theories , 1970 .

[43]  B. Glaser Conceptualization: On Theory and Theorizing Using Grounded Theory , 2002 .

[44]  M. Schlesinger,et al.  Robust Strategies for Abating Climate Change , 2000 .

[45]  P. John,et al.  Is There Life After Policy Streams, Advocacy Coalitions, and Punctuations: Using Evolutionary Theory to Explain Policy Change? , 2003 .

[46]  Lawrence C. Walters,et al.  Putting More Public in Policy Analysis , 2000 .

[47]  M. Spicer Public Administration, Social Science, and Political Association , 1998 .

[48]  M. Weisbord,et al.  Future Search: An Action Guide to Finding Common Ground in Organizations and Communities , 1995 .

[49]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[50]  Elaine Ramsey,et al.  Evaluating Public Policy Formation and Support Mechanisms for Technological Innovation , 2006 .

[51]  Herman L. Boschken Organizational Performance and Multiple Constituencies , 1994 .

[52]  G. Ritzer Explorations in Social Theory: From Metatheorizing to Rationalization , 2001 .