The Non-Codified Use of Problem Structuring Methods and the Need for a Generic Constitutive Definition

When we use a PSM what is it we are actually doing? An answer to this question would enable the PSM community to considerably enlarge the available source of case studies by the inclusion of examples of non-codified PSM use. We start from Checkland’s own proposal for a “constitutive definition” of SSM, which originated from trying to answer the question of knowing when a claim of SSM use was legitimate. By extending this idea to a generic constitutive definition for all PSMs leads us to propose a self-consistent labelling schema for observed phenomena arising from PSMs in action. This consists of a set of testable propositions, which, through observation of putative PSM use, can be used to assess validity of claims of PSM use. Such evidential support for the propositions as may be found in putative PSM use can then make it back into a broader axiomatic formulation of PSMs through the use of a set-theoretic approach, which enables our method to scale to large data sets. The theoretical underpinning to our work is in causal realism and middle range theory. We illustrate our approach through the analysis of three case studies drawn from engineering organisations, a rich source of possible non-codified PSM use. The combination of a method for judging cases of non-codified PSM use, sound theoretical underpinning, and scalability to large data sets, we believe leads to a demystification of PSMs and should encourage their wider use.

[1]  Michael Jackson,et al.  Systems Thinking: Creative Holism for Managers , 2003 .

[2]  Richard J. Ormerod,et al.  The mangle of OR practice: towards more informative case studies of ‘technical’ projects , 2014, J. Oper. Res. Soc..

[3]  James W. Hall,et al.  Uncertain inference using interval probability theory , 1998, Int. J. Approx. Reason..

[4]  John Mingers,et al.  The contribution of critical realism as an underpinning philosophy for OR/MS and systems , 2000, J. Oper. Res. Soc..

[5]  D. Voliotis,et al.  [Experimental approaches]. , 1996, Der Internist.

[6]  John Mingers,et al.  A classification of the philosophical assumptions of management science methods , 2003, J. Oper. Res. Soc..

[7]  William H. Glick,et al.  Typologies As a Unique Form Of Theory Building: Toward Improved Understanding and Modeling , 1994 .

[8]  Amanda J. Gregory,et al.  A problem structuring method for ecosystem-based management: The DPSIR modelling process , 2013, Eur. J. Oper. Res..

[9]  Peter Checkland,et al.  Soft systems methodology : a 30-year retrospective . Soft systems methodology in action , 1999 .

[10]  Fadhel Kaboub.  Realistic Evaluation , 2004 .

[11]  Richard J. Ormerod,et al.  Critical rationalism in practice: Strategies to manage subjectivity in OR investigations , 2014, Eur. J. Oper. Res..

[12]  Zhichang Zhu,et al.  After paradim: why mixing-methodology theorising fails and how to make it work again , 2011, J. Oper. Res. Soc..

[13]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[14]  Peter Checkland,et al.  'Classic OR' and 'Soft OR' - an asymmetric complementarity , 2004 .

[15]  G. M. Jenkins,et al.  A Systems Approach to Management , 1968 .

[16]  G. Midgley.  Dealing with coercion: Critical Systems Heuristics and beyond , 1997 .

[17]  A Boyd,et al.  Partnership and Participation: Decision-making in the Multiagency Setting , 2002, J. Oper. Res. Soc..

[18]  Magdi N. Kamel,et al.  Knowledge Acquisition , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[19]  P. B. Henning,et al.  Systems Thinking: Common Ground or Untapped Territory? , 2011 .

[20]  J. Scholes,et al.  Soft Systems Methodology in Action: Including a 30-Year Retrospective , 2000 .

[21]  Ahmed M. A. Sattar,et al.  Case Study: 17th Street Canal Breach Closure Procedures , 2008 .

[22]  Michael Jackson,et al.  Social Theory and Operational Research Practice , 1993 .

[23]  P. Solli,et al.  Longitudinal studies. , 2015, Journal of thoracic disease.

[24]  Jonathan Rosenhead,et al.  What's the Problem? An Introduction to Problem Structuring Methods , 1996 .

[25]  David C. Lane,et al.  Rerum cognoscere causas: Part I — How do the ideas of system dynamics relate to traditional social theories and the voluntarism/determinism debate? , 2001 .

[26]  John McGregor.  Context , 2005, J. Object Technol..

[27]  Jonathan Rosenhead,et al.  Into the Swamp: The Analysis of Social Issues , 1992 .

[28]  Richard Ormerod,et al.  The history and ideas of pragmatism , 2006, J. Oper. Res. Soc..

[29]  A. Kellerman,et al.  The Constitution of Society : Outline of the Theory of Structuration , 2015 .

[30]  Jesper Simonsen,et al.  Soft Systems Methodology , 2020, Systems Approaches to Making Change: A Practical Guide.

[31]  Jac A. M. Vennix,et al.  Group model-building: tackling messy problems , 1999 .

[32]  Jonathan Wai.  What does it mean to be an expert , 2014 .

[33]  Jonathan Rosenhead,et al.  Introduction to the Special Issue: Teaching Soft O.R., Problem Structuring Methods, and Multimethodology , 2011, INFORMS Trans. Educ..

[34]  Fran Ackermann,et al.  Problem structuring methods 'in the Dock': Arguing the case for Soft OR , 2012, Eur. J. Oper. Res..

[35]  L. M. Miller,et al.  Controlling disasters: recognising latent goals after Hurricane Katrina. , 2012, Disasters.

[36]  George P. Richardson,et al.  Scripts for group model building , 1997 .

[37]  G. Midgley.  Systemic Intervention: Philosophy, Methodology, and Practice , 2000 .

[38]  John Mingers,et al.  Operational research: the science of better? , 2007, J. Oper. Res. Soc..

[39]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[40]  Jonathan Rosenhead,et al.  Past, present and future of problem structuring methods , 2006, J. Oper. Res. Soc..

[41]  David C. Lane,et al.  Social theory and system dynamics practice , 1999, Eur. J. Oper. Res..

[42]  Mike Yearworth,et al.  Understanding systems thinking: an agenda for applied research in industry , 2012 .

[43]  George P. Richardson,et al.  Group model building: problem structuring, policy simulation and decision support , 2007, J. Oper. Res. Soc..

[44]  P. Keys,et al.  OR as Technology: Some Issues and Implications , 1989 .

[45]  Douglas A. Kysar,et al.  Did Nepa Drown New Orleans? The Levees, the Blame Game, and the Hazards of Hindsight , 2006 .

[46]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[47]  Jack Ring.  A value-seeking approach to the engineering of systems , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[48]  R. Ackoff.  The Future of Operational Research is Past , 1979 .

[49]  L. White,et al.  Evaluating problem-structuring methods: developing an approach to show the value and effectiveness of PSMs , 2006, J. Oper. Res. Soc..

[50]  H. Simon,et al.  Bounded Rationality and Organizational Learning , 1991 .

[51]  Ray Pawson,et al.  A Measure for Measures: A Manifesto for Empirical Sociology , 1989 .

[52]  Fran Ackermann,et al.  The Effects of Design Changes and Delays on Project Costs , 1995 .

[53]  John Mingers,et al.  Recent Developments in Critical Management Science , 1992 .

[54]  K. Weick.  The social psychology of organizing , 1969 .

[55]  M. Reynolds,et al.  Critical systems heuristics , 2010 .

[56]  Patrick Godfrey,et al.  Critical awareness of worldviews in organisational change , 2012 .

[57]  R. Merton.  Social Theory and Social Structure , 1958 .

[58]  Mike Yearworth,et al.  The use of a systems engineering process guide to accelerate improvement in systems engineering application and expertise , 2013, 2013 IEEE International Systems Conference (SysCon).

[59]  Dean Tjosvold,et al.  Book review : Group model building : facilitating team learning using system dynamics , 1998 .

[60]  W. Ulrich,et al.  Beyond methodology choice: critical systems thinking as critically systemic discourse , 2003, J. Oper. Res. Soc..

[61]  George P. Richardson,et al.  Teamwork in group model building , 1995 .

[62]  Feodor Murzin,et al.  On the Qualitative Models , 1997, SCAI.

[63]  Fran Ackermann,et al.  Getting "Messy" with Problems: The Challenges of Teaching "Soft" OR , 2011, INFORMS Trans. Educ..

[64]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[65]  A. Ehrlich.  What is meaningful learning? , 1975, The Dental assistant.

[66]  Michael Jackson,et al.  Towards a System of Systems Methodologies , 1984 .

[67]  P. Bennett,et al.  A Kuhnian Crisis in Management Science? , 1981 .

[68]  Richard J. Ormerod,et al.  On the Nature of OR — Entering the Fray , 1996 .

[69]  Robert Y. Cavana,et al.  Towards a new framework for evaluating systemic problem structuring methods , 2013, Eur. J. Oper. Res..

[70]  Mike Yearworth,et al.  On the Desirability of Integrating Research Methods into Overall Systems Approaches in the Training of Engineers: Analysis Using SSM , 2014 .

[71]  Charles C. Ragin,et al.  Using Qualitative Comparative Analysis to Study Causal Order , 2008 .

[72]  Leroy White,et al.  Partnership and Participation: Decision-Making in the Multiagency Setting , 2000 .

[73]  John D. Sterman,et al.  All models are wrong: reflections on becoming a systems scientist† , 2002 .

[74]  John Mingers,et al.  Soft OR comes of age—but not everywhere! , 2011 .

[75]  Charles C. Ragin,et al.  Fuzzy Sets and Social Research , 2005 .

[76]  John N. Warfield,et al.  Spreadthink: Explaining ineffective groups , 2007 .

[77]  Richard J. Ormerod,et al.  OR competences: the demands of problem structuring methods , 2014 .

[78]  Russell L. Ackoff,et al.  The Art and Science of Mess Management , 1981 .

[79]  Yiyang Fan,et al.  A Problem Structuring Method for Innovation Strategy: A Tentative DPSIR Approach , 2013 .

[80]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[81]  Fran Ackermann,et al.  Modeling for Litigation: Mixing Qualitative and Quantitative Approaches , 1997 .

[82]  Michael Jackson,et al.  The System of Systems Methodologies: A Guide to Researchers , 1993 .

[83]  John Davis,et al.  Integrating Problem Solving and Research Methods Teaching for Systems Practice in Engineering , 2013, CSER.

[84]  K. Weick.  The Generative Properties Of Richness , 2007 .

[85]  D. Cabrera,et al.  Systems thinking. , 2008, Evaluation and program planning.

[86]  Leroy White,et al.  The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process , 2013, Eur. J. Oper. Res..

[87]  K. Boal,et al.  Strategic resources: Traits, configurations and paths to sustainable competitive advantage , 2007 .

[88]  Mike C. Jackson,et al.  Critical systems thinking and practice , 2001, Eur. J. Oper. Res..

[89]  D. Little.  Causal mechanisms in the social realm , 2011 .

[90]  D. Morgan,et al.  Sociological Paradigms and Organizational Analysis. , 1983 .

[91]  Andrew Sayer,et al.  Method in Social Science: A Realist Approach , 1984 .

[92]  P. Keys.  On becoming expert in the use of problem structuring methods , 2006, J. Oper. Res. Soc..

[93]  R. Rosenfeld,et al.  Conflicts , 2013, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[94]  Leroy White,et al.  Understanding problem structuring methods interventions , 2009, Eur. J. Oper. Res..

[95]  Richard J. Ormerod.  Putting soft OR methods to work: the case of IS strategy development for the UK Parliament , 2005, J. Oper. Res. Soc..

[96]  Fran Ackermann,et al.  Where next for problem structuring methods , 2006, J. Oper. Res. Soc..

[97]  R. Kahn,et al.  The Social Psychology of Organizations , 1966 .

[98]  Jonathan Rosenhead,et al.  Problem structuring methods in action , 2004, Eur. J. Oper. Res..

[99]  Simon Bell,et al.  DPSIR = A Problem Structuring Method? An exploration from the "Imagine" approach , 2012, Eur. J. Oper. Res..

[100]  David C. Lane,et al.  Rerum cognoscere causas: Part II—Opportunities generated by the agency/structure debate and suggestions for clarifying the social theoretic position of system dynamics , 2001 .