Applying organizational psychology as a design science: A method for predicting malfunctions in socio-technical systems (PreMiSTS)

As a discipline, design science has traditionally focused on designing products and associated technical processes to improve usability and performance. Although significant progress has been made in these areas, little research has yet examined the role of human behaviour in the design of socio-technical systems (e.g., organizations). Here, we argue that applying organizational psychology as a design science can address this omission and enhance the capability of both disciplines. Specifically, we propose a method to predict malfunctions in socio-technical systems (PreMiSTS), thereby enabling them to be designed out or mitigated. We introduce this method, describe its nine stages, and illustrate its application with reference to two high-profile case studies of such malfunctions: (1) the severe breakdowns in patient care at the UK’s Mid-Staffordshire NHS Foundation Trust hospital in the period 2005–2009, and (2) the fatal Grayrigg rail accident in Cumbria, UK, in 2007. Having first identified the socio-technical and behavioural antecedents of these malfunctions, we then consider how the PreMiSTS method could be used to predict and prevent future malfunctions of this nature. Finally, we evaluate the method, consider its advantages and disadvantages, and suggest where it can be most usefully applied.

[1]  Panos Y. Papalambros,et al.  Design Science: Why, What and How , 2015, Design Science.

[2]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[3]  Erik Hollnagel,et al.  The functional resonance accident model , 2004 .

[4]  Joanne O'Day,et al.  CAUSAL CHAIN APPROACHES TO THE EVALUATION OF HIGHWAY SAFETY COUNTERMEASURES , 1971 .

[5]  Alexander M. Millkey The Black Swan: The Impact of the Highly Improbable , 2009 .

[6]  Enid Mumford,et al.  A Socio-Technical Approach to Systems Design , 2000, Requirements Engineering.

[7]  John A White The Factory of the Future , 1982 .

[8]  Frank W. Geels,et al.  The ongoing energy transition: Lessons from a socio-technical, multi-level analysis of the Dutch electricity system (1960-2004) , 2007 .

[9]  Enrico W. Coiera,et al.  Putting the technical back into socio-technical systems research , 2007, Int. J. Medical Informatics.

[10]  Barna A. Szabó,et al.  The Problem of Reliability in Numerical Simulation , 1993 .

[11]  Graham Clark,et al.  Assessing organisational factors in aircraft accidents using a hybrid Reason and AcciMap model , 2013 .

[12]  Peter Kroes,et al.  Treating socio-technical systems as engineering systems: some conceptual problems , 2006 .

[13]  Amany R. Elbanna Managers as Designers in the Public Services: Beyond Technomagic , 2012 .

[14]  Chris W. Clegg,et al.  Design engineering competencies: future requirements and predicted changes in the forthcoming decade , 2005 .

[15]  Neil F. Johnson,et al.  Simply Complexity: A Clear Guide to Complexity Theory , 2007 .

[16]  Gene I. Rochlin ``High-Reliability'' Organizations and Technical Change: Some Ethical Problems and Dilemmas , 1986, IEEE Technology and Society Magazine.

[17]  Neville A Stanton,et al.  Designing sociotechnical systems with cognitive work analysis: putting theory back into practice , 2015, Ergonomics.

[18]  John E. Mathieu,et al.  Multiteam Systems: A Structural Framework and Meso-Theory of System Functioning , 2018 .

[19]  I. Welber,et al.  Factory of the future , 1987, IEEE Control Systems Magazine.

[20]  Jacques Leplat,et al.  Analysis of human errors in industrial incidents and accidents for improvement of work safety , 1984 .

[21]  Donald L. Simon,et al.  Integration of On-Line and Off-Line Diagnostic Algorithms for Aircraft Engine Health Management , 2007 .

[22]  C W Clegg,et al.  Sociotechnical principles for system design. , 2000, Applied ergonomics.

[23]  DJ Huppatz,et al.  Revisiting Herbert Simon's “Science of Design” , 2015, Design Issues.

[24]  A. Sagie,et al.  Assessor type, number of distinguishable dimension categories, and assessment centre construct validity , 1997 .

[25]  Patrick WATERSON,et al.  Trade-offs between reliability, validity and utility in the development of human factors methods , 2014 .

[26]  Jens Rasmussen,et al.  Risk management in a dynamic society: a modelling problem , 1997 .

[27]  Paul M. Salmon,et al.  Systems-based accident analysis methods: A comparison of Accimap, HFACS, and STAMP , 2012 .

[28]  Neville A Stanton,et al.  Predicting pilot error: testing a new methodology and a multi-methods and analysts approach. , 2009, Applied ergonomics.

[29]  M R Cohen,et al.  Why error reporting systems should be voluntary , 2000, BMJ : British Medical Journal.

[30]  Kincho H. Law,et al.  A multi-agent based framework for the simulation of human and social behaviors during emergency evacuations , 2007, AI & SOCIETY.

[31]  S. Fawcett,et al.  Data Science, Predictive Analytics, and Big Data: A Revolution that Will Transform Supply Chain Design and Management , 2013 .

[32]  B. Turner Man Made Disasters , 1995 .

[33]  William G. Johnson,et al.  Mort Safety Assurance Systems , 1980 .

[34]  Mark Robinson,et al.  How design engineers spend their time: Job content and task satisfaction , 2012 .

[35]  Christopher L. Magee,et al.  Engineering Systems: Meeting Human Needs in a Complex Technological World , 2011 .

[36]  Chris W. Clegg,et al.  Agent-based modelling and simulation: The potential contribution to organizational psychology , 2012 .

[37]  P. Salmon,et al.  A Fine Line Between Pleasure and Pain: Applying a Systems Analysis to the kimberly Ultramarathon Fire , 2015 .

[38]  Phil Johnson,et al.  Action research: Explaining the diversity , 2006 .

[39]  H. Voelcker,et al.  Solid modeling: current status and research directions , 1983, IEEE Computer Graphics and Applications.

[40]  I. Dror,et al.  The forensic confirmation bias: Problems, perspectives, and proposed solutions. , 2013 .

[41]  Sean Brennan,et al.  The biggest computer programme in the world ever! How's it going? , 2007, J. Inf. Technol..

[42]  C. Hood The Risk Game and the Blame Game * , 2002, Government and Opposition.

[43]  Patrick Waterson,et al.  Systems thinking, the Swiss Cheese Model and accident analysis: a comparative systemic analysis of the Grayrigg train derailment using the ATSB, AcciMap and STAMP models. , 2014, Accident; analysis and prevention.

[44]  W. Thorngate Possible Limits on a Science of Social Behavior , 1976 .

[45]  M. Cook,et al.  Personnel Selection , 2004 .

[46]  James Reason,et al.  Human Error , 1990 .

[47]  P. Marques,et al.  Creativity and Innovation through Multidisciplinary and Multisectoral Cooperation , 2007 .

[48]  Dustin J. Sleesman,et al.  Coordinated action in multiteam systems. , 2012, The Journal of applied psychology.

[49]  William E. Feinberg,et al.  THE IMPACT OF EXIT INSTRUCTIONS AND NUMBER OF EXITS IN FIRE EMERGENCIES: A COMPUTER SIMULATION INVESTIGATION , 1997 .

[50]  A. J. Grimes Normal Accidents: Living with High Risk Technologies , 1985 .

[51]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[52]  Christopher D. Wickens,et al.  On the Independence of Compliance and Reliance: Are Automation False Alarms Worse Than Misses? , 2007, Hum. Factors.

[53]  Albert Cherns,et al.  Principles of Sociotechnical Design Revisted , 1987 .

[54]  Thomas Y. Choi,et al.  Supply networks and complex adaptive systems: Control versus emergence , 2001 .

[55]  S. Schulz-Hardt,et al.  Confirmation bias in sequential information search after preliminary decisions: an expansion of dissonance theoretical research on selective exposure to information. , 2001, Journal of personality and social psychology.

[56]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[57]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[58]  David L. Cooke,et al.  A system dynamics analysis of the Westray mine disaster , 2003 .

[59]  Nancy G. Leveson,et al.  A new accident model for engineering safer systems , 2004 .

[60]  Joseph M. Hellerstein,et al.  MAD Skills: New Analysis Practices for Big Data , 2009, Proc. VLDB Endow..

[61]  James T. Reason,et al.  Types and tokens in road accident causation , 1990 .

[63]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[64]  S. Parker Beyond motivation: job and work design for development, health, ambidexterity, and more. , 2014, Annual review of psychology.

[65]  Fiona Patterson,et al.  Developments in work psychology: Emerging issues and future trends , 2001 .

[66]  N. Roese,et al.  Hindsight Bias , 2012 .

[67]  Albert B. Cherns,et al.  The Principles of Sociotechnical Design , 1976 .

[68]  K. Weick Organizational Culture as a Source of High Reliability , 1987 .

[69]  Nicolas Marmaras,et al.  Searching efficient plans for emergency rescue through simulation: the case of a metro fire , 2004, Cognition, Technology & Work.

[70]  Paul Lukowicz,et al.  A planetary nervous system for social mining and collective awareness , 2012, ArXiv.

[71]  S. Kozlowski,et al.  From Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research , 2000 .

[72]  Sue White,et al.  Performing ‘Initial Assessment’: Identifying the Latent Conditions for Error at the Front-Door of Local Authority Children's Services , 2010 .

[73]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[74]  Richard M. Crowder,et al.  The Development of an Agent-Based Modeling Framework for Simulating Engineering Team Work , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[75]  Paulo Victor Rodrigues de Carvalho,et al.  Overcoming the blame game to learn from major accidents: A systemic analysis of an Anhydrous Ammonia leakage accident , 2012 .

[76]  Wan Chul Yoon,et al.  An accident causation model for the railway industry: Application of the model to 80 rail accident investigation reports from the UK , 2013 .

[77]  Philip S. Yu,et al.  Bag Constrained Structure Pattern Mining for Multi-Graph Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[78]  Hao Rong,et al.  STAMP-Based HRA Considering Causality Within a Sociotechnical System , 2015, Hum. Factors.

[79]  Yang Miang Goh,et al.  Applying systems thinking concepts in the analysis of major incidents and safety culture , 2010 .

[80]  Andreas Schreiber,et al.  Challenges to Digital Product and Process Development Systems at BMW , 2015 .

[81]  Ken Eason,et al.  Sociotechnical systems theory in the 21 st Century : another half-filled glass ? , 2010 .

[82]  C. Clegg The Process of Job Redesign: Signposts from a Theoretical Orphanage? , 1979 .

[83]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[84]  S. Ratzan,et al.  Man-Made Disasters 20 years later: Critical commentary , 1999 .

[85]  Richard,et al.  Motivation through the Design of Work: Test of a Theory. , 1976 .

[86]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[87]  F. Emery Characteristics of Socio-Technical Systems , 1993 .

[88]  Julie Dugdale,et al.  Design of robust socio-technical systems , 2006 .

[89]  Roderick M. Kramer,et al.  Repairing and Enhancing Trust: Approaches to Reducing Organizational Trust Deficits , 2010 .

[90]  Jiri Blazek,et al.  Computational Fluid Dynamics: Principles and Applications , 2001 .

[91]  Carl Macrae,et al.  Early warnings, weak signals and learning from healthcare disasters , 2014, BMJ quality & safety.

[92]  Mark Robinson,et al.  Quantitative Research Principles and Methods for Human-Focused Research in Engineering Design , 2016 .

[93]  Neville A. Stanton,et al.  The crash at Kerang: Investigating systemic and psychological factors leading to unintentional non-compliance at rail level crossings. , 2013, Accident; analysis and prevention.

[94]  Paul E. Spector Industrial and Organizational Psychology: Research and Practice , 1995 .

[95]  Francisco J. García-Peñalvo,et al.  Human-computer interaction in evolutionary visual software analytics , 2013, Comput. Hum. Behav..

[96]  E. Trist,et al.  Some Social and Psychological Consequences of the Longwall Method of Coal-Getting , 1951 .

[97]  John C. Mankins,et al.  Technology readiness assessments: A retrospective , 2009 .

[98]  A. Nowak,et al.  Dynamical Minimalism: Why Less is More in Psychology , 2004, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[99]  Chris W. Clegg,et al.  Advancing socio-technical systems thinking: a call for bravery. , 2014, Applied ergonomics.

[100]  William W. Cooper,et al.  New Perspectives in Organization Research , 1965 .

[101]  C. Clegg,et al.  Crowd disasters: a socio-technical systems perspective , 2011 .

[102]  I. Svedung,et al.  Graphic representation of accident scenarios: mapping system structure and the causation of accidents , 2002 .

[103]  R. Bénabou Groupthink: Collective Delusions in Organizations and Markets , 2009, SSRN Electronic Journal.