Toward quantifying metrics for rail-system resilience: identification and analysis of performance weak resilience signals

Abstract This paper aims to enhance tangibility of the resilience engineering concept by facilitating understanding and operationalization of weak resilience signals (WRSs) in the rail sector. Within complex socio-technical systems, accidents can be seen as unwanted outcomes emerging from uncontrolled sources of entropy (functional resonance). Various theoretical models exist to determine the variability of system interactions, the resilience state and the organization’s intrinsic abilities to reorganize and manage their functioning and adaptive capacity to cope with unexpected and unforeseen disruptions. However, operationalizing and measuring concrete and reliable manifestations of resilience and assessing their impact at a system level have proved to be a challenge. A multi-method, ethnographic observation and resilience questionnaire, were used to determine resilience baseline conditions at an operational rail traffic control post. This paper describes the development, implementation and initial validation of WRSs identified and modeled around a ‘performance system boundary.’ In addition, a WRS analysis function is introduced to interpret underlying factors of the performance WRSs and serves as a method to reveal potential sources of future resonance that could comprise system resilience. Results indicate that performance WRSs can successfully be implemented to accentuate relative deviations from resilience baseline conditions. A WRS analysis function can help to interpret these divergences and could be used to reveal (creeping) change processes and unnoticed initiating events that facilitate emergence that degrades rail-system resilience. Establishing relevant change signals in advance can contribute to anticipation and awareness, enhance organizational learning and stimulate resilient courses of action and adaptive behavior that ensures rail operation reliability.

[1]  Jan Maarten Schraagen,et al.  ADAPTER: Analysing and developing adaptability and performance in teams to enhance resilience , 2015, Reliab. Eng. Syst. Saf..

[2]  Ann Blandford,et al.  A resilience markers framework for small teams , 2011, Reliab. Eng. Syst. Saf..

[3]  Charles-Clemens Rüling Towards a conceptual framework , 2002 .

[4]  Rob M.P. Goverde,et al.  PERFORMANCE EVALUATION OF NETWORK TIMETABLES USING PETER , 2002 .

[5]  John R Wilson,et al.  Rail human factors: Past, present and future. , 2005, Applied ergonomics.

[6]  Laura Pickup,et al.  The Integrated Workload Scale (IWS): a new self-report tool to assess railway signaller workload. , 2005, Applied ergonomics.

[7]  David R. Millen,et al.  Rapid ethnography: time deepening strategies for HCI field research , 2000, DIS '00.

[8]  Zahid H Qureshi,et al.  A Review of Accident Modelling Approaches for Complex Critical Sociotechnical Systems , 2008 .

[9]  Kevin Heaslip,et al.  A Sketch Level Method for Assessing Transportation Network Resiliency toNatural Disasters and Man-Made Events , 2010 .

[10]  David D. Woods John Wreathall STRESS-STRAIN PLOTS AS A BASIS FOR ASSESSING SYSTEM RESILIENCE , 2016 .

[11]  Erik Hollnagel,et al.  The Four Cornerstones of Resilience Engineering , 2016 .

[12]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[13]  Walter Schön,et al.  Interdisciplinary safety analysis of complex socio-technological systems based on the functional resonance accident model: An application to railway trafficsupervision , 2011, Reliab. Eng. Syst. Saf..

[14]  Bruce A. Francis,et al.  Feedback Control Theory , 1992 .

[15]  David Woods,et al.  Incidents – Markers of Resilience or Brittleness? , 2017 .

[16]  Pascale Carayon,et al.  Behind Human Error: Taming Complexity to Improve Patient Safety , 2006 .

[17]  Paul T. Bartone,et al.  Resilience Under Military Operational Stress: Can Leaders Influence Hardiness? , 2006 .

[18]  A. Edmondson,et al.  Team Reflexivity as an Antidote to Team Information-Processing Failures , 2014 .

[19]  S. Low,et al.  The "robust yet fragile" nature of the Internet. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Stephen M. Kosslyn,et al.  How Team Composition and Collaborative Planning Jointly Shape Analytic Effectiveness , 2008 .

[21]  B. Berche,et al.  Resilience of public transport networks against attacks , 2009, 0905.1638.

[22]  Miha Škerlavaj,et al.  Transactional and Transformational Leadership Impacts on Organizational Learning , 2009 .

[23]  David D. Woods,et al.  How do Systems Manage Their Adaptive Capacity to Successfully Handle Disruptions? A Resilience Engineering Perspective , 2010, AAAI Fall Symposium: Complex Adaptive Systems.

[24]  Erik Hollnagel,et al.  Resilience Engineering : New directions for measuring and maintaining safety in complex systems Final Report , November 2008 , 2008 .

[25]  Thomas Herrmann,et al.  A modelling method for the development of groupware applications as socio-technical systems , 2004, Behav. Inf. Technol..

[26]  Erik Hollnagel,et al.  Resilience Engineering in Practice: A Guidebook , 2012 .

[27]  A. W. Siegel,et al.  Measuring Workload Weak Resilience Signals at a Rail Control Post , 2014 .

[28]  B. Bass From transactional to transformational leadership: Learning to share the vision. , 1990 .

[29]  Yiannis Xenidis,et al.  Comparative Evaluation of Resilience Quantification Methods for Infrastructure Systems , 2013 .

[30]  Duncan David Nulty,et al.  The adequacy of response rates to online and paper surveys: what can be done? , 2008 .

[31]  Zahid H. Qureshi,et al.  A review of accident modelling approaches for complex socio-technical systems , 2007 .

[32]  Corinne Bieder,et al.  Trapping Safety into Rules: How Desirable or Avoidable is Proceduralization? , 2013 .

[33]  Nancy G. Leveson,et al.  A new accident model for engineering safer systems , 2004 .

[34]  Ann Blandford,et al.  DiCoT: A Methodology for Applying Distributed Cognition to the Design of Teamworking Systems , 2005, DSV-IS.

[35]  René Amalberti,et al.  The paradoxes of almost totally safe transportation systems , 2001 .

[36]  Sarah Sharples,et al.  Resilience in rail engineering work , 2013 .

[37]  Ernst Mach,et al.  Erkenntnis und Irrtum : Skizzen zur Psychologie der Forschung , 1905 .

[38]  Paulo Victor Rodrigues de Carvalho,et al.  The use of Functional Resonance Analysis Method (FRAM) in a mid-air collision to understand some characteristics of the air traffic management system resilience , 2011, Reliab. Eng. Syst. Saf..

[39]  Sidney Dekker,et al.  Drift into Failure: From Hunting Broken Components to Understanding Complex Systems , 2011 .

[40]  W. Skipper,et al.  Shouldering Risks: The Culture of Control in the Nuclear Power Industry , 2006 .

[41]  G. McCarthy FRAM: the functional resonance analysis method, modelling complex socio-technical systems , 2013 .

[42]  E. Hollnagel FRAM: The Functional Resonance Analysis Method: Modelling Complex Socio-technical Systems , 2012 .

[43]  Erik Hollnagel,et al.  Safety-I and Safety-II: The Past and Future of Safety Management , 2014 .

[44]  Marlys K. Christianson,et al.  Managing the unexpected , 2001 .

[45]  Scott E. Bryant The Role of Transformational and Transactional Leadership in Creating, Sharing and Exploiting Organizational Knowledge , 2003 .

[46]  David D. Woods,et al.  Hollnagel’s test: being ‘in control’ of highly interdependent multi-layered networked systems , 2010, Cognition, Technology & Work.

[47]  Constance Perin,et al.  Shouldering Risks: The Culture of Control in the Nuclear Power Industry , 2004 .

[48]  Erik Hollnagel,et al.  Epilogue: RAG – The Resilience Analysis Grid , 2017 .

[49]  Jens Rasmussen,et al.  Risk management in a dynamic society: a modelling problem , 1997 .

[50]  Shirley A. Star,et al.  AMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH , 1980 .

[51]  Erik Hollnagel,et al.  Barriers And Accident Prevention , 2004 .

[52]  Azad M. Madni,et al.  Towards a Conceptual Framework for Resilience Engineering , 2009, IEEE Systems Journal.

[53]  Tony Huzzard,et al.  Towards a Conceptual Framework , 2014 .

[54]  M. Scheffer,et al.  Alternative equilibria in shallow lakes. , 1993, Trends in ecology & evolution.

[55]  G. R. J. Hockey,et al.  The railway as a socio-technical system: Human factors at the heart of successful rail engineering , 2007 .

[56]  Ann Blandford,et al.  Resilience Markers for Safer Systems and Organisations , 2008, SAFECOMP.

[57]  Patrick Waterson,et al.  Systemic accident analysis: examining the gap between research and practice. , 2013, Accident; analysis and prevention.

[58]  B. M. Staw The Escalation of Commitment To a Course of Action , 1981 .