The design of a human reliability assessment method for structural engineering

In the recent past a number of buildings collapsed in the Netherlands under apparent normal circumstances. The causes of these failures are predominantly human error within the design or construction of the building. Examples of this are the collapse of five balconies of an apartment building in Maastricht in 2003, and the partial collapse of a roof structure under construction of a football stadium in Enschede in 2012. Based on these developments it is of importance to investigate the current building practice concerning the occurrence of human error. The objective of this research is to investigate the effect of human error within the design process on the reliability of building structures. Based on this, the following research question is defined: What are the consequences of human error within the structural design process on the structural reliability of a typical building structure? The research question is answered by proposing a Human Reliability Assessment method and subsequently analyse the effect of selected human actions within the structural design process. This method is envisioned as a monitoring method for use within engineering/construction organizations. The research consists of two consecutive parts. Firstly a literature study is performed to examine the current knowledge concerning human error in structural engineering. Secondly, based on the literature findings, a model for Human Reliability Assessment in structural engineering processes is proposed. This model is subsequently used to investigate the effect of human error within a specified structural design process. literature study The literature study focusses on four aspects: the occurrence of structural failure, the basic aspects of human error, the basics of Human Reliability Assessments and probabilistic quantification methods. Concerning the occurrence of structural failure, it can be concluded that the majority of the failures are caused by human error (Fruhwald, Serrano, Toratti, Emilsson & Thelandersson, 2007). In most researches a value of eighty to ninety percent is mentioned (Ellingwood, 1987; Stewart, 1993; Vrouwenvelder, 2011). Based on the researches of Fruhwald et al. (2007), Boot (2010) and ABC-meldpunt (2011) it can be concluded that the occurrence or errors are of the same order of magnitude for design and construction, with slightly higher frequencies for the design phase. An important aspect of failure is that in general multiple causes can be identified (CUR, 2010), and that taking away one of these causes usually mitigates the undesired situation. A useful model to represent error causation is the “Swiss cheese“ model (Reason, 2000; Reason, Carthey & de Leval, iii 2001). The model exists of several defensive layers between an hazard and an undesired situation. In an ideal world these layers would be intact. However in the real world holes are occurring, making an undesired situation possible. Another relevant aspect of failure is the cognitive level on which an error is made. A subdivision of this is given by Reason (1990): a skillbased level, rule-based level and knowledge-based level. This subdivision is roughly based on the complexity of the task at hand and the level of attention. One method to investigate human error within design is by means of a Human Reliability Assessment (HRA). These techniques mostly contain three basic techniques (Kirwan, 1994): identify which errors can occur, deciding how likely the errors are to occur and reducing this error likelihood. Most of the HRA techniques are aimed towards subdividing a process in a task sequence, and subsequently analyse these task sequences on human error. An example is the ‘Cognitive Reliability and Error Analysis Method‘ (CREAM), which is used within the main research. The last aspect discussed in the literature study is the use of probability analysis techniques for quantifying human error probabilities. A frequently used technique is reliability analysis methods which focus on relative effect of failures on the global reliability index of the structure. Another technique is scenario analysis, in which scenarios for errors are investigated to quantify relative consequences associated with these errors. A useful computation method for these kinds of analysis is Monte Carlo analysis, which uses repeated random sampling to calculate results for the analysis. main research In order to investigate the effect of human error in design tasks, a HRA method for specific use within engineering tasks is proposed. A simplified flow chart of this methodology is presented in figure 1. The model encompasses basically four elements: A qualitative analysis, a human error quantification stage, a design simulation stage and a probabilistic analysis. Qualitative Analysis Human error quantification Design simulation Probabilistic analysis Kwalitatieve analyse Menselijke fout kwantificatie Ontwerp simulatie Probabilistische analyse Identify considered process Select scenarios to be analysed Identify context Identify design steps Design steps overview Figure 1: Basic steps within the HRA model The first step in the HRA model is to define the process of interest and its boundaries (qualitative analysis). Furthermore, a selection of the most error prone processes within the overall process is required in order to focus the HRA efforts. The selected process is a structural design process of a beam element within a common office building. The office building is envisioned as a framework of concrete beams and columns supporting a slab floor. The overall stability is arranged by means of a concrete core. Within the analysis two beam types are considered: a statical determined beam element iv and a statical undetermined beam element. Furthermore two scenarios for specific analysis are selected: the level of professional knowledge and the level of design control. The second step within the HRA method is to quantify the probability of failure within an individual design task. This probability of failure is represented by a probability distribution function expressed by two parameters: a Human Error Probability (HEP) and an Error Magnitude (EM). The EM is a parameter which describes the severity of an error. The procedure for determining HEPs consists of two methods: a basic HEP method and an extended HEP method. The extended method is labour intensive and requires quite some knowledge concerning human factors. The simplified method requires considerate less efforts and knowledge, however this method is only applicable for standard design tasks. The simplified method distinct seven basic design tasks, each subdivided in three cognitive levels: a rule-, a skill- and a knowledge based task level. The third step is to combine the task probability distributions to obtain an overall probability distribution of the element strength due to errors in the process. For this, a Monte Carlo simulation procedure is proposed. Within this simulation process, each design task is modelled with an algorithm which models the design task at hand and the occurrence of failure. Furthermore design control is modelled as well in order to investigate the proposed scenarios. For this a subdivision is made between self-checking (by the designer) and normal supervision. Based on the analysis performed in the case study it can be concluded that the proposed simulation method is useful for combining task probability distributions into an overall probability distribution. However improvements are required for practical use of the model. The last step in the model is to determine the probability of failure of the engineered structure. For this a probabilistic analysis method based on plastic limit state analysis is proposed. The overall probability distributions found in step three combined with probabilistic loading conditions are used to determine the structural failure probability. Based on the analysis is can be concluded that the structural failure probability can increase considerable. Finally it can be concluded that the proposed HRA model has the potential to quantify the effect of human error within carefully defined boundary conditions. However further research is required to increase the accuracy of the model and its practical use. From the case study it can be concluded that the statical determined beam element is slightly more susceptible to structural failure.Within both structural types, the influence of design experience on the structural failure is limited. Furthermore, the effect of normal supervision on the failure probability in comparison to a process with only self-checking is about a factor 2,4 to 4,0. A design process without supervision and self-checking results in an unrealistic failure probability. However the occurrence of this seems not logical as self-checking is always present, mostly in a subconscious manner.

[1]  William B. Rouse,et al.  Models of human problem solving: Detection, diagnosis, and compensation for system failures , 1982, Autom..

[2]  Roger M. Cooke,et al.  Causal Model for Air Transport Safety: Final report , 2008 .

[3]  Robert E. Melchers,et al.  Human error in structural reliability assessments , 1984 .

[4]  James T. Reason,et al.  Managing the risks of organizational accidents , 1997 .

[5]  D E Allen ERRORS IN CONCRETE STRUCTURES , 1979 .

[6]  J. Reason,et al.  Diagnosing “vulnerable system syndrome”: an essential prerequisite to effective risk management , 2001, Quality in health care : QHC.

[7]  Andrzej S. Nowak,et al.  Sensitivity Analysis for Structural Errors , 1985 .

[8]  B Kirwan,et al.  The validation of three human reliability quantification techniques--THERP, HEART and JHEDI: Part II--Results of validation exercise. , 1997, Applied ergonomics.

[9]  Donald O. Dusenberry,et al.  Building Design for Abnormal Loads and Progressive Collapse , 2005 .

[10]  Hugo Priemus,et al.  Construction safety: An analysis of systems failure: The case of the multifunctional Bos & Lommerplein estate, Amsterdam , 2010 .

[11]  Dana Crowe,et al.  Failure Modes and Effects Analysis , 2001 .

[12]  George Apostolakis,et al.  Data analysis in risk assessments , 1982 .

[13]  Dan M. Frangopol,et al.  Balancing weight, system reliability and redundancy in a multiobjective optimization framework , 1990 .

[14]  Dimitri V. Val,et al.  Robustness of Frame Structures , 2006 .

[15]  J.C. Williams,et al.  A data-based method for assessing and reducing human error to improve operational performance , 1988, Conference Record for 1988 IEEE Fourth Conference on Human Factors and Power Plants,.

[16]  Alan D. Swain,et al.  Human reliability analysis: Need, status, trends and limitations , 1990 .

[17]  Faisal Khan,et al.  Determination of human error probabilities for offshore platform musters , 2005 .

[18]  Andrzej S. Nowak Effect of Human Error on Structural Safety , 1979 .

[19]  W. F. Boot Constructieve schade: Een onderzoek naar de constructieve schade in bouwwerken en de wijze waarop wet- en regelgeving een rol spelen bij het waarborgen van de constructieve veiligheid , 2010 .

[20]  J.A.C.M. Doorewaard,et al.  Het ontwerpen van een onderzoek , 2007 .

[21]  Uwe Starossek,et al.  Progressive Collapse of Structures , 2009 .

[22]  Robert E. Melchers Human Error in Structural Design Tasks , 1989 .

[23]  R E Melchers,et al.  HUMAN ERROR IN STRUCTURAL RELIABILITY - I: INVESTIGATION OF TYPICAL DESIGN TASKS , 1984 .

[24]  Nigel Hyatt Incident Investigation and Accident Prevention in the Process and Allied Industries , 2006 .

[25]  Uwe Starossek,et al.  Progressive Collapse of Structures: Nomenclature and Procedures , 2006 .

[26]  A.C.W.M. Vrouwenvelder Developments towards full probabilistic design codes , 2002 .

[27]  Miroljub Grozdanovic,et al.  Framework for human error quantification , 2006 .

[28]  Mark G. Stewart Structural reliability and error control in reinforced concrete design and construction , 1993 .

[29]  Fabian C. Hadipriono Analysis of Events in Recent Structural Failures , 1985 .

[30]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[31]  Kenneth L. Carper,et al.  Design and Construction Failures: Lessons from Forensic Investigations , 1991 .

[32]  F John,et al.  Three mile island accident , 2008 .

[33]  R. Rackwitz,et al.  Structural reliability under combined random load sequences , 1978 .

[34]  Mark G. Stewart Simulation of human error in reinforced concrete design , 1992 .

[35]  Mark G. Stewart,et al.  Human Error and Reliability of Multistory Reinforced-Concrete Building Construction , 2004 .

[36]  H. Gulvanessian,et al.  EN1990 Eurocode—Basis of structural design , 2001 .

[37]  David A. Nethercot,et al.  Progressive collapse of multi-storey buildings due to sudden column loss — Part I: Simplified assessment framework , 2008 .

[38]  Erik Hollnagel,et al.  Epilogue: Resilience Engineering Precepts , 2006 .

[39]  Bruce R. Ellingwood DESIGN AND CONSTRUCTION ERROR EFFECTS ON STRUCTURAL RELIABILITY , 1987 .

[40]  Teemu Reiman,et al.  Leading indicators of system safety – Monitoring and driving the organizational safety potential , 2012 .

[41]  Jack W. Baker,et al.  On the assessment of robustness , 2008 .

[42]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method , 1998 .

[43]  Mark G. Stewart,et al.  CHECKING MODELS IN STRUCTURAL DESIGN , 1989 .

[44]  Dimitris Diamantidis Robustness of buildings in structural codes , 2010 .

[45]  Roger M. Cooke,et al.  Further development of a Causal model for Air Transport Safety (CATS): Building the mathematical heart , 2009, Reliab. Eng. Syst. Saf..

[46]  R. Burchfield Oxford English dictionary , 1982 .

[47]  John Dalsgaard Sørensen,et al.  Robustness of structures: EU COST action TU0601 , 2009 .

[48]  Gary Herrin,et al.  A guide to practical human reliability assessment , 1996 .

[49]  Michael Havbro Faber,et al.  Applications of Statistics and Probability in Civil Engineering , 2011 .

[50]  Dan M. Frangopol,et al.  On Structural Robustness, Redundancy, and Static Indeterminacy , 2008 .

[51]  Bilal M. Ayyub,et al.  Analysis of Recent U.S. Structural and Construction Failures , 1991 .

[52]  D. V. Rosowsky,et al.  Accounting for Human Error during Design and Construction , 1995 .

[53]  J. Shaoul Human Error , 1973, Nature.

[54]  Haig Gulvanessian,et al.  Robustness and the Eurocodes , 2006 .

[55]  B Kirwan,et al.  The validation of three human reliability quantification techniques - THERP, HEART and JHEDI: part 1 - technique descriptions and validation issues. , 1996, Applied ergonomics.

[56]  Mark G. Stewart Modelling human error rates for human reliability analysis of a structural design task , 1992 .

[57]  John W. Saull,et al.  The Probability and Management of Human Error , 2004 .

[58]  Dirk G Mans,et al.  Evaluation of the Risk Management of Structural Safety in 15 Building Projects , 2009 .

[59]  Dan M. Frangopol,et al.  Effects of Damage and Redundancy on Structural Reliability , 1987 .

[60]  Richard Williams This one will bring the house down , 2011 .

[61]  A. Hughes Oxford English Dictionary. , 2008, Isis; an international review devoted to the history of science and its cultural influences.

[62]  Sven Thelandersson,et al.  Design of safe timber structures - How can we learn from structural failures in concrete, steel and timber? , 2007 .

[63]  P. Hudson Safety science: It's not rocket science, it's much harder , 2010 .

[64]  Robert E. Melchers Human error in structural design , 1984 .

[65]  N. Meshkati Human factors in large-scale technological systems' accidents: Three Mile Island, Bhopal, Chernobyl , 1991 .