Development of the step complexity measure for emergency operating procedures using entropy concepts

Abstract For a nuclear power plant (NPP), symptom-based emergency operating procedures (EOPs) have been adopted to enhance the safety of NPPs through reduction of operators’ workload under emergency conditions. Symptom-based EOPs, however, could place a workload on operators because they have to not only identify related symptoms, but also understand the context of steps that should be carried out. Therefore, many qualitative checklists are suggested to ensure the appropriateness of steps included in EOPs. However, since these qualitative evaluations have some drawbacks, a quantitative measure that can roughly estimate the complexity of EOP steps is imperative to compensate for them. In this paper, a method to evaluate the complexity of an EOP step is developed based on entropy measures that have been used in software engineering. Based on these, step complexity (SC) measure that can evaluate SC from various viewpoints (such as the amount of information/operators’ actions included in each EOP step, and the logic structure of each EOP step) was developed. To verify the suitableness of the SC measure, estimated SC values are compared with subjective task load scores obtained from the NASA-TLX (task load index) method and step performance time obtained from a full scope simulator. From these comparisons, it was observed that estimated SC values generally agree with the NASA-TLX scores and step performance time data. Thus, it could be concluded that the developed SC measure would be considered for evaluating SC of an EOP step.

[1]  S. Jayaprakash,et al.  Properties of Control-Flow Complexity Measures , 1991, IEEE Trans. Software Eng..

[2]  J Dickinson,et al.  Order effects and the weighting process in workload assessment. , 1993, Applied ergonomics.

[3]  Bill Curtis,et al.  Measuring the Psychological Complexity of Software Maintenance Tasks with the Halstead and McCabe Metrics , 1979, IEEE Transactions on Software Engineering.

[4]  Neal S. Coulter,et al.  Software Science and Cognitive Psychology , 1983, IEEE Transactions on Software Engineering.

[5]  J. Bartko,et al.  On Various Intraclass Correlation Reliability Coefficients , 1976 .

[6]  P. Clare Goodman,et al.  Human Factors Information System: A Tool to Assess Error Related to Human Performance in U.S. Nuclear Power Plants , 1991 .

[7]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[8]  Ki-Sig Kang,et al.  (A) study on the development of the on-line operator aid system using rule based expert system and fuzzy logic for nuclear power plants = 규칙기반 전문가시스템과 퍼지논리를 이용한 원자력 발전소의 온라인 운전원 지원시스템 개발에 관한 연구 , 1995 .

[9]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[10]  H. E. Dunsmore,et al.  Software Science Revisited: A Critical Analysis of the Theory and Its Empirical Support , 1983, IEEE Transactions on Software Engineering.

[11]  Stephen S. Yau,et al.  An Integrated Life-Cycle Model for Software Maintenance , 1988, IEEE Trans. Software Eng..

[12]  A. A. Husseiny,et al.  Analysis of gross error rates in operation of commercial nuclear power stations , 1979 .

[13]  S L Hwang,et al.  The design of an emergency operating procedure in process control systems: a case study of a refrigeration system in an ammonia plant. , 1994, Ergonomics.

[14]  John Stephen Davis,et al.  A Study of the Applicability of Complexity Measures , 1988, IEEE Trans. Software Eng..

[15]  K. Hendy,et al.  Measuring Subjective Workload: When Is One Scale Better Than Many? , 1993 .

[16]  M Angelborg-Thanderz,et al.  Information complexity--mental workload and performance in combat aircraft. , 1997, Ergonomics.

[17]  J. C. Byers,et al.  Comparison of Four Subjective Workload Rating Scales , 1992 .

[18]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[19]  Ed M. Dougherty Context and human reliability analysis , 1993 .

[20]  Z. A. Sabri,et al.  Operating procedure automation to enhance safety of nuclear power plants , 1989 .

[21]  J. Bartko The Intraclass Correlation Coefficient as a Measure of Reliability , 1966, Psychological reports.

[22]  Tharam S. Dillon,et al.  Software Complexity and Its Impact on Software Reliability , 1988, IEEE Trans. Software Eng..

[23]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[24]  J Williams,et al.  Balancing automation and human action through task analysis , 1992 .

[25]  Fatemeh Zahedi,et al.  The Analytic Hierarchy Process—A Survey of the Method and its Applications , 1986 .

[26]  R. L. Brune,et al.  Checklist for evaluating emergency operating procedures used in nuclear power plants , 1983 .

[27]  G. Gerhart,et al.  On modification of the relative complexity metric , 1996 .

[28]  Y. Dien,et al.  Ergonomic evaluation in the design of future control rooms , 1992, Conference Record for 1992 Fifth Conference on Human Factors and Power Plants.

[29]  Ali Mosleh,et al.  A methodology for modeling operator errors of commission in probabilistic risk assessment , 1994 .

[30]  R. L. Brune,et al.  Peer-review study of the draft handbook for human-reliability analysis with emphasis on nuclear-power-plant applications, NUREG/CR-1278 , 1983 .

[31]  Thomas Drake,et al.  Measuring Software Quality: A Case Study , 1996, Computer.

[32]  Asaf Degani,et al.  Cockpit Checklists: Concepts, Design, and Use , 1993 .

[33]  Martin R. Woodward,et al.  A Measure of Control Flow Complexity in Program Text , 1979, IEEE Transactions on Software Engineering.

[34]  L. K. Ainsworth,et al.  Balancing automation and human action through task analysis , 1992 .

[35]  Elaine J. Weyuker,et al.  Evaluating Software Complexity Measures , 2010, IEEE Trans. Software Eng..

[36]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[37]  P. S. Tsang,et al.  TECHNIQUES OF SUBJECTIVE WORKLOAD ASSESSMENT: A COMPARISON OF SWAT AND THE NASA-BIPOLAR METHODS , 1986 .

[38]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[39]  P A Hancock,et al.  Effects of control order, augmented feedback, input device and practice on tracking performance and perceived workload. , 1996, Ergonomics.

[40]  A. Mowshowitz,et al.  Entropy and the complexity of graphs. I. An index of the relative complexity of a graph. , 1968, The Bulletin of mathematical biophysics.

[41]  Ronald E. Prather,et al.  Design and analysis of hierarchical software metrics , 1995, CSUR.