Assessing the Performance of a Classification-Based Vulnerability Analysis Model.

In this article, a classification model based on the majority rule sorting (MR-Sort) method is employed to evaluate the vulnerability of safety-critical systems with respect to malevolent intentional acts. The model is built on the basis of a (limited-size) set of data representing (a priori known) vulnerability classification examples. The empirical construction of the classification model introduces a source of uncertainty into the vulnerability analysis process: a quantitative assessment of the performance of the classification model (in terms of accuracy and confidence in the assignments) is thus in order. Three different app oaches are here considered to this aim: (i) a model-retrieval-based approach, (ii) the bootstrap method, and (iii) the leave-one-out cross-validation technique. The analyses are presented with reference to an exemplificative case study involving the vulnerability assessment of nuclear power plants.

[1]  B. Roy.  THE OUTRANKING APPROACH AND THE FOUNDATIONS OF ELECTRE METHODS , 1991 .

[2]  Enrico Zio,et al.  A Hierarchical Decision Making Framework for Vulnerability Analysis , 2013 .

[3]  E. Zio,et al.  A study of the bootstrap method for estimating the accuracy of artificial neural networks in predicting nuclear transient processes , 2006, IEEE Transactions on Nuclear Science.

[4]  E. Zio,et al.  Bootstrap-based techniques for computing Monte Carlo system reliability confidence intervals in evaluation , 2005, Annual Reliability and Maintainability Symposium, 2005. Proceedings..

[5]  Ricardo Gutierrez-Osuna,et al.  Pattern analysis for machine olfaction: a review , 2002 .

[6]  Terje Aven,et al.  An extended risk assessment approach for chemical plants applied to a study related to pipe ruptures , 2012, Reliab. Eng. Syst. Saf..

[7]  Terje Aven,et al.  Some reflections on uncertainty analysis and management , 2010, Reliab. Eng. Syst. Saf..

[8]  Marc Pirlot,et al.  Learning the Parameters of a Multiple Criteria Sorting Method , 2011, ADT.

[9]  Enrico Zio,et al.  Bagged Ensemble of Fuzzy C Means Classifiers for Nuclear Transient Identification , 2011 .

[10]  Terje Aven,et al.  Reliability and validity of risk analysis , 2009, Reliab. Eng. Syst. Saf..

[11]  Tony R. Martinez,et al.  Combining cross-validation and confidence to measure fitness , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  Vincent Mousseau,et al.  Inferring an ELECTRE TRI Model from Assignment Examples , 1998, J. Glob. Optim..

[13]  Terje Aven,et al.  Use of decision criteria based on expected values to support decision-making in a production assurance and safety setting , 2009, Reliab. Eng. Syst. Saf..

[14]  Enrico Zio,et al.  A model based on bootstrapped neural networks for computing the maximum fuel cladding temperature in an Rmbk-1500 nuclear reactor accident , 2008 .