A constraint-based genetic algorithm for optimizing neural network architectures for detection of loss of coolant accidents of nuclear power plants

Abstract The loss of coolant accident (LOCA) of a nuclear power plant (NPP) is a severe accident in the nuclear energy industry. Nowadays, neural networks have been trained on nuclear simulation transient datasets to detect LOCA. This paper proposes a constraint-based genetic algorithm (GA) to find optimised 2-hidden layer network architectures for detecting LOCA of a NPP. The GA uses a proposed constraint satisfaction algorithm called random walk heuristic to create an initial population of neural network architectures of high performance. At each generation, the GA population is split into a sub-population of feature subsets and a sub-population of 2-hidden layer architectures to breed offspring from each sub-population independently in order to generate a wide variety of network architectures. During breeding 2-hidden layer architectures, a constraint-based nearest neighbor search algorithm is proposed to find the nearest neighbors of the offspring population generated by mutation. The results showed that for LOCA detection, the GA-optimised network outperformed a random search, an exhaustive search and a RBF kernel support vector regression (SVR) in terms of generalization performance. For the skillcraft dataset of the UCI machine learning repository, the GA-optimised network has a similar performance to the RBF kernel SVR and outperformed the other approaches.

[1]  José Neves,et al.  Evolution of neural networks for classification and regression , 2007, Neurocomputing.

[2]  A. C. Gonçalves,et al.  Identification model of an accidental drop of a control rod in PWR reactors using thermocouple readings and radial basis function neural networks , 2017 .

[3]  Rina Dechter,et al.  Constraint Processing , 1995, Lecture Notes in Computer Science.

[4]  M. Farid Golnaraghi,et al.  Prognosis of machine health condition using neuro-fuzzy systems , 2004 .

[5]  Cagdas Hakan Aladag,et al.  A new architecture selection method based on tabu search for artificial neural networks , 2011, Expert Syst. Appl..

[6]  S. Sathiya Keerthi,et al.  Improvements to the SMO algorithm for SVM regression , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Yueying Wang,et al.  On Stabilization of Quantized Sampled-Data Neural-Network-Based Control Systems , 2017, IEEE Transactions on Cybernetics.

[8]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[9]  Andrew Graham,et al.  Nuclear snake-arm robots , 2012, Ind. Robot.

[10]  Ausif Mahmood,et al.  A Framework for Designing the Architectures of Deep Convolutional Neural Networks , 2017, Entropy.

[11]  Xiaogang Ruan,et al.  A tabu based neural network learning algorithm , 2007, Neurocomputing.

[12]  Gary M. Lee,et al.  Nonlinear interpolation , 1971, IEEE Trans. Inf. Theory.

[13]  Lixuan Lu,et al.  Fault Tree Analysis for an Inspection Robot in a Nuclear Power Plant , 2017 .

[14]  Man Gyun Na,et al.  ESTIMATION OF BREAK LOCATION AND SIZE FOR LOSS OF COOLANT ACCIDENTS USING NEURAL NETWORKS , 2004 .

[15]  Enrico Zio,et al.  A data-driven approach for predicting failure scenarios in nuclear systems , 2010 .

[16]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[17]  Atul Srivastava,et al.  A diagnostic system for identifying accident conditions in a nuclear reactor , 2011 .

[18]  Enrico Zio,et al.  Quantifying uncertainties in the estimation of safety parameters by using bootstrapped artificial neural networks , 2008 .

[19]  Krzysztof R. Apt,et al.  Constraint logic programming using Eclipse , 2007 .

[20]  Eric B. Bartlett,et al.  Nuclear power plant status diagnostics using an artificial neural network , 1992 .

[21]  Mohamed Ettaouil,et al.  Genetic algorithm for neural network architecture optimization , 2016, 2016 3rd International Conference on Logistics Operations Management (GOL).

[22]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[23]  Patricia Melin,et al.  Multi-objective optimization for modular granular neural networks applied to pattern recognition , 2017, Inf. Sci..

[24]  Rodrigo Fernandes de Mello,et al.  Designing architectures of convolutional neural networks to solve practical problems , 2018, Expert Syst. Appl..

[25]  Le Van Hong,et al.  LARGE LOCA ANALYSIS OF INDIAN PRESSURIZED HEAVY WATER REACTOR - 220 MWe , 2002 .

[26]  Randall S. Sexton,et al.  Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing , 1999, Eur. J. Oper. Res..

[27]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[28]  Roberto Musmanno,et al.  Heuristic techniques to optimize neural network architecture in manufacturing applications , 2015, Neural Computing and Applications.

[29]  Fevrier Valdez,et al.  Modular Neural Networks architecture optimization with a new nature inspired method using a fuzzy combination of Particle Swarm Optimization and Genetic Algorithms , 2014, Information Sciences.

[30]  Zuhairi Baharudin,et al.  Optimization of neural network architecture using genetic algorithm for load forecasting , 2014, 2014 5th International Conference on Intelligent and Advanced Systems (ICIAS).

[31]  James Cussens,et al.  Integer Linear Programming for the Bayesian network structure learning problem , 2017, Artif. Intell..

[32]  Patricia Melin,et al.  Optimization of modular granular neural networks using hierarchical genetic algorithms for human recognition using the ear biometric measure , 2014, Eng. Appl. Artif. Intell..

[33]  Toby Walsh,et al.  Handbook of Constraint Programming (Foundations of Artificial Intelligence) , 2006 .

[34]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[35]  Enrico Zio,et al.  Safety margin sensitivity analysis for model selection in nuclear power plant probabilistic safety assessment , 2017, Reliab. Eng. Syst. Saf..

[36]  Mustafa Demetgul,et al.  Fault diagnosis of rolling bearings using a genetic algorithm optimized neural network , 2014 .

[37]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[38]  Zhichao Guo,et al.  Use of artificial neural networks to analyze nuclear power plant performance , 1992 .

[39]  Celso Marcelo Franklin Lapa,et al.  Adaptive fuzzy system for fuel rod cladding failure in nuclear power plant , 2007 .

[40]  Krzysztof R. Apt,et al.  Principles of constraint programming , 2003 .

[41]  Man Gyun Na,et al.  Prediction and uncertainty analysis of power peaking factor by cascaded fuzzy neural networks , 2017 .

[42]  James Cussens,et al.  Bayesian network learning with cutting planes , 2011, UAI.

[43]  Enrico Zio,et al.  Bagged Ensemble of Fuzzy C Means Classifiers for Nuclear Transient Identification , 2011 .

[44]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[45]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[46]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[47]  Jiashuang Wan,et al.  Prediction Study on PCI Failure of Reactor Fuel Based on a Radial Basis Function Neural Network , 2016 .

[48]  James Cussens,et al.  Bayesian Network Structure Learning with Integer Programming: Polytopes, Facets and Complexity , 2017, J. Artif. Intell. Res..

[49]  Naser Pariz,et al.  Adaptive fuzzy fitness granulation for evolutionary optimization , 2008, Int. J. Approx. Reason..

[50]  Carlos Henggeler Antunes,et al.  Comparison of a genetic algorithm and simulated annealing for automatic neural network ensemble development , 2013, Neurocomputing.

[51]  Hamid Reza Karimi,et al.  Improved Stability and Stabilization Results for Stochastic Synchronization of Continuous-Time Semi-Markovian Jump Neural Networks With Time-Varying Delay , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[52]  N. G. J. Dias,et al.  Optimizing neural network architectures for image recognition using genetic algorithms , 2015, 2015 Fifteenth International Conference on Advances in ICT for Emerging Regions (ICTer).