A Denoising Based Autoassociative Model for Robust Sensor Monitoring in Nuclear Power Plants

Sensors health monitoring is essentially important for reliable functioning of safety-critical chemical and nuclear power plants. Autoassociative neural network (AANN) based empirical sensor models have widely been reported for sensor calibration monitoring. However, such ill-posed data driven models may result in poor generalization and robustness. To address above-mentioned issues, several regularization heuristics such as training with jitter, weight decay, and cross-validation are suggested in literature. Apart from these regularization heuristics, traditional error gradient based supervised learning algorithms for multilayered AANN models are highly susceptible of being trapped in local optimum. In order to address poor regularization and robust learning issues, here, we propose a denoised autoassociative sensor model (DAASM) based on deep learning framework. Proposed DAASM model comprises multiple hidden layers which are pretrained greedily in an unsupervised fashion under denoising autoencoder architecture. In order to improve robustness, dropout heuristic and domain specific data corruption processes are exercised during unsupervised pretraining phase. The proposed sensor model is trained and tested on sensor data from a PWR type nuclear power plant. Accuracy, autosensitivity, spillover, and sequential probability ratio test (SPRT) based fault detectability metrics are used for performance assessment and comparison with extensively reported five-layer AANN model by Kramer.

[1]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[2]  Yoshua Bengio,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2010, AISTATS.

[3]  Mark A. Kramer,et al.  Autoassociative neural networks , 1992 .

[4]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing [Exploratory DSP] , 2011, IEEE Signal Processing Magazine.

[5]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[6]  Paolo F. Fantoni,et al.  On-line monitoring of instrument channel performance in nuclear power plant using PEANO , 2003 .

[7]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[8]  M. Marseguerra,et al.  The AutoAssociative Neural Network in signal analysis: II. Application to on-line monitoring of a simulated BWR component , 2005 .

[9]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[10]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[11]  Michael J. Piovoso,et al.  Probabilistic model for sensor fault detection and identification , 2003 .

[12]  Bayya Yegnanarayana,et al.  Analysis of autoassociative mapping neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[13]  Jonathan D. Linton,et al.  An augmented efficient backpropagation training strategy for deep autoassociative neural networks , 2010, ESANN.

[14]  Gyun Young Heo CONDITION MONITORING USING EMPIRICAL MODELS: TECHNICAL REVIEW AND PROSPECTS FOR NUCLEAR APPLICATIONS , 2008 .

[15]  Shufeng Tan,et al.  Reducing data dimensionality through optimizing neural network inputs , 1995 .

[16]  Weihua Li,et al.  Detection, identification, and reconstruction of faulty sensors with maximized sensitivity , 1999 .

[17]  Jin Jiang,et al.  Applications of fault detection and diagnosis methods in nuclear power plants: A review , 2011 .

[18]  L. Buydens,et al.  Nonlinear process monitoring using bottle-neck neural networks , 2001 .

[19]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[20]  Robert E. Uhrig,et al.  ON-LINE SENSOR CALIBRATION MONITORING AND FAULT DETECTION FOR CHEMICAL PROCESSES , 1998 .

[21]  Shahbazian Mehdi,et al.  Reconstruction based approach to sensor fault diagnosis using auto-associative neural networks , 2014 .

[22]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[23]  Enrico Zio,et al.  Fault Detection in Nuclear Power Plants Components by a Combination of Statistical Methods , 2013, IEEE Transactions on Reliability.

[24]  Ryan M. Meyer,et al.  A Review of Sensor Calibration Monitoring for Calibration Interval Extension in Nuclear Power Plants , 2012 .

[25]  J. Wesley Hines,et al.  Development and Application of Fault Detectability Performance Metrics for Instrument Calibration Verification and Anomaly Detection , 2006 .

[26]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[27]  Robert E. Uhrig,et al.  Regularization Methods for Inferential Sensing in Nuclear Power Plants , 2000 .

[28]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[29]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[30]  Robert E. Uhrig,et al.  Use of Autoassociative Neural Networks for Signal Validation , 1998, J. Intell. Robotic Syst..

[31]  Michael G. Pecht,et al.  Using cross-validation for model parameter selection of sequential probability ratio test , 2012, Expert Syst. Appl..

[32]  E. Davis,et al.  Lessons learned from the U.S. nuclear power Plant on-line monitoring programs , 2005 .

[33]  Andrei V. Gribok,et al.  Heuristic, systematic, and informational regularization for process monitoring , 2002, Int. J. Intell. Syst..

[34]  J. Wesley Hines,et al.  Instrument Surveillance and Calibration Verification Through Plant Wide Monitoring Using Autoassociative Neural Networks , 1996 .