Cold Start Approach for Data-Driven Fault Detection

A typical assumption in supervised fault detection is that abundant historical data are available prior to model learning, where all types of faults have already been observed at least once. This assumption is likely to be violated in practical settings as new fault types can emerge over time. In this paper we study this often overlooked cold start learning problem in data-driven fault detection, where in the beginning only normal operation data are available and faulty operation data become available as the faults occur. We explored how to leverage strengths of unsupervised and supervised approaches to build a model capable of detecting faults even if none are still observed, and of improving over time, as new fault types are observed. The proposed framework was evaluated on the benchmark Tennessee Eastman Process data. The proposed fusion model performed better on both unseen and seen faults than the stand-alone unsupervised and supervised models.

[1]  Moisès Graells,et al.  A semi-supervised approach to fault diagnosis for chemical processes , 2010, Comput. Chem. Eng..

[2]  Bo-Suk Yang,et al.  Combination of independent component analysis and support vector machines for intelligent faults diagnosis of induction motors , 2007, Expert Syst. Appl..

[3]  Yew Seng Ng,et al.  Evaluation of decision fusion strategies for effective collaboration among heterogeneous fault diagnostic methods , 2011, Comput. Chem. Eng..

[4]  ChangKyoo Yoo,et al.  Statistical monitoring of dynamic processes based on dynamic independent component analysis , 2004 .

[5]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[6]  Bhaskar D. Kulkarni,et al.  Knowledge incorporated support vector machines to detect faults in Tennessee Eastman Process , 2005, Comput. Chem. Eng..

[7]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[8]  Theodora Kourti,et al.  Statistical Process Control of Multivariate Processes , 1994 .

[9]  James T. Kwok,et al.  Prototype vector machine for large scale semi-supervised learning , 2009, ICML '09.

[10]  Silvio Simani,et al.  Identification and fault diagnosis of a simulated model of an industrial gas turbine , 2005, IEEE Transactions on Industrial Informatics.

[11]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[12]  Samuel H. Huang,et al.  Robust and Efficient Rule Extraction Through Data Summarization and Its Application in Welding Fault Diagnosis , 2008, IEEE Transactions on Industrial Informatics.

[13]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[14]  Frank L. Lewis,et al.  Intelligent Diagnosis and Prognosis of Tool Wear Using Dominant Feature Identification , 2009, IEEE Transactions on Industrial Informatics.

[15]  Shi Zhang,et al.  An integrated method of independent component analysis and support vector machines for industry distillation process monitoring , 2010 .

[16]  Adwait Ratnaparkhi,et al.  A Maximum Entropy Model for Part-Of-Speech Tagging , 1996, EMNLP.

[17]  Gilles Blanchard,et al.  Semi-Supervised Novelty Detection , 2010, J. Mach. Learn. Res..

[18]  Peng Xu,et al.  Decentralized fault detection and diagnosis via sparse PCA based decomposition and Maximum Entropy decision fusion , 2012 .

[19]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[20]  Chun-Chin Hsu,et al.  Integrate Independent Component Analysis and Support Vector Machine for Monitoring Non-Gaussian Multivariate Process , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[21]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[22]  Arthur K. Kordon,et al.  Fault diagnosis based on Fisher discriminant analysis and support vector machines , 2004, Comput. Chem. Eng..

[23]  Ratna Babu Chinnam,et al.  An Industrial Strength Novelty Detection Framework for Autonomous Equipment Monitoring and Diagnostics , 2010, IEEE Transactions on Industrial Informatics.

[24]  Hong Zhou,et al.  Decentralized Fault Diagnosis of Large-Scale Processes Using Multiblock Kernel Partial Least Squares , 2010, IEEE Transactions on Industrial Informatics.

[25]  Haifeng Chen,et al.  Combining supervised and unsupervised monitoring for fault detection in distributed computing systems , 2006, SAC '06.

[26]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[27]  Lei Xie,et al.  Research on an integrated ICA-SVM based framework for fault diagnosis , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[28]  David Shan-Hill Wong,et al.  Fault Detection Based on Statistical Multivariate Analysis and Microarray Visualization , 2010, IEEE Transactions on Industrial Informatics.

[29]  Tor Arne Johansen,et al.  An Integrated Approach to On-line Fault Detection and Diagnosis - Including Artificial Neural Networks with Local Basis-Functions , 1992 .

[30]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[31]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .