Mining abnormal patterns from heterogeneous time‐series with irrelevant features for fault event detection

We address the issue of detecting fault events in multivariate time series. We suppose the following realistic situation: A) the features to which multivariate time series correspond are heterogeneous; B) relative to a large number of normal examples, only a small number of examples of fault events are available in advance; and C) many features irrelevant to fault events are included. In such a situation, we require real-time, high-accuracy processing. We propose an algorithm to resolve the issue. Key ideas in it include: 1) transforming the time-series for each feature into a sequence of anomaly scores, in order to map heterogeneous features to homogeneous features (an anomaly score indicates the degree of anomaly relative to an ordinal sequence) and then representing the pattern of a fault event in terms of anomaly score vectors; 2) selecting features specifying a fault event by means of iterative optimization using both normal and fault anomaly score vectors. We then monitor the degree of abnormal with regard to test anomaly score vectors by matching with the abnormal patterns. We demonstrate the effectiveness of our proposed algorithm through an application to an actual automobile fault diagnosis data set.

[1]  Chunsheng Yang,et al.  Learning to predict train wheel failures , 2005, KDD '05.

[2]  Peter McBurney,et al.  Chance Discovery , 2003, Advanced Information Processing.

[3]  Michael Fink,et al.  Object Classification from a Single Example Utilizing Class Relevance Metrics , 2004, NIPS.

[4]  Kenji Yamanishi,et al.  A unifying framework for detecting outliers and change points from time series , 2006, IEEE Transactions on Knowledge and Data Engineering.

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Chris Jermaine,et al.  Outlier detection by sampling with accuracy guarantees , 2006, KDD '06.

[7]  Ye Li,et al.  Fault diagnosis based on support vector machine ensemble , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[8]  Philip S. Yu,et al.  Outlier detection for high dimensional data , 2001, SIGMOD '01.

[9]  J. Ma,et al.  Time-series novelty detection using one-class support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[10]  Kevin P. Murphy,et al.  Modeling changing dependency structure in multivariate time series , 2007, ICML '07.

[11]  Jaideep Srivastava,et al.  Event detection from time series data , 1999, KDD '99.

[12]  Alina Beygelzimer,et al.  Entropy Approximation for Active Fault Diagnosis , 2004 .

[13]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[14]  Keisuke Inoue,et al.  Knowledge Discovery from Heterogeneous Dynamic Systems using Change-Point Correlations , 2005, SDM.

[15]  Vipin Kumar,et al.  Feature bagging for outlier detection , 2005, KDD '05.

[16]  A. Campoccia,et al.  GA-based feature selection for faults identification in electrical distribution systems , 1999, PowerTech Budapest 99. Abstract Records. (Cat. No.99EX376).

[17]  Keming Wang.  Neural Network Approach to Vibration Feature Selection and Multiple Fault Detection for Mechanical Systems , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[18]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[19]  Takehisa Yairi,et al.  An approach to spacecraft anomaly detection problem using kernel feature space , 2005, KDD '05.

[20]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[21]  Michael I. Jordan,et al.  Failure diagnosis using decision trees , 2004 .

[22]  S. Thrun,et al.  Particle Filters for Rover Fault Diagnosis , 2004 .

[23]  Padhraic Smyth,et al.  Knowledge Discovery and Data Mining: Towards a Unifying Framework , 1996, KDD.

[24]  Graham J. Williams,et al.  On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms , 2000, KDD '00.

[25]  Bo-Suk Yang,et al.  Fault Diagnosis System of Induction Motors Using Feature Extraction, Feature Selection and Classification Algorithm , 2006 .

[26]  Uri Lerner,et al.  Hybrid Bayesian networks for reasoning about complex systems , 2002 .

[27]  Bianca Zadrozny,et al.  Outlier detection by active learning , 2006, KDD '06.