Combining MLP and RBF Neural Networks for Novelty Detection in Short Time Series

Novelty detection in time series is an important problem with application in different domains such as machine failure detection, fraud detection and auditing. In many problems, the occurrence of short length time series is a frequent characteristic. In previous works we have proposed a novelty detection approach for short time series that uses RBF neural networks to classify time series windows as normal or novelty. Additionally, both normal and novelty random patterns are added to training sets to improve classification performance. In this work we consider the use of MLP networks as classifiers. Next, we analyze (a) the impact of validation and training sets generation, and (b) of the training method. We have carried out a number of experiments using four real-world time series, whose results have shown that under a good selection of these alternatives, MLPs perform better than RBFs. Finally, we discuss the use of MLP and MLP/RBF committee machines in conjunction with our previous method. Experimental results shows that these committee classifiers outperform single MLP and RBF classifiers.

[1]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[2]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[3]  Michael R. Berthold,et al.  Boosting the Performance of RBF Networks with Dynamic Decay Adjustment , 1994, NIPS.

[4]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction, 4th edn. , 1990 .

[5]  Sameer Singh,et al.  An approach to novelty detection applied to the classification of image regions , 2004, IEEE Transactions on Knowledge and Data Engineering.

[6]  D. Dasgupta,et al.  Combining negative selection and classification techniques for anomaly detection , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1981 .

[8]  Silvio Romero de Lemos Meira,et al.  Novelty Detection for Short Time Series with Neural Networks , 2003, HIS.

[9]  Eamonn J. Keogh,et al.  Finding surprising patterns in a time series database in linear time and space , 2002, KDD.

[10]  Cyrus Shahabi,et al.  TSA-tree: a wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data , 2000, Proceedings. 12th International Conference on Scientific and Statistica Database Management.

[11]  Eija Koskivaara Artificial neural network models for predicting patterns in auditing monthly balances , 1997, ECIS.

[12]  Jingtao Yao,et al.  A case study on using neural networks to perform technical forecasting of forex , 2000, Neurocomputing.

[13]  Michael R. Berthold,et al.  A time delay radial basis function network for phoneme recognition , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).