Auto-Regressive Processes Explained by Self-Organized Maps. Application to the Detection of Abnormal Behavior in Industrial Processes

This paper analyzes the expected time evolution of an auto-regressive (AR) process using self-organized maps (SOM). It investigates how a SOM captures the time information given by the AR input process and how the transitions from one neuron to another one can be understood under a probabilistic perspective. In particular, regions of the map into which the AR process is expected to move are identified. This characterization allows detecting anomalous changes in the AR process structure or parameters. On the basis of the theoretical results, an anomaly detection method is proposed and applied to a real industrial process.

[1]  Chrissanthi Angeli,et al.  On-Line Fault Detection Techniques for Technical Systems: A Survey , 2004, Int. J. Comput. Sci. Appl..

[2]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[3]  C. A. Perazzo,et al.  Detection of abnormality in the electrocardiogram without prior knowledge by using the quantisation error of a self-organising map, tested on the European ischaemia database , 2006, Medical and Biological Engineering and Computing.

[4]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[5]  P Barbieri,et al.  Comparison of self-organizing maps classification approach with cluster and principal components analysis for large environmental data sets. , 2007, Water research.

[6]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[7]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[8]  Robin De Keyser,et al.  A self-tuning multistep predictor application , 1981, Autom..

[9]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[10]  Fabrice Rossi,et al.  Clustering functional data with the SOM algorithm , 2004, ESANN.

[11]  Helge Ritter.  Asymptotic level density for a class of vector quantization processes , 1991, IEEE Trans. Neural Networks.

[12]  Rolf Isermann,et al.  Process fault detection based on modeling and estimation methods - A survey , 1984, Autom..

[13]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[14]  Venkat Venkatasubramanian,et al.  Challenges in the industrial applications of fault diagnostic systems , 2000 .

[15]  Rolf Isermann,et al.  Model-based fault-detection and diagnosis - status and applications , 2004, Annu. Rev. Control..

[16]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[17]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[18]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[19]  Yi Sun,et al.  On quantization error of self-organizing map network , 2000, Neurocomputing.

[20]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[21]  B. Gas.  Self-Organizing MultiLayer Perceptron , 2010, IEEE Transactions on Neural Networks.

[22]  T. Warren Liao,et al.  Clustering of time series data - a survey , 2005, Pattern Recognit..

[23]  B. Hewitson,et al.  Self-organizing maps: applications to synoptic climatology , 2002 .

[24]  Jukka Heikkonen,et al.  Time Series Predicition using Recurrent SOM with Local Linear Models , 1997 .

[25]  Leonardo Aguayo,et al.  Novelty Detection in Time Series Through Self-Organizing Networks: An Empirical Evaluation of Two Different Paradigms , 2008, 2008 10th Brazilian Symposium on Neural Networks.

[26]  B. Widrow,et al.  Statistical theory of quantization , 1996 .

[27]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[28]  Michèle Basseville,et al.  Detecting changes in signals and systems - A survey , 1988, Autom..