LS-SVM based spectral clustering and regression for predicting maintenance of industrial machines

Abstract Accurate prediction of forthcoming faults in modern industrial machines plays a key role in reducing production arrest, increasing the safety of plant operations, and optimizing manufacturing costs. The most effective condition monitoring techniques are based on the analysis of historical process data. In this paper we show how Least Squares Support Vector Machines (LS-SVMs) can be used effectively for early fault detection in an online fashion. Although LS-SVMs are existing artificial intelligence methods, in this paper the novelty is represented by their successful application to a complex industrial use case, where other approaches are commonly used in practice. In particular, in the first part we present an unsupervised approach that uses Kernel Spectral Clustering (KSC) on the sensor data coming from a vertical form seal and fill (VFFS) machine, in order to distinguish between normal operating condition and abnormal situations. Basically, we describe how KSC is able to detect in advance the need of maintenance actions in the analysed machine, due the degradation of the sealing jaws. In the second part we illustrate a nonlinear auto-regressive (NAR) model, thus a supervised learning technique, in the LS-SVM framework. We show that we succeed in modelling appropriately the degradation process affecting the machine, and we are capable to accurately predict the evolution of dirt accumulation in the sealing jaws.

[1]  Lennart Ljung,et al.  System identification (2nd ed.): theory for the user , 1999 .

[2]  Agusmian P. Ompusunggu,et al.  A practical approach to combine data mining and prognostics for improved predictive maintenance , 2009 .

[3]  Michael J. Galloy.  Review process , 2011, 2011 Information Security for South Africa.

[4]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[5]  Fabrizio Angiulli,et al.  Outlier Detection Techniques for Data Mining , 2009, Encyclopedia of Data Warehousing and Mining.

[6]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[7]  G.S. May,et al.  Fault detection in reactive ion etching systems using one-class support vector machines , 2005, IEEE/SEMI Conference and Workshop on Advanced Semiconductor Manufacturing 2005..

[8]  S. G. Deshmukh,et al.  A literature review and future perspectives on maintenance optimization , 2011 .

[9]  Cem Iyigun,et al.  Probabilistic D-Clustering , 2008, J. Classif..

[10]  Johan A. K. Suykens,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2004, Machine Learning.

[11]  Lifeng Xi,et al.  Preventive maintenance scheduling for repairable system with deterioration , 2010, J. Intell. Manuf..

[12]  K. Johana,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2022 .

[13]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[14]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[15]  Johan A. K. Suykens,et al.  Highly sparse kernel spectral clustering with predictive out-of-sample extensions , 2010, ESANN.

[16]  Paul Hofmarcher.  Primal and dual model representations in kernel-based learning , 2011 .

[17]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[18]  Johan A. K. Suykens,et al.  Soft kernel spectral clustering , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[19]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[20]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[21]  J. Suykens,et al.  Kernel spectral clustering with memory effect , 2013 .

[22]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[23]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[24]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[26]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[27]  Johan A. K. Suykens,et al.  Kernel spectral clustering for predicting maintenance of industrial machines , 2013, 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[28]  Cheng-Lung Huang,et al.  Defect spatial pattern recognition using a hybrid SOM-SVM approach in semiconductor manufacturing , 2009, Expert Syst. Appl..

[29]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[30]  C. Yoo,et al.  Overall statistical monitoring of static and dynamic patterns , 2003 .

[31]  J. Suykens,et al.  Primal and dual model representations in kernel-based learning , 2010 .

[32]  Johan A. K. Suykens,et al.  Incremental kernel spectral clustering for online learning of non-stationary data , 2014, Neurocomputing.

[33]  Theodora Kourti,et al.  Process analysis, monitoring and diagnosis, using multivariate projection methods , 1995 .

[34]  Johan A. K. Suykens,et al.  Multiway Spectral Clustering with Out-of-Sample Extensions through Weighted Kernel PCA , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Robert B. Randall,et al.  Vibration-based Condition Monitoring: Industrial, Aerospace and Automotive Applications , 2011 .

[36]  Johan A. K. Suykens,et al.  Coupled Simulated Annealing , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).