A particle swarm‐optimized support vector machine for reliability prediction

System reliability depends on inherent mechanical and structural aging factors as well as on operational and environmental conditions, which could enhance (or smoothen) such factors. In practice, the involved dependences may burden the modeling of the reliability behavior over time, in which traditional stochastic modeling approaches may likely fail. Empirical prediction methods, such as support vector machines (SVMs), become a valid alternative whenever reliable time series data are available. However, the prediction performance of SVMs depends on the setting of a number of parameters that influence the effectiveness of the training stage during which the SVMs are constructed based on the available data set. The problem of choosing the most suitable values for the SVM parameters can be framed in terms of an optimization problem aimed at minimizing a prediction error. In this work, this problem is solved by particle swarm optimization (PSO), a probabilistic approach based on an analogy with the collective motion of biological organisms. SVM in liaison with PSO is then applied to tackle reliability prediction problems based on time series data of engineered components. Comparisons of the obtained results with those given by other time series techniques indicate that the PSO + SVM model is able to provide reliability predictions with comparable or great accuracy. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Ingo Mierswa Controlling overfitting with multi-objective support vector machines , 2007, GECCO '07.

[4]  Richard C.M. Yam,et al.  Intelligent Predictive Decision Support System for Condition-Based Maintenance , 2001 .

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  Chandrasekhar Nataraj,et al.  Use of particle swarm optimization for machinery fault detection , 2009, Eng. Appl. Artif. Intell..

[7]  Hsuan-Tien Lin A Study on Sigmoid Kernels for SVM and the Training of non-PSD Kernels by SMO-type Methods , 2005 .

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  P. C. Sander,et al.  Repairable systems reliability: Modeling, inference, misconceptions and their causes , 1986 .

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  Ping-Feng Pai,et al.  Support Vector Machines with Simulated Annealing Algorithms in Electricity Load Forecasting , 2005 .

[12]  Enrique López Droguett,et al.  Mathematical formulation and numerical treatment based on transition frequency densities and quadrature methods for non-homogeneous semi-Markov processes , 2009, Reliab. Eng. Syst. Saf..

[13]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[14]  Ping-Feng Pai,et al.  Recurrent Support Vector Machines in Reliability Prediction , 2005, ICNC.

[15]  Ming-Wei Chang,et al.  Leave-One-Out Bounds for Support Vector Regression Model Selection , 2005, Neural Computation.

[16]  Kristin P. Bennett,et al.  A Pattern Search Method for Model Selection of Support Vector Regression , 2002, SDM.

[17]  Chris Chatfield,et al.  Introduction to Statistical Time Series. , 1976 .

[18]  Ping-Feng Pai,et al.  Software reliability forecasting by support vector machines with simulated annealing algorithms , 2006, J. Syst. Softw..

[19]  Junyan Yang,et al.  Application Research of Support Vector Machines in Condition Trend Prediction of Mechanical Equipment , 2005, ISNN.

[20]  A. Roli Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[21]  Ryohei Nakano,et al.  Optimizing Support Vector regression hyperparameters based on cross-validation , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[22]  B. Kowalski,et al.  The parsimony principle applied to multivariate calibration , 1993 .

[23]  G. Meek Mathematical statistics with applications , 1973 .

[24]  M. Farid Golnaraghi,et al.  Prognosis of machine health condition using neuro-fuzzy systems , 2004 .

[25]  Authors' Biographies , 2005 .

[26]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[27]  I. D. Lins E. López Droguett Multiobjective optimization of redundancy allocation in systems with imperfect repairs via ant colony and discrete event simulation , 2008 .

[28]  Elmer E Lewis,et al.  Introduction To Reliability Engineering , 1987 .

[29]  Enrico Zio,et al.  Failure and Reliability Predictions by Infinite Impulse Response Locally Recurrent Neural Networks , 2012 .

[30]  Mehmet Karaköse,et al.  A multi-objective artificial immune algorithm for parameter optimization in support vector machine , 2011, Appl. Soft Comput..

[31]  Ping-Feng Pai,et al.  System reliability forecasting by support vector machines with genetic algorithms , 2006, Math. Comput. Model..

[32]  Kuan-Yu Chen,et al.  Forecasting systems reliability based on support vector regression with genetic algorithms , 2007, Reliab. Eng. Syst. Saf..

[33]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[34]  Enrique López Droguett,et al.  Multiobjective optimization of availability and cost in repairable systems design via genetic algorithms and discrete event simulation , 2009 .

[35]  V. Vapnik,et al.  Bounds on Error Expectation for Support Vector Machines , 2000, Neural Computation.

[36]  Cheng-Hua Wang,et al.  Support vector regression with genetic algorithms in forecasting tourism demand , 2007 .

[37]  Vojislav Kecman,et al.  Support Vector Machines – An Introduction , 2005 .

[38]  Enrique López Droguett,et al.  Redundancy allocation problems considering systems with imperfect repairs using multi-objective genetic algorithms and discrete event simulation , 2011, Simul. Model. Pract. Theory.

[39]  Ratna Babu Chinnam,et al.  A neuro-fuzzy approach for estimating mean residual life in condition-based maintenance systems , 2004 .

[40]  Ping-Feng Pai,et al.  Predicting engine reliability by support vector machines , 2006 .

[41]  Ping-Feng Pai,et al.  Application of Hybrid Learning Neural Fuzzy Systems in Reliability Prediction , 2006, Qual. Reliab. Eng. Int..

[42]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[43]  W. Fuller,et al.  Introduction to Statistical Time Series (2nd ed.) , 1997 .

[44]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[45]  Ahmed Z. Al-Garni,et al.  Artificial neural network application of modeling failure rate for Boeing 737 tires , 2011, Qual. Reliab. Eng. Int..

[46]  Harold E. Ascher Repairable Systems Reliability , 2008 .

[47]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[48]  R. Ganesan,et al.  Multivariable Trend Analysis Using Neural Networks for Intelligent Diagnostics of Rotating Machinery , 1997 .

[49]  Mingjun Wang,et al.  Particle swarm optimization-based support vector machine for forecasting dissolved gases content in power transformer oil , 2009 .

[50]  Robert Ivor John Soft computing and hybrid approaches: An introduction to this special issue , 2003, Inf. Sci..

[51]  Wei-Chiang Hong,et al.  Chaotic particle swarm optimization algorithm in a support vector regression electric load forecasting model , 2009 .

[52]  Loon Ching Tang,et al.  Application of neural networks in forecasting engine systems reliability , 2003, Appl. Soft Comput..

[53]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.