Support vector machine based estimation of remaining useful life: current research status and future trends

Estimation of remaining useful life (RUL) is helpful to manage life cycles of machines and to reduce maintenance cost. Support vector machine (SVM) is a promising algorithm for estimation of RUL because it can easily process small training sets and multi-dimensional data. Many SVM based methods have been proposed to predict RUL of some key components. We did a literature review related to SVM based RUL estimation within a decade. The references reviewed are classified into two categories: improved SVM algorithms and their applications to RUL estimation. The latter category can be further divided into two types: one, to predict the condition state in the future and then build a relationship between state and RUL; two, to establish a direct relationship between current state and RUL. However, SVM is seldom used to track the degradation process and build an accurate relationship between the current health condition state and RUL. Based on the above review and summary, this paper points out that the ability to continually improve SVM, and obtain a novel idea for RUL prediction using SVM will be future works.

[1]  Hu Jun-biao.  Method of Residual Life Prediction for Barrel of Tank Gun Based on LS-SVM , 2010 .

[2]  Bhaskar Saha,et al.  A Bayesian Framework for Remaining Useful Life Estimation , 2007, AAAI Fall Symposium: Artificial Intelligence for Prognostics.

[3]  Michael Buchholz,et al.  Health diagnosis and remaining useful life prognostics of lithium-ion batteries using data-driven methods , 2013 .

[4]  Michael E. Tipping.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[5]  Jianshe Kang,et al.  Gearbox fault prognosis based on CHMM and SVM , 2012, 2012 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering.

[6]  Matthew Daigle,et al.  Model-based prognostics under limited sensing , 2010, 2010 IEEE Aerospace Conference.

[7]  Sung-Soo Hwang,et al.  Integrated approach for diagnostics and prognostics of HP LNG pump based on health state probability estimation , 2012 .

[8]  Michael Pecht,et al.  Prognostics and Health Management , 2013 .

[9]  David He,et al.  Hidden semi-Markov model-based methodology for multi-sensor equipment health diagnosis and prognosis , 2007, Eur. J. Oper. Res..

[10]  Shengfa Yuan,et al.  Fault diagnosis using binary tree and sphere-structured support vector machines , 2012 .

[11]  Bo-Suk Yang,et al.  Machine performance degradation assessment and remaining useful life prediction using proportional hazard model and support vector machine , 2012, WCE 2010.

[12]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[13]  Zhiwen Liu,et al.  A Monotonic Degradation Assessment Index of Rolling Bearings Using Fuzzy Support Vector Data Description and Running Time , 2012, Sensors.

[14]  Shaojiang Dong,et al.  Bearing degradation process prediction based on the PCA and optimized LS-SVM model , 2013 .

[15]  Fanrang Kong,et al.  Fault diagnosis of rotating machinery based on the statistical parameters of wavelet packet paving and a generic support vector regressive classifier , 2013 .

[16]  Zhiqian Xu,et al.  Casing life prediction using Borda and support vector machine methods , 2010 .

[17]  Ivor W. Tsang,et al.  Core Vector Machines: Fast SVM Training on Very Large Data Sets , 2005, J. Mach. Learn. Res..

[18]  Tongmin Jiang,et al.  Support vector machine based on new fuzzy membership , 2012, Proceedings of the IEEE 2012 Prognostics and System Health Management Conference (PHM-2012 Beijing).

[19]  Michael Pecht,et al.  A probabilistic description scheme for rotating machinery health evaluation , 2010 .

[20]  Jianshe Kang,et al.  Gearbox fault diagnosis method based on wavelet packet analysis and support vector machine , 2012, Proceedings of the IEEE 2012 Prognostics and System Health Management Conference (PHM-2012 Beijing).

[21]  Tongmin Jiang,et al.  Life and reliability forecasting of the CSADT using Support Vector Machines , 2010, 2010 Proceedings - Annual Reliability and Maintainability Symposium (RAMS).

[22]  Bo-Suk Yang,et al.  Machine health prognostics using survival probability and support vector machine , 2011, Expert Syst. Appl..

[23]  J. Suykens.  Nonlinear modelling and support vector machines , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[24]  Chia-Hui Huang,et al.  A reduced support vector machine approach for interval regression analysis , 2012, Inf. Sci..

[25]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[26]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[27]  Noureddine Zerhouni,et al.  Remaining useful life estimation based on nonlinear feature reduction and support vector regression , 2013, Eng. Appl. Artif. Intell..

[28]  Enrico Zio,et al.  Fatigue crack growth estimation by relevance vector machine , 2012, Expert Syst. Appl..

[29]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[30]  Dong Wang,et al.  Robust health evaluation of gearbox subject to tooth failure with wavelet decomposition , 2009 .

[31]  Haiyi Zhu,et al.  Assessment of Rotor Degradation in Steam Turbine Using Support Vector Machine , 2009, 2009 Asia-Pacific Power and Energy Engineering Conference.

[32]  Fan Xiao,et al.  SVM with optimized parameters and its application to electronic system fault diagnosis , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[33]  Qiang Miao,et al.  Prognostics of lithium-ion batteries based on relevance vectors and a conditional three-parameter capacity degradation model , 2013 .

[34]  Kai Goebel,et al.  Comparison of prognostic algorithms for estimating remaining useful life of batteries , 2009 .

[35]  Dong-Whan Choi,et al.  Multiple defect diagnostics of gas turbine engine using SVM and RCGA-based ANN algorithms , 2012 .

[36]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[37]  Qiang Miao,et al.  A Prognostics and Health Management Strategy for Complex Electronic Systems , 2012 .

[38]  Johan A. K. Suykens,et al.  Confidence bands for least squares support vector machine classifiers: A regression approach , 2012, Pattern Recognit..

[39]  Jing Zhao,et al.  Twin least squares support vector regression , 2013, Neurocomputing.

[40]  N. Zerhouni,et al.  Fault prognostic of bearings by using support vector data description , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[41]  Fulei Chu,et al.  Application of support vector machine based on pattern spectrum entropy in fault diagnostics of bearings , 2010, 2010 Prognostics and System Health Management Conference.

[42]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[43]  Jinbo Bi,et al.  Dimensionality Reduction via Sparse Support Vector Machines , 2003, J. Mach. Learn. Res..

[44]  Zhixin Yang,et al.  Machine condition monitoring and fault diagnosis based on support vector machine , 2010, 2010 IEEE International Conference on Industrial Engineering and Engineering Management.

[45]  Enrico Zio,et al.  Combining Relevance Vector Machines and exponential regression for bearing residual life estimation , 2012 .

[46]  H. You.  Real-time Lifetime Prediction Method Based on Wavelet Support Vector Regression and Fuzzy c-means Clustering , 2012 .

[47]  Yuan Xiaofang,et al.  Parameter selection of support vector machine for function approximation based on chaos optimization , 2008 .

[48]  Uday Kumar,et al.  Remaining Useful Life Estimation using Time Trajectory Tracking and Support Vector Machines , 2012 .

[49]  Pengcheng Yin,et al.  Life-prediction of accelerated life testing based on support vector machine , 2011, 2011 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering.

[50]  Donghua Zhou,et al.  A degradation path-dependent approach for remaining useful life estimation with an exact and closed-form solution , 2013, Eur. J. Oper. Res..

[51]  Yongsheng Zhu,et al.  Bearing performance degradation assessment based on the rough support vector data description , 2013 .

[52]  Peter W. Tse,et al.  A Relevance Vector Machine-Based Approach with Application to Oil Sand Pump Prognostics , 2013, Sensors.

[53]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[54]  Zhi-Jie Zhou,et al.  Real-time Lifetime Prediction Method Based on Wavelet Support Vector Regression and Fuzzy c -means Clustering: Real-time Lifetime Prediction Method Based on Wavelet Support Vector Regression and Fuzzy c -means Clustering , 2012 .

[55]  Zhongjie Shen,et al.  Remaining Life Predictions of Rolling Bearing Based on Relative Features and Multivariable Support Vector Machine , 2013 .

[56]  Jianbo Yu,et al.  A similarity-based prognostics approach for Remaining Useful Life estimation of engineered systems , 2008, 2008 International Conference on Prognostics and Health Management.

[57]  Zigmund Bluvband,et al.  Remaining useful life estimation for systems with non-trendability behaviour , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[58]  Xunkai Wei,et al.  Analysis and applications of support vector forecasting model based on chaos theory , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[59]  Hatice Gunes,et al.  Output-associative RVM regression for dimensional and continuous emotion prediction , 2011, Face and Gesture 2011.

[60]  Kris De Brabanter.  Least Squares Support Vector Regression with Applications to Large-Scale Data: a Statistical Approach (Kleinste kwadraten support vector regressie met toepassingen op grote datasets: een statistische benadering) , 2011 .

[61]  Wenbin Wang,et al.  A model for residual life prediction based on Brownian motion with an adaptive drift , 2011, Microelectron. Reliab..

[62]  Joseph Mathew,et al.  Bearing fault prognosis based on health state probability estimation , 2012, Expert Syst. Appl..

[63]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[64]  Wenbin Wang,et al.  An approximate algorithm for prognostic modelling using condition monitoring information , 2011, Eur. J. Oper. Res..

[65]  Donghua Zhou,et al.  Remaining useful life prediction using a stochastic filtering model with multi-sensor information fusion , 2011, 2011 Prognostics and System Health Managment Confernece.

[66]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Zhigang Zeng,et al.  Advances in neural networks , 2015, Neurocomputing.

[68]  Maja Pantic,et al.  Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics , 2007, ICCV-HCI.

[69]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[70]  Cory J. Butz,et al.  Rough support vector regression , 2010, Eur. J. Oper. Res..

[71]  Joseph Mathew,et al.  Machine Prognostics Based on Health State Estimation Using SVM , 2008, WCE 2009.

[72]  Jay Lee,et al.  Methodology and framework for predicting rolling element helicopter bearing failure , 2011, 2011 IEEE Conference on Prognostics and Health Management.

[73]  Tian Xuemin.  Nonlinear system fault prognosis based on SVM and Kalman predictor , 2009 .

[74]  Ouahab Kadri,et al.  Fault diagnosis of rotary kiln using SVM and binary ACO , 2012 .

[75]  Junyan Yang,et al.  Application Research of Support Vector Machines in Condition Trend Prediction of Mechanical Equipment , 2005, ISNN.

[76]  Yew-Soon Ong,et al.  Advances in Natural Computation, First International Conference, ICNC 2005, Changsha, China, August 27-29, 2005, Proceedings, Part I , 2005, ICNC.

[77]  Cheng-Lung Huang,et al.  A distributed PSO-SVM hybrid system with feature selection and parameter optimization , 2008, Appl. Soft Comput..

[78]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[79]  Khanh Le Son,et al.  Remaining useful life estimation on the non-homogenous gamma with noise deterioration based on Gibbs filtering: A case study , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[80]  M.G. Pecht,et al.  Prognostics and health management of electronics , 2008, IEEE Transactions on Components and Packaging Technologies.

[81]  Vadlamani Ravi,et al.  Support vector regression based hybrid rule extraction methods for forecasting , 2010, Expert Syst. Appl..

[82]  Leon N. Cooper,et al.  Training Data Selection for Support Vector Machines , 2005, ICNC.

[83]  Enrico Zio,et al.  Nuclear Power Plant Components Condition Monitoring by Probabilistic Support Vector Machine , 2013 .

[84]  Lei Guo,et al.  Robust bearing performance degradation assessment method based on improved wavelet packet–support vector data description , 2009 .

[85]  Hongbing Xu,et al.  Parameter selection for Gaussian radial basis function in support vector machine classification , 2012, 2012 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering.

[86]  Jay Lee,et al.  A review on prognostics and health monitoring of Li-ion battery , 2011 .

[87]  Chen Li,et al.  Condition Residual Life Evaluation by Support Vector Machine , 2007, 2007 8th International Conference on Electronic Measurement and Instruments.

[88]  Ming Jian Zuo,et al.  An LSSVR-based algorithm for online system condition prognostics , 2012, Expert Syst. Appl..

[89]  Thomas Hofmann,et al.  Hidden Markov Support Vector Machines , 2003, ICML.

[90]  Sabine Van Huffel,et al.  Support vector machines for survival analysis , 2007 .

[91]  William J. Kolarik,et al.  Multivariate performance reliability prediction in real-time , 2001, Reliab. Eng. Syst. Saf..

[92]  Peter W. Tse,et al.  Support vector data description for fusion of multiple health indicators for enhancing gearbox fault diagnosis and prognosis , 2011 .

[93]  Zhengjia He,et al.  Research on bearing life prediction based on support vector machine and its application , 2011 .

[94]  Zhao Jianmin,et al.  Remaining useful life prediction based on nonlinear state space model , 2011, 2011 Prognostics and System Health Managment Confernece.

[95]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[96]  Bo-Suk Yang,et al.  Application of relevance vector machine and logistic regression for machine degradation assessment , 2010 .

[97]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Evolutionary tuning of SVM parameter values in multiclass problems , 2008, Neurocomputing.