One-class support vector machines with a bias constraint and its application in system reliability prediction

Abstract Support vector machine (SVM) methods are widely used for classification and regression analysis. In many engineering applications, only one class of data is available, and then one-class SVM methods are employed. In reliability applications, the one-class data may be failure data since the data are recorded during reliability experiments when only failures occur. Different from the problems handled by existing one-class SVM methods, there is a bias constraint in the SVM model in this work and the constraint comes from the probability of failure estimated from the failure data. In this study, a new one-class SVM regression method is proposed to accommodate the bias constraint. The one class of failure data is maximally separated from a hypersphere whose radius is determined by the known probability of failure. The proposed SVM method generates regression models that directly link the states of failure modes with design variables, and this makes it possible to obtain the joint probability density of all the component states of an engineering system, resulting in a more accurate prediction of system reliability during the design stage. Three examples are given to demonstrate the effectiveness of the new one-class SVM method.

[1]  Enrique Frías-Martínez,et al.  Support vector machines versus multi-layer perceptrons for efficient off-line signature recognition , 2006, Eng. Appl. Artif. Intell..

[2]  A. Sudjianto,et al.  First-order saddlepoint approximation for reliability analysis , 2004 .

[3]  Sankaran Mahadevan,et al.  Efficient Kriging surrogate modeling approach for system reliability analysis , 2017, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[4]  Xiaoping Du,et al.  Saddlepoint approximation reliability method for quadratic functions in normal variables , 2018 .

[5]  Xiaoping Du,et al.  Integration of Statistics- and Physics-Based Methods – A Feasibility Study on Accurate System Reliability Prediction , 2018 .

[6]  李洪双,et al.  SUPPORT VECTOR MACHINE FOR STRUCTURAL RELIABILITY ANALYSIS , 2006 .

[7]  M. Rosenblatt Remarks on a Multivariate Transformation , 1952 .

[8]  Sirish L. Shah,et al.  Fault detection and diagnosis in process data using one-class support vector machines , 2009 .

[9]  Jerald F. Lawless,et al.  Statistical Methods in Reliability , 1983 .

[10]  Yan-Gang Zhao,et al.  A general procedure for first/second-order reliabilitymethod (FORM/SORM) , 1999 .

[11]  Enrico Zio,et al.  Failure and reliability prediction by support vector machines regression of time series data , 2011, Reliab. Eng. Syst. Saf..

[12]  Stephen Kwek,et al.  Applying Support Vector Machines to Imbalanced Datasets , 2004, ECML.

[13]  Marvin Rausand,et al.  System Reliability Theory: Models, Statistical Methods, and Applications , 2003 .

[14]  Zhen Hu,et al.  An exploratory study for predicting component reliability with new load conditions , 2018, Frontiers of Mechanical Engineering.

[15]  Yong Shi,et al.  Recent advances on support vector machines research , 2012 .

[16]  Yong Cang Zhang High-order reliability bounds for series systems and application to structural systems , 1993 .

[17]  Thomas N. Duening,et al.  Business Process Outsourcing: The Competitive Advantage , 2004 .

[18]  W. Nelson Statistical Methods for Reliability Data , 1998 .

[19]  Xiaoping Du,et al.  System reliability prediction with shared load and unknown component design details , 2017, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[20]  Guangyuan Fu,et al.  Data-driven fault prediction and anomaly measurement for complex systems using support vector probability density estimation , 2018, Eng. Appl. Artif. Intell..

[21]  Sankaran Mahadevan,et al.  First-Order Approximation Methods in Reliability-Based Design Optimization , 2005 .

[22]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[23]  Robert C. Green,et al.  Intelligent state space pruning for Monte Carlo simulation with applications in composite power system reliability , 2013, Eng. Appl. Artif. Intell..

[24]  Xiaoping Du,et al.  System Reliability Analysis With Dependent Component Failures During Early Design Stage—A Feasibility Study , 2016 .

[25]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[26]  Thomas A. Cruse,et al.  Reliability-Based Mechanical Design , 1997 .

[27]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[28]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[29]  Konstantinos C. Gryllias,et al.  A Support Vector Machine approach based on physical model training for rolling element bearing fault detection in industrial environments , 2012, Eng. Appl. Artif. Intell..

[30]  Xinjun Peng,et al.  TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition , 2011, Pattern Recognit..

[31]  Sean Hanna,et al.  Inductive machine learning of optimal modular structures: Estimating solutions using support vector machines , 2007, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[32]  Jong-Myon Kim,et al.  Fire flame detection in video sequences using multi-stage pattern recognition techniques , 2012, Eng. Appl. Artif. Intell..

[33]  Long-Sheng Chen,et al.  Using SVM based method for equipment fault detection in a thermal power plant , 2011, Comput. Ind..

[34]  Paulo Cortez,et al.  Data Mining with Neural Networks and Support Vector Machines Using the R/rminer Tool , 2010, ICDM.