Flexible Support Vector Regression and Its Application to Fault Detection

Abstract Hyper-parameters, which determine the ability of learning and generalization for support vector regression (SVR), are usually fixed during training. Thus when SVR is applied to complex system modeling, this parameters-fixed strategy leaves the SVR in a dilemma of selecting rigorous or slack parameters due to complicated distributions of sample dataset. Therefore in this paper we proposed a flexible support vector regression (F-SVR) in which parameters are adaptive to sample dataset distributions during training. The method F-SVR divides the training sample dataset into several domains according to the distribution complexity, and generates a different parameter set for each domain. The efficacy of the proposed method is validated on an artificial dataset, where F-SVR yields better generalization ability than conventional SVR methods while maintaining good learning ability. Finally, we also apply F-SVR successfully to practical fault detection of a high frequency power supply.

[1]  V. Vapnik,et al.  Bounds on Error Expectation for Support Vector Machines , 2000, Neural Computation.

[2]  Bruno Apolloni,et al.  Relevance regression learning with support vector machines , 2010 .

[3]  Dong-Hua Zhou,et al.  Fault Diagnosis Techniques for Dynamic Systems: Fault Diagnosis Techniques for Dynamic Systems , 2009 .

[4]  Furong Gao,et al.  Batch process monitoring based on support vector data description method , 2011 .

[5]  Bin Jiang,et al.  Support Vector Machine Based on Nodes Refined Decision Directed Acyclic Graph and Its Application to Fault Diagnosis: Support Vector Machine Based on Nodes Refined Decision Directed Acyclic Graph and Its Application to Fault Diagnosis , 2010 .

[6]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[7]  Kenneth A. Loparo,et al.  A neural-network approach to fault detection and diagnosis in industrial processes , 1997, IEEE Trans. Control. Syst. Technol..

[8]  J.T. Kwok,et al.  Linear Dependency betweenand the Input Noise in -Support Vector Regression , 2001 .

[9]  S. Krishnan,et al.  Knowledge-Based Green's Kernel for Support Vector Regression , 2010 .

[10]  Pei-Yi Hao,et al.  New support vector algorithms with parametric insensitive/margin model , 2010, Neural Networks.

[11]  Zhou Dong-Hua,et al.  Fault Diagnosis Techniques for Dynamic Systems: Fault Diagnosis Techniques for Dynamic Systems , 2009 .

[12]  Ying-wei Zhang,et al.  Complex process quality prediction using modified kernel partial least squares , 2010 .

[13]  T. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2005, DAC 2003.

[14]  D. Thukaram,et al.  Artificial neural network and support vector Machine approach for locating faults in radial distribution systems , 2005, IEEE Transactions on Power Delivery.

[15]  Bernhard Schölkopf,et al.  Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[16]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[17]  Vladimir Cherkassky,et al.  Model complexity control for regression using VC generalization bounds , 1999, IEEE Trans. Neural Networks.

[18]  Jiang Bin,et al.  Support Vector Machine Based on Nodes Refined Decision Directed Acyclic Graph and Its Application to Fault Diagnosis , 2010 .

[19]  Ming-Wei Chang,et al.  Leave-One-Out Bounds for Support Vector Regression Model Selection , 2005, Neural Computation.

[20]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[21]  Hong Yan,et al.  Framelet Kernels With Applications to Support Vector Regression and Regularization Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Bin Jiang,et al.  Candidate working set strategy based SMO algorithm in support vector machine , 2009, Inf. Process. Manag..

[23]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[24]  L. Buydens,et al.  Determination of optimal support vector regression parameters by genetic algorithms and simplex optimization , 2005 .

[25]  Hong Zhou,et al.  Decentralized Fault Diagnosis of Large-Scale Processes Using Multiblock Kernel Partial Least Squares , 2010, IEEE Transactions on Industrial Informatics.

[26]  Yoshua Bengio,et al.  Model Selection for Small Sample Regression , 2002, Machine Learning.

[27]  Yue Tian,et al.  A new fuzzy identification approach using support vector regression and particle swarm optimization algorithm , 2009, 2009 ISECS International Colloquium on Computing, Communication, Control, and Management.

[28]  Wei‐Chiang Hong.  A hybrid support vector machine regression for exchange rate prediction , 2006 .

[29]  Marcel Staroswiecki,et al.  Fault Accommodation for Nonlinear Dynamic Systems , 2006, IEEE Transactions on Automatic Control.

[30]  Zhiming Li,et al.  Modeling and Monitoring of Dynamic Processes , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[31]  J. Bunch,et al.  A computational method for the indefinite quadratic programming problem , 1980 .

[32]  Michael R. Lyu,et al.  Localized support vector regression for time series prediction , 2009, Neurocomputing.