A multi-objective artificial immune algorithm for parameter optimization in support vector machine

Support vector machine (SVM) is a classification method based on the structured risk minimization principle. Penalize, C; and kernel, @s parameters of SVM must be carefully selected in establishing an efficient SVM model. These parameters are selected by trial and error or man's experience. Artificial immune system (AIS) can be defined as a soft computing method inspired by theoretical immune system in order to solve science and engineering problems. A multi-objective artificial immune algorithm has been used to optimize the kernel and penalize parameters of SVM in this paper. In training stage of SVM, multiple solutions are found by using multi-objective artificial immune algorithm and then these parameters are evaluated in test stage. The proposed algorithm is applied to fault diagnosis of induction motors and anomaly detection problems and successful results are obtained.

[1]  José Luis Rojo-Álvarez,et al.  Fuzzy sigmoid kernel for support vector classifiers , 2004, Neurocomputing.

[2]  Q. Henry Wu,et al.  Leave one support vector out cross validation for fast estimation of generalization errors , 2004, Pattern Recognit..

[3]  Xiao Zhi Gao,et al.  Soft computing methods in motor fault diagnosis , 2001, Appl. Soft Comput..

[4]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[5]  Alan S. Perelson,et al.  Self-nonself discrimination in a computer , 1994, Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy.

[6]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[7]  D. Devaraj,et al.  Artificial neural network approach for fault detection in rotary system , 2008, Appl. Soft Comput..

[8]  M. E. H. Benbouzid,et al.  What Stator Current Processing Based Technique to Use for Induction Motor Rotor Faults Diagnosis , 2002, IEEE Power Engineering Review.

[9]  Sven F. Crone,et al.  Genetic Algorithms for Support Vector Machine Model Selection , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[10]  Bo Jin,et al.  Support Vector Machine with the Fuzzy Hybrid Kernel for Protein Subcellular Localization Classification , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[11]  Mo-Yuen Chow,et al.  Multiple Discriminant Analysis and Neural-Network-Based Monolith and Partition Fault-Detection Schemes for Broken Rotor Bar in Induction Motors , 2006, IEEE Transactions on Industrial Electronics.

[12]  Jonathan Timmis,et al.  Artificial immune systems - a new computational intelligence paradigm , 2002 .

[13]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[14]  Paul S. Bradley,et al.  Feature Selection via Mathematical Programming , 1997, INFORMS J. Comput..

[15]  Sheng-Wu Xiong,et al.  Fuzzy support vector machines based on FCM clustering , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[16]  Fiorenzo Filippetti,et al.  Recent developments of induction motor drives fault diagnosis using AI techniques , 2000, IEEE Trans. Ind. Electron..

[17]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[18]  Sheng-Fa Yuan,et al.  Fault diagnosis based on support vector machines with parameter optimisation by artificial immunisation algorithm , 2007 .

[19]  H.A. Toliyat,et al.  Pattern recognition-a technique for induction machines rotor fault detection "eccentricity and broken bar fault" , 2001, Conference Record of the 2001 IEEE Industry Applications Conference. 36th IAS Annual Meeting (Cat. No.01CH37248).

[20]  Bo-Suk Yang,et al.  Combination of independent component analysis and support vector machines for intelligent faults diagnosis of induction motors , 2007, Expert Syst. Appl..

[21]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[22]  Chun-De Yang,et al.  Using Immune Algorithm to Optimize Anomaly Detection Based on SVM , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[23]  S. Sathiya Keerthi,et al.  Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms , 2002, IEEE Trans. Neural Networks.

[24]  Alan S. Perelson,et al.  Using Genetic Algorithms to Explore Pattern Recognition in the Immune System , 1993, Evolutionary Computation.

[25]  M. Karakose,et al.  A Simple and Efficient Method for Fault Diagnosis Using Time Series Data Mining , 2007, 2007 IEEE International Electric Machines & Drives Conference.

[26]  Jonathan Timmis,et al.  Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[27]  Hyun Joon Shin,et al.  One-class support vector machines - an application in machine fault detection and classification , 2005, Comput. Ind. Eng..

[29]  Lei Wang,et al.  Research on 3D Modeling for Head MRI Image Based on Immune Sphere-Shaped Support Vector Machine , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[31]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[32]  Chih-Hung Wu,et al.  A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy , 2007, Expert Syst. Appl..

[33]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[34]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  O. Ondel,et al.  A method to detect broken bars in induction machine using pattern recognition techniques , 2006, IEEE Transactions on Industry Applications.