Learning performance of kernel SVMC with Markov chain samples

Markov sampling is a natural sampling mechanism extensively used in applications, especially in the study of time sequence or content-based pattern recognition or biological sequence analysis. In this paper we generalize the study on the learning performance of support vector machine classification (SVMC) algorithm with Markov chain samples based on linear prediction models to the case of Gaussian kernel. We present the numerical studies on the learning performance of Gaussian kernel SVMC algorithm based on Markov chain samples for benchmark repository.

[1]  Zongben Xu,et al.  The learning performance of support vector machine classification based on Markov sampling , 2013, Science China Information Sciences.

[2]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[3]  Bin Yu.  RATES OF CONVERGENCE FOR EMPIRICAL PROCESSES OF STATIONARY MIXING SEQUENCES , 1994 .

[4]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[5]  Lipo Wang,et al.  Data Mining With Computational Intelligence , 2006, IEEE Transactions on Neural Networks.

[6]  David Gamarnik.  Extension of the PAC framework to finite and countable Markov chains , 2003, IEEE Trans. Inf. Theory.

[7]  Yuan Yan Tang,et al.  Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[8]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[9]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[10]  S. Smale,et al.  ONLINE LEARNING WITH MARKOV SAMPLING , 2009 .

[11]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Don R. Hush,et al.  Learning from dependent observations , 2007, J. Multivar. Anal..

[13]  Bin Zou,et al.  Generalization performance of least-square regularized regression algorithm with Markov chain samples , 2012 .

[14]  David Burshtein,et al.  Support Vector Machine Training for Improved Hidden Markov Modeling , 2008, IEEE Transactions on Signal Processing.

[15]  Marimuthu Palaniswami,et al.  Support Vector Machines for Automated Recognition of Obstructive Sleep Apnea Syndrome From ECG Recordings , 2009, IEEE Transactions on Information Technology in Biomedicine.

[16]  Mathukumalli Vidyasagar,et al.  Learning and Generalization: With Applications to Neural Networks , 2002 .

[17]  Zongben Xu,et al.  Generalization bounds of ERM algorithm with V-geometrically Ergodic Markov chains , 2012, Adv. Comput. Math..

[18]  E. Masry,et al.  Minimum complexity regression estimation with weakly dependent observations , 1996, Proceedings of 1994 Workshop on Information Theory and Statistics.

[19]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[20]  Zongben Xu,et al.  Learning from uniformly ergodic Markov chains , 2009, J. Complex..

[21]  Zongben Xu,et al.  The generalization performance of ERM algorithm with strongly mixing observations , 2009, Machine Learning.

[22]  Yiming Ying,et al.  Support Vector Machine Soft Margin Classifiers: Error Analysis , 2004, J. Mach. Learn. Res..

[23]  R N Curnow.  The use of Markov chain models in studying the evolution of the proteins. , 1988, Journal of theoretical biology.