Error bounds of multi-graph regularized semi-supervised classification

In this paper, we investigate the generalization performance of the multi-graph regularized semi-supervised classification algorithm associated with the hinge loss. We provide estimates for the excess misclassification error of multi-graph regularized classifiers and show the relations between the generalization performance and the structural invariants of data graphs. Experiments performed on real database demonstrate the effectiveness of our theoretical analysis.

[1]  Yiming Ying,et al.  Multi-kernel regularized classifiers , 2007, J. Complex..

[2]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[3]  Felipe Cucker,et al.  Learning Theory: An Approximation Theory Viewpoint (Cambridge Monographs on Applied & Computational Mathematics) , 2007 .

[4]  Chi-Hoon Lee,et al.  Clustering high dimensional data: A graph-based relaxed optimization approach , 2008, Inf. Sci..

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Cory J. Butz,et al.  Rough set based 1-v-1 and 1-v-r approaches to support vector machine multi-classification , 2007, Inf. Sci..

[7]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[8]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[9]  Ran El-Yaniv,et al.  Stable Transductive Learning , 2006, COLT.

[10]  Irena Koprinska,et al.  Learning to classify e-mail , 2007, Inf. Sci..

[11]  Felipe Cucker,et al.  Learning Theory: An Approximation Theory Viewpoint: Index , 2007 .

[12]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[13]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[14]  J. Siemons.  Surveys in combinatorics, 1989 , 1989 .

[15]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[16]  Felipe Cucker,et al.  On the mathematical foundations of learning , 2001 .

[17]  Larry Wasserman,et al.  Challenges in Statistical Machine Learning , 2006 .

[18]  Charles A. Micchelli,et al.  Learning the Kernel Function via Regularization , 2005, J. Mach. Learn. Res..

[19]  Tong Zhang,et al.  Graph-Based Semi-Supervised Learning and Spectral Kernel Design , 2008, IEEE Transactions on Information Theory.

[20]  Mikhail Belkin,et al.  Regularization and Semi-supervised Learning on Large Graphs , 2004, COLT.

[21]  Tong Zhang,et al.  On the Effectiveness of Laplacian Normalization for Graph Semi-supervised Learning , 2007, J. Mach. Learn. Res..

[22]  Mikhail Belkin,et al.  Semi-Supervised Learning on Riemannian Manifolds , 2004, Machine Learning.

[23]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[24]  Yiming Ying,et al.  Support Vector Machine Soft Margin Classifiers: Error Analysis , 2004, J. Mach. Learn. Res..

[25]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .