The strong convergence of visual classification method and its applications

Abstract Visual classification method has been proposed as a learning strategy for pattern classification problem. In this paper, we show the strong convergence property of this method. In particular, the method is shown to converge to the Bayesian estimator, i.e., the learning error of the method is convergent to the posterior expected minimal value. The performance of the method has also been theoretically evaluated to comply with the human visual sensation and perception principle. The method is successfully used to some practical remote sensing and disease diagnosis applications. The experimental results all verify the validity and effectiveness of the theoretical conclusions.

[1]  Deyu Meng,et al.  A New Approach for Classification: Visual Simulation Point of View , 2005, ISNN.

[2]  Qinghua Hu,et al.  An efficient gene selection technique for cancer recognition based on neighborhood mutual information , 2010, Int. J. Mach. Learn. Cybern..

[3]  Xi-Zhao Wang,et al.  Improving Generalization of Fuzzy IF--THEN Rules by Maximizing Fuzzy Entropy , 2009, IEEE Transactions on Fuzzy Systems.

[4]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[5]  C. L. Philip Chen,et al.  Adaptive least squares support vector machines filter for hand tremor canceling in microsurgery , 2011, Int. J. Mach. Learn. Cybern..

[6]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[7]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[8]  Felix E. Browder,et al.  The One-Dimensional Heat Equation: Preface , 1984 .

[9]  Yoshua Bengio,et al.  No Unbiased Estimator of the Variance of K-Fold Cross-Validation , 2003, J. Mach. Learn. Res..

[10]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[11]  Yi-Chung Hu,et al.  A PROMETHEE-based classification method using concordance and discordance relations and its application to bankruptcy prediction , 2011, Inf. Sci..

[12]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[13]  Olcay Taner Yildiz,et al.  Model selection in omnivariate decision trees using Structural Risk Minimization , 2011, Inf. Sci..

[14]  Xizhao Wang,et al.  Induction of multiple fuzzy decision trees based on rough set technique , 2008, Inf. Sci..

[15]  Ratna Babu Chinnam,et al.  mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification , 2011, Inf. Sci..

[16]  Rui Xia,et al.  Ensemble of feature sets and classification algorithms for sentiment classification , 2011, Inf. Sci..

[17]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[18]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[19]  Deyu Meng,et al.  Fast and Efficient Strategies for Model Selection of Gaussian Support Vector Machine , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Matthias Baumgarten,et al.  Optimal model selection for posture recognition in home-based healthcare , 2011, Int. J. Mach. Learn. Cybern..

[21]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[22]  K. Kreutz-Delgado,et al.  A grid algorithm for autonomous star identification , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[23]  José Torres-Jiménez,et al.  New bounds for binary covering arrays using simulated annealing , 2012, Inf. Sci..

[24]  Chang Wook Ahn,et al.  Entropy-based efficiency enhancement techniques for evolutionary algorithms , 2012, Inf. Sci..

[25]  S. Coren,et al.  In Sensation and perception , 1979 .

[26]  Yee Leung,et al.  Clustering by Scale-Space Filtering , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  David G. Stork,et al.  Pattern Classification , 1973 .