A Local Learning Framework for Pattern Classification

The paper presents a local learning framework for pattern classification by partitioning a pattern space into different overlapped subsets and combining decisions in a local space. In contrast to designing a classifier on the global space, the advantage of the local learning framework is to reduce the complexity of component classifier which helps to enhance generalization. Our experimental results on handwritten digit database (CENPARMI and MNIST) are comparable with current best classifiers, which indicates that the proposed method is effective for classifying real world patterns. In addition, we have analyzed the characteristics of overlapped subsets and discovered that a simple average of the outputs of component classifiers achieves the best performance by optimizing the weights. Keywords— Local learning, classifier complexity, pattern classification, generalization

[1]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[2]  Ching Y. Suen,et al.  Structural classification and relaxation matching of totally unconstrained handwritten zip-code numbers , 1988, Pattern Recognit..

[3]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[4]  이성환,et al.  유전자 알고리즘과 결합된 다층 역전파 신경망을 이용한 무제약 필기체 숫자의 오프라인 인식 ( Off-Line Recognition of Unconstrained Handwritten Digits Using Multilayer Backpropagation Neural Network Combined With Genetic Algorithm ) , 1994 .

[5]  Léon Bottou,et al.  Local Learning Algorithms , 1992, Neural Computation.

[6]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[7]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[10]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[11]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[12]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[13]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.

[14]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[15]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[16]  Meng Shi,et al.  Handwritten numeral recognition using gradient and curvature of gray scale image , 2002, Pattern Recognit..

[17]  Ponnuthurai N. Suganthan,et al.  On the performance of the HONG network for pattern classification , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[18]  Tetsushi Wakabayashi,et al.  Improvement of handwritten Japanese character recognition using weighted direction code histogram , 1997, Pattern Recognit..

[19]  Ching Y. Suen,et al.  A generalized knowledge-based system for the recognition of unconstrained handwritten numerals , 1990, IEEE Trans. Syst. Man Cybern..

[20]  Ponnuthurai N. Suganthan Hierarchical overlapped SOM's for pattern classification , 1999, IEEE Trans. Neural Networks.

[21]  Ching Y. Suen,et al.  Contour Tracing and parametric Approximations for Digitized Patterns , 1989, Computer Vision and Shape Recognition.