In-Situ Learning in Multi-net Systems

Multiple classifier systems based on neural networks can give improved generalisation performance as compared with single classifier systems. We examine collaboration in multi-net systems through in-situ learning, exploring how generalisation can be improved through the simultaneous learning in networks and their combination. We present two in-situ trained systems; first, one based upon the simple ensemble, combining supervised networks in parallel, and second, a combination of unsupervised and supervised networks in sequence. Results for these are compared with existing approaches, demonstrating that in-situ trained systems perform better than similar pre-trained systems.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Derek Partridge,et al.  Multiple Classifier Systems: Software Engineered, Automatically Modular Leading to a Taxonomic Overview , 2002, Pattern Analysis & Applications.

[3]  Amanda J. C. Sharkey,et al.  Boosting Using Neural Networks , 1999 .

[4]  Matthew C. Casey.  Integrated learning in multi-net systems , 2004 .

[5]  Sebastian Thrun,et al.  The MONK''s Problems-A Performance Comparison of Different Learning Algorithms, CMU-CS-91-197, Sch , 1991 .

[6]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Mohamed S. Kamel,et al.  An adaptive training algorithm for an ensemble of networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[9]  Amanda J. C. Sharkey,et al.  Mixtures of X , 1999 .

[10]  Patrick Gallinari,et al.  A Framework for the Cooperation of Learning Algorithms , 1990, NIPS.

[11]  Amanda J. C. Sharkey,et al.  Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[12]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[13]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[14]  Amanda J. C. Sharkey,et al.  Multi-Net Systems , 1999 .

[15]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[16]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.