Improved Knowledge Mining with the Multimethod Approach

Automatic induction from examples has a long tradition and represents an important technique used in data mining. Trough induction a method builds a hypothesis to explain observed facts. Many knowledge extraction methods have been developed, unfortunately each has advantages and limitations and in general there is no such method that would outperform all others on all problems. One of the possible approaches to overcome this problem is to combine different methods in one hybrid method. Recent research is mainly focused on a specific combination of methods, contrary, multimethod approach combines different induction methods in an unique manner – it applies different methods on the same knowledge model in no predefined order where each method may contain inherent limitations with the expectation that the combined multiple methods may produce better results. In this paper we present the overview of an idea, concrete integration and possible improvements.

[1]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[2]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[3]  Peter Kokol,et al.  Finding boundary subjects for medical decision support with support vector machines , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[4]  Sebastian Thrun,et al.  Learning to Learn , 1998, Springer US.

[5]  Saso Dzeroski,et al.  Combining Multiple Models with Meta Decision Trees , 2000, PKDD.

[6]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[7]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[8]  Yanxi Liu,et al.  SVM decision boundary based discriminative subspace induction , 2005, Pattern Recognit..

[9]  Stefan Wermter,et al.  The Extraction and Comparison of Knowledge from Local Function Networks , 2001, Int. J. Comput. Intell. Appl..

[10]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.