Decision Tree Induction using Adaptive FSA

This paper introduces a new algorithm for the induction of decision trees, based on adaptive techniques. One of the main feature of this algorithm is the application of automata theory to formalize the problem of decision tree induction and the use of a hybrid approach, which integrates both syntactical and statistical strategies. Some experimental results are also presented indicating that the adaptive approach is useful in the construction of ecien t learning algorithms.

[1]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[2]  D. Wolpert.  On Overfitting Avoidance as Bias , 1993 .

[3]  A.,et al.  INCREMENTAL GRAMMATICAL INFERENCE FROM POSITIVE ANDNEGATIVE DATA USING UNBIASED FINITE STATE AUTOMATA , 1994 .

[4]  Andre Riyuiti Hirakawa,et al.  ADAPTIVE AUTOMATA FOR INDEPENDENT AUTONOMOUS NAVIGATION IN UNKNOWN ENVIRONMENT , 2000 .

[5]  Pedro M. Domingos,et al.  Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[6]  J. R. Quinlan.  Learning With Continuous Classes , 1992 .

[7]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[8]  João José Neto,et al.  Adaptive Automata for Syntax Learning , 1998 .

[9]  João José Neto,et al.  Compiler construction – a pedagogical approach , 2003 .

[10]  Eibe Frank,et al.  Pruning Decision Trees and Lists , 2000 .

[11]  Colin de la Higuera,et al.  Current Trends in Grammatical Inference , 2000, SSPR/SPR.

[12]  James Kelly,et al.  AutoClass: A Bayesian Classification System , 1993, ML.

[13]  J. Ross Quinlan,et al.  Learning decision tree classifiers , 1996, CSUR.

[14]  Andre Riyuiti Hirakawa,et al.  An adaptive alternative for syntactic pattern recognition , 2002 .

[15]  Kevin Baker,et al.  Classification of radar returns from the ionosphere using neural networks , 1989 .

[16]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[17]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[18]  I. W. Evett,et al.  Rule induction in forensic science , 1989 .

[19]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[20]  Belur V. Dasarathy,et al.  Nosing Around the Neighborhood: A New System Structure and Classification Rule for Recognition in Partially Exposed Environments , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[22]  Malcolm R. Forster,et al.  Simplicity, Inference and Modelling: The new science of simplicity , 2002 .

[23]  G. Gates.  The Reduced Nearest Neighbor Rule , 1998 .

[24]  Yong Wang,et al.  Using Model Trees for Classification , 1998, Machine Learning.

[25]  João José Neto.  Solving Complex Problems Efficiently with Adaptive Automata , 2000, CIAA.

[26]  Cullen Schaffer,et al.  A Conservation Law for Generalization Performance , 1994, ICML.

[27]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[28]  Usama M. Fayyad,et al.  Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning , 1993, IJCAI.

[29]  João José Neto,et al.  A stochastic musical composer based on adaptive algorithms , 2004 .

[30]  Léopold Simar,et al.  Computer Intensive Methods in Statistics , 1994 .

[31]  Zhi-Hua Zhou,et al.  Hybrid decision tree , 2002, Knowl. Based Syst..

[32]  Paul E. Utgoff,et al.  Decision Tree Induction Based on Efficient Tree Restructuring , 1997, Machine Learning.

[33]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[34]  Sankar K. Pal,et al.  Pattern Recognition: From Classical to Modern Approaches , 2001 .

[35]  John Mingers,et al.  Expert Systems—Rule Induction with Statistical Data , 1987 .