A Fast Memory-Efficient Incremental Decision Tree Algorithm in its Application to Mobile Robot Navigation

Incremental learning is vital in robots that need to adapt rapidly and respond appropriately to new or unexpected events that occur in its vicinity. This paper describes a novel incremental learning method here demonstrated in its reactive navigation of a mobile robot. The approach records acquired feature vectors in a compact statistical representation we term a frequency table that is purposely designed to contain sufficient information for the generation of a conventional C4.5 decision tree. During learning, further feature vectors can be added in an incremental manner to the frequency table which can then be used to generate new decision trees as required. A major advantage compared with previous incremental decision tree approaches that keep feature vectors in the tree itself, is that the frequency table's memory requirement is fixed and known a priori. Experimental results in the practical application of the method to the real-time navigation of a mobile robot through previously uncharted environments show that the calculation time is typically an order of magnitude less than that of an incremental generation of an ITI decision tree

[1]  Paul E. Utgoff,et al.  Decision Tree Induction Based on Efficient Tree Restructuring , 1997, Machine Learning.

[2]  J. Ross Quinlan,et al.  Decision trees and decision-making , 1990, IEEE Trans. Syst. Man Cybern..

[3]  Haji Izham Haji Zainal Abidin,et al.  The fuzzy decision tree application to a power system problem , 2004 .

[4]  Yohanan Arzi,et al.  Operating an FMC by a decision-tree-based adaptive production control system , 2000 .

[5]  Paul E. Utgoff,et al.  ID5: An Incremental ID3 , 1987, ML.

[6]  Kevin P. Murphy,et al.  A Survey of POMDP Solution Techniques , 2000 .

[7]  Ian P. W. Sillitoe,et al.  Becoming incrementally reactive: on-line learning of an evolving decision tree array for robot navigation , 1999, Robotica.

[8]  Chao-Ton Su,et al.  Intelligent scheduling controller for shop floor control systems: A hybrid genetic algorithm/decision tree learning approach , 2003 .

[9]  Paul E. Utgoff,et al.  Improved Training Via Incremental Learning , 1989, ML.

[10]  G. H. Shah Hamzei,et al.  Implementation of an Intelligent Control System Using Fuzzy ITI , 2000, Neural Computing & Applications.

[11]  Stefano Caselli,et al.  Experiments in robust bistatic sonar object classification for local environment mapping , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[13]  Frederic Maire,et al.  Automatic State Construction using Decision Tree for Reinforcement Learning Agents , 2004 .

[14]  J. R. Quinlan,et al.  Data Mining Tools See5 and C5.0 , 2004 .

[15]  Deborah R. Carvalho,et al.  A hybrid decision tree/genetic algorithm method for data mining , 2004, Inf. Sci..

[16]  A. Vlahou,et al.  Diagnosis of Ovarian Cancer Using Decision Tree Classification of Mass Spectral Data , 2003, Journal of biomedicine & biotechnology.