Implementation of Modified ID3 Algorithm

Data classification algorithms are very important in real world applications like- intrusion classification, heart disease prediction, cancer prediction etc. This paper presents a novel decision tree based technique for data classification. Basically it is an enhanced variant of ID3 algorithm. ID3 is a popular and common decision tree based technique for data classification. in this paper, an upgraded version of ID3 is proposed. This version calculates information gain in a different way by giving more weightage to more important attribute instead of an attribute which is having more different values. The fundamentals of data classification are also discussed in brief. The experimental results have proven that the accuracy of the presented method is better.

[1]  Pat Langley,et al.  Induction of Recursive Bayesian Classifiers , 1993, ECML.

[2]  Singh Vijendra,et al.  Efficient Clustering for High Dimensional Data: Subspace Based Clustering and Density Based Clustering , 2011 .

[3]  João Gama,et al.  Linear tree , 1999, Intell. Data Anal..

[4]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[5]  Liang Xu,et al.  An improved Decision Tree classification algorithm based on ID3 and the application in score analysis , 2009, 2009 Chinese Control and Decision Conference.

[6]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[7]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[8]  Hans Zantema,et al.  Finding Small Equivalent Decision Trees is Hard , 2000, Int. J. Found. Comput. Sci..

[9]  Miao Wang,et al.  A more efficient classification scheme for ID3 , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[10]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[11]  Liu Yuxun,et al.  Improved ID3 algorithm , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[12]  Geoffrey I. Webb,et al.  On Why Discretization Works for Naive-Bayes Classifiers , 2003, Australian Conference on Artificial Intelligence.

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .