Classification Based on Decision Tree Algorithm for Machine Learning

Decision tree classifiers are regarded to be a standout of the most well-known methods to data classification representation of classifiers. Different researchers from various fields and backgrounds have considered the problem of extending a decision tree from available data, such as machine study, pattern recognition, and statistics. In various fields such as medical disease analysis, text classification, user smartphone classification, images, and many more the employment of Decision tree classifiers has been proposed in many ways. This paper provides a detailed approach to the decision trees. Furthermore, paper specifics, such as algorithms/approaches used, datasets, and outcomes achieved, are evaluated and outlined comprehensively. In addition, all of the approaches analyzed were discussed to illustrate the themes of the authors and identify the most accurate classifiers. As a result, the uses of different types of datasets are discussed and their findings are analyzed.

[1]  Gaurav Gupta,et al.  A self explanatory review of decision tree classifiers , 2014, International Conference on Recent Advances and Innovations in Engineering (ICRAIE-2014).

[2]  Iqbal H. Sarker,et al.  BehavDT: A Behavioral Decision Tree Learning to Build User-Centric Context-Aware Predictive Model , 2019, Mobile Networks and Applications.

[3]  R. Udendhran,et al.  Hybridized neural network and decision tree based classifier for prognostic decision making in breast cancers , 2020, Soft Comput..

[4]  Lou Wei,et al.  Fault Diagnosis of Rolling Bearing Based on the Permutation Entropy of VMD and Decision Tree , 2019 .

[5]  Shuning Wu,et al.  A user-centric machine learning framework for cyber security operations center , 2017, 2017 IEEE International Conference on Intelligence and Security Informatics (ISI).

[6]  María Pérez-Ortiz,et al.  A Review of Classification Problems and Algorithms in Renewable Energy Applications , 2016 .

[7]  Qingshan Jiang,et al.  Feature selection via maximizing global information gain for text classification , 2013, Knowl. Based Syst..

[8]  P. Goyal,et al.  Controlling Ambipolarity and Rising Ion in TFETs for Enhanced Reliability: A Review , 2020, 2020 5th IEEE International Conference on Recent Advances and Innovations in Engineering (ICRAIE).

[9]  Neha Agarwal,et al.  Stock Market Analysis using Supervised Machine Learning , 2019, 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon).

[10]  Nawzat Sadiq Ahmed,et al.  Clarify of the Random Forest Algorithm in an Educational Field , 2018, 2018 International Conference on Advanced Science and Engineering (ICOASE).

[11]  P. Sathiyanarayanan,et al.  Identification of Breast Cancer Using The Decision Tree Algorithm , 2019, 2019 IEEE International Conference on System, Computation, Automation and Networking (ICSCAN).

[12]  Ahmed I. Taloba,et al.  An Intelligent Hybrid Technique of Decision Tree and Genetic Algorithm for E-Mail Spam Detection , 2019, 2019 Ninth International Conference on Intelligent Computing and Information Systems (ICICIS).

[13]  Diyar Qader Zeebaree,et al.  A Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction , 2020, Journal of Applied Science and Technology Trends.

[14]  Yong Deng,et al.  Evidential Decision Tree Based on Belief Entropy , 2019, Entropy.

[15]  Carla E. Brodley,et al.  Multivariate decision trees , 2004, Machine Learning.

[16]  Sulatha V. Bhandary,et al.  Automated detection of optic disc contours in fundus images using decision tree classifier , 2020 .

[17]  Yui-Lam Chan,et al.  Machine Learning-Based Fast Intra Mode Decision for HEVC Screen Content Coding via Decision Trees , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Shweta Taneja,et al.  An Enhanced K-Nearest Neighbor Algorithm Using Information Gain and Clustering , 2014, 2014 Fourth International Conference on Advanced Computing & Communication Technologies.

[19]  Wei-Yin Loh,et al.  Fifty Years of Classification and Regression Trees , 2014 .

[20]  Ying LU,et al.  Decision tree methods: applications for classification and prediction , 2015, Shanghai archives of psychiatry.

[21]  Margo I. Seltzer,et al.  Optimal Sparse Decision Trees , 2019, NeurIPS.

[22]  Tae-Seong Kim,et al.  Femur segmentation in DXA imaging using a machine learning decision tree. , 2018, Journal of X-ray science and technology.

[23]  Lior Rokach,et al.  Top-down induction of decision trees classifiers - a survey , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Dan A. Simovici,et al.  Functional entropy and decision trees , 1998, Proceedings. 1998 28th IEEE International Symposium on Multiple- Valued Logic (Cat. No.98CB36138).

[25]  Kilian Stoffel,et al.  Theoretical Comparison between the Gini Index and Information Gain Criteria , 2004, Annals of Mathematics and Artificial Intelligence.

[26]  Feng-Jen Yang,et al.  An Extended Idea about Decision Trees , 2019, 2019 International Conference on Computational Science and Computational Intelligence (CSCI).

[27]  Kien A. Hua,et al.  Decision tree classifier for network intrusion detection with GA-based feature selection , 2005, ACM Southeast Regional Conference.

[28]  Leon N. Cooper,et al.  Training Data Selection for Support Vector Machines , 2005, ICNC.

[29]  Parman Sukarno,et al.  Comparative Analysis of K-Nearest Neighbor and Decision Tree in Detecting Distributed Denial of Service , 2020, 2020 8th International Conference on Information and Communication Technology (ICoICT).

[30]  Sachin S. Gavankar,et al.  Eager decision tree , 2017, 2017 2nd International Conference for Convergence in Technology (I2CT).

[31]  Yoshua Bengio,et al.  DECISION TREES DO NOT GENERALIZE TO NEW VARIATIONS , 2010, Comput. Intell..

[32]  Habibollah Haron,et al.  Gene Selection and Classification of Microarray Data Using Convolutional Neural Network , 2018, 2018 International Conference on Advanced Science and Engineering (ICOASE).

[33]  William Stafford Noble,et al.  Machine learning applications in genetics and genomics , 2015, Nature Reviews Genetics.

[34]  Fabio Dovis,et al.  Detection of GNSS Ionospheric Scintillations Based on Machine Learning Decision Tree , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[35]  Siddalingeshwar Patil,et al.  Accuracy Prediction for Distributed Decision Tree using Machine Learning approach , 2019, 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI).

[36]  Anjar Wanto,et al.  Decision Tree Optimization in C4.5 Algorithm Using Genetic Algorithm , 2019, Journal of Physics: Conference Series.

[37]  M. U. Shaikh,et al.  A framework for generation of rules from decision tree and decision table , 2010, 2010 International Conference on Information and Emerging Technologies.

[38]  Habibollah Haron,et al.  Machine learning and Region Growing for Breast Cancer Segmentation , 2019, 2019 International Conference on Advanced Science and Engineering (ICOASE).

[39]  Ahmed Ahmim,et al.  A Novel Hierarchical Intrusion Detection System Based on Decision Tree and Rules-Based Models , 2018, 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS).

[40]  Ying Ju,et al.  Predicting Diabetes Mellitus With Machine Learning Techniques , 2018, Front. Genet..

[41]  Peter Kapec,et al.  Decision Support in Medical Data Using 3D Decision Tree Visualisation , 2019, 2019 E-Health and Bioengineering Conference (EHB).

[42]  Adnan Mohsin Abdulazeez,et al.  Gait-Based Human Gender Classification Using Lifting 5/3 Wavelet and Principal Component Analysis , 2018, 2018 International Conference on Advanced Science and Engineering (ICOASE).

[43]  Bofeng Zhang,et al.  Information Gain with Weight Based Decision Tree for the Employment Forecasting of Undergraduates , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[44]  Raj Kumar,et al.  Classification Algorithms for Data Mining: a Survey , 2022 .

[45]  Ramón López de Mántaras,et al.  A distance-based attribute selection measure for decision tree induction , 1991, Machine Learning.

[46]  S. Nandhini,et al.  Performance Evaluation of Machine Learning Algorithms for Email Spam Detection , 2020, 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE).

[47]  Adel Sabry Eesa,et al.  A novel feature-selection approach based on the cuttlefish optimization algorithm for intrusion detection systems , 2015, Expert Syst. Appl..

[48]  Francesca De Felice,et al.  Decision tree algorithm in locally advanced rectal cancer: an example of over-interpretation and misuse of a machine learning approach , 2019, Journal of Cancer Research and Clinical Oncology.

[49]  SAGAR S. NIkAM,et al.  A Comparative Study of Classification Techniques in Data Mining Algorithms , 2015 .

[50]  Adel Sabry Eesa,et al.  A DIDS Based on The Combination of Cuttlefish Algorithm and Decision Tree , 2017 .

[51]  Sotiris B. Kotsiantis,et al.  Machine learning: a review of classification and combining techniques , 2006, Artificial Intelligence Review.

[52]  Xiaodong Lin,et al.  Efficient and Secure Decision Tree Classification for Cloud-Assisted Online Diagnosis Services , 2019, IEEE Transactions on Dependable and Secure Computing.

[53]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Decision-Tree Induction , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  Ayodele Adebiyi,et al.  PCA Model For RNA-Seq Malaria Vector Data Classification Using KNN And Decision Tree Algorithm , 2020, 2020 International Conference in Mathematics, Computer Engineering and Computer Science (ICMCECS).

[55]  Y. Zhao,et al.  Comparison of decision tree methods for finding active objects , 2007, 0708.4274.

[56]  Cezary Z. Janikow,et al.  Fuzzy decision trees: issues and methods , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[57]  Adnan Mohsin Abdulazeez Brifcani,et al.  Intrusion Detection and Attack Classifier Based on Three Techniques: A Comparative Study , 2011 .

[58]  Kelvin K. W. Yau,et al.  Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networks , 2007 .

[59]  Wlodzislaw Duch,et al.  Comparison of Shannon, Renyi and Tsallis Entropy Used in Decision Trees , 2006, ICAISC.

[60]  D.V. Patil,et al.  A Hybrid Evolutionary Approach To Construct Optimal Decision Trees With Large Data Sets , 2006, 2006 IEEE International Conference on Industrial Technology.

[61]  Tsehay Admassu Assegie,et al.  Handwritten digits recognition with decision tree classification: a machine learning approach , 2019, International Journal of Electrical and Computer Engineering (IJECE).

[62]  Jinhai Liu,et al.  Prediction of Daily Smoking Behavior Based on Decision Tree Machine Learning Algorithm , 2019, 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC).

[63]  S R Jiao,et al.  A Review of Decision Tree Classification Algorithms for Continuous Variables , 2020 .

[64]  Fei Han,et al.  Hybrid self-inertia weight adaptive particle swarm optimisation with local search using C4.5 decision tree classifier for feature selection problems , 2019, Connect. Sci..

[65]  Virgnia Mari E. Batitis,et al.  Image Classification of Abnormal Red Blood Cells Using Decision Tree Algorithm , 2020, 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC).

[66]  Dastan Hussen Maulud,et al.  A Review on Linear Regression Comprehensive in Machine Learning , 2020 .

[67]  Priyanka,et al.  Decision tree classifier: a detailed survey , 2020, Int. J. Inf. Decis. Sci..

[68]  Omar Ahmed,et al.  Gene Expression Classification Based on Deep Learning , 2019, 2019 4th Scientific International Conference Najaf (SICN).

[69]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[70]  Philip H. Swain,et al.  Purdue e-Pubs , 2022 .

[71]  Michel Bierlaire,et al.  A systematic review of machine learning classification methodologies for modelling passenger mode choice , 2021 .

[72]  Xihui Chen,et al.  Fault Diagnosis of Rolling Bearing Based on the Permutation Entropy of VMD and Decision Tree , 2019, 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE).

[73]  Ayon Dey,et al.  Machine Learning Algorithms : A Review , 2016 .

[74]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.