A Comparative Study to Analyze the Performance of Advanced Pattern Recognition Algorithms for Multi-Class Classification

This study aims to implement the following four advanced pattern recognition algorithms, such as “optimal Bayesian classifier,” “anti-Bayesian classifier,” “decision trees (DTs),” and “dependence trees (DepTs)” on both artificial and real datasets for multi-class classification. Then, we calculated the performance of individual algorithms on both real and artificial data for comparison. In Sect. 1, a brief introduction is given about the study. In the second section, the different types of datasets used in this study are discussed. In the third section, we compared the classification accuracies of Bayesian and anti-Bayesian methods for both the artificial and real-life datasets. In the fourth section, a comparison between the classification accuracy of DT and DepT classification methods for both the artificial and real-life datasets is discussed. In the fifth section, a comparison between the classification accuracy of the four algorithms, such as (a) Bayes, (b) anti-Bayes, (c) DTs, and (d) DepTs for both the artificial and real datasets is explained. We used 5-fold cross-validation to determine the classification accuracy of individual, machine learning-based, advanced pattern recognition (PR) models.

[1]  S. Péché,et al.  Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices , 2004, math/0403022.

[2]  Ayan Chatterjee,et al.  Identification of Risk Factors Associated with Obesity and Overweight—A Machine Learning Overview , 2020, Sensors.

[3]  Tomasz Górecki,et al.  Linear discriminant analysis with a generalization of the Moore–Penrose pseudoinverse , 2013, Int. J. Appl. Math. Comput. Sci..

[4]  B. John Oommen,et al.  The fundamental theory of optimal "Anti-Bayesian" parametric pattern classification using order statistics criteria , 2013, Pattern Recognit..

[5]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[6]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[7]  Dimitris Kanellopoulos,et al.  Data Preprocessing for Supervised Leaning , 2007 .

[8]  B. John Oommen,et al.  "Anti-Bayesian" parametric pattern classification using order statistics criteria for some members of the exponential family , 2014, Pattern Recognit..

[9]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[10]  Anca L. Ralescu,et al.  Confusion Matrix-based Feature Selection , 2011, MAICS.

[11]  Ayan Chatterjee,et al.  Statistical Explorations and Univariate Timeseries Analysis on COVID-19 Datasets to Understand the Trend of Disease Spreading and Death , 2020, Sensors.

[12]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..