Recognition of different datasets using PCA, LDA, and various classifiers

Bayesian, k-nearest neighbor, and Parzen window classifiers along with PCA and LDA methods, are effective tools in machine learning. In this work, a hybrid method is formed by the above mentioned methods. The aim is to achieve a successful, fast, and low computational classification. Performance of the new method is evaluated on five various kinds of datasets, from UCI machine learning datasets, including Breast Cancer, Iris, Glass, Yeast, and Wine. The experimental results indicate the superior performance of the proposed method in comparison with the previous works.

[1]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[2]  Cigdem Inan Aci,et al.  A hybrid classification method of k nearest neighbor, Bayesian methods and genetic algorithm , 2010, Expert Syst. Appl..

[3]  Chengqi Zhang,et al.  Testing Adaptive Local Hyperplane for multi-class classification by double cross-validation , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[4]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[5]  Victor-Emil Neagoe,et al.  Face Recognition using PCA versus ICA versus LDA cascaded with the neural classifier of Concurrent Self-Organizing Maps , 2010, 2010 8th International Conference on Communications.

[6]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[7]  Yanli Zhang,et al.  Classification Systems Based on Fuzzy Cognitive Maps , 2010, 2010 Fourth International Conference on Genetic and Evolutionary Computing.

[8]  Aruna Tiwari,et al.  Performance evaluation of SVM based semi-supervised classification algorithm , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[9]  Gen-Lin Ji,et al.  Random sampling LDA incorporating feature selection for face recognition , 2010, 2010 International Conference on Wavelet Analysis and Pattern Recognition.

[10]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[11]  N. Mozayani,et al.  Adjusting the parameters of radial basis function networks using Particle Swarm Optimization , 2009, 2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[12]  Vadlamani Ravi,et al.  Rule extraction from differential evolution trained radial basis function network using genetic algorithms , 2009, 2009 IEEE International Conference on Automation Science and Engineering.

[14]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.