Improved Data Classification using Fuzzy Euclidean Hyperbox Classifier

In this paper, a modification to the simple fuzzy min-max classifier has been proposed. The primary objective was the design of an efficient classifier that can be used in a wide range of application domains, unlike most prior works which focus on selected problems. This work retains the fuzzy neural structure of the original work but proposes a different membership function for the hyperboxes based on the Euclidean distance measure. The new function takes into consideration the centroids of the hyperboxes and not just the min and max points. The competence of the proposed classifier is tested on kinds of datasets. Further, a novel approach in which the classifier can also handle partly labeled data (or data with missing labels) is also discussed. One of the most important requisites of any classification algorithm is its efficiency. In the result-driven technological world of today, where mobile computing is a major thrust area, simple and elegant solutions are highly sought. Thus speed and efficiency were major considerations in the choice of the classifier for the classification system designed.

[1]  David Barber,et al.  Bayesian Classification With Gaussian Processes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  N. Draper,et al.  Applied Regression Analysis. , 1967 .

[3]  Vijay Kumar Jha,et al.  Fuzzy min–max neural network and particle swarm optimization based intrusion detection system , 2017 .

[4]  Ji Won Yoon,et al.  Efficient model selection for probabilistic K nearest neighbour classification , 2015, Neurocomputing.

[5]  Zahra Mirzamomen,et al.  Fuzzy min-max neural network based decision trees , 2016, Intell. Data Anal..

[6]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[8]  Vijay Kumar Jha,et al.  Data Mining in Intrusion Detection: A Comparative Study of Methods, Types and Data Sets , 2013 .

[9]  Maria-Florina Balcan,et al.  A discriminative model for semi-supervised learning , 2010, J. ACM.

[10]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[11]  Minoru Sasaki,et al.  Hybrid Method of Semi-supervised Learning and Feature Weighted Learning for Domain Adaptation of Document Classification , 2015, PACLIC.

[12]  Barbara Hammer,et al.  Efficient approximations of robust soft learning vector quantization for non-vectorial data , 2015, Neurocomputing.

[13]  L. M. Khanli,et al.  Intrusion Detection in the Cloud Environment Using Multi-Level Fuzzy Neural Networks , 2015 .

[14]  Vijay Kumar Jha,et al.  A Novel Fuzzy Min-Max Neural Network and Genetic Algorithm-Based Intrusion Detection System , 2016 .

[15]  Jeffrey S. Racine,et al.  Spline Regression in the Presence of Categorical Predictors , 2015 .

[16]  Shrijana Pradhan,et al.  Internet of Things: Comparative Study on Classification Algorithms (k-NN, Naive Bayes and Case based Reasoning) , 2015 .

[17]  Vijay Kumar Jha,et al.  Genetic Algorithm to Solve the Problem of Small Disjunct In the Decision Tree Based Intrusion Detection System , 2015 .

[18]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[19]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[20]  Muharram Mansoorizadeh,et al.  Multi-Level Fuzzy Min-Max Neural Network Classifier , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[22]  Neil D. Lawrence,et al.  Semi-described and semi-supervised learning with Gaussian processes , 2015, UAI.

[23]  Seba Susan,et al.  Fuzzy Min-Max Neural Networks for Business Intelligence , 2013, 2013 International Symposium on Computational and Business Intelligence.

[24]  P. K. Simpson,et al.  Fuzzy min-max neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[25]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[26]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[27]  Sahil Shah,et al.  Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques , 2015, Expert Syst. Appl..

[28]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[29]  Prabir Kumar Biswas,et al.  A Granular Reflex Fuzzy Min–Max Neural Network for Classification , 2009, IEEE Transactions on Neural Networks.

[30]  Patrick K. Simpson.  Fuzzy min-max classification with neural networks , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[31]  Chee Peng Lim,et al.  An Enhanced Fuzzy Min–Max Neural Network for Pattern Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[33]  J. Manyika.  Big data: The next frontier for innovation, competition, and productivity , 2011 .

[34]  Donghai Guan,et al.  Semi-supervised learning using frequent itemset and ensemble learning for SMS classification , 2015, Expert Syst. Appl..