Rule-based granular classification: A hypersphere information granule-based method

Abstract As fundamental abstract constructs supporting the human-centered way of Granular Computing (GrC), information granules can be used to distinguish different classes of data from the perspective of easily understood geometrical structure. In this study, a three-stage rule-based granular classification method is proposed using a union of a series of hypersphere information granules. The first stage focuses on dividing each class of data into a series of chunks. The second stage concerns the construction of some hyperspheres around these chunks. These resulting hyperspheres form a union information granule to depict the key structural characteristics of the corresponding data through their union operation. At the final stage, the union information granules are refined and the rule-based granular classification model is emerged through using a series of “If-Then” rules to articulate the refined union information granule formed for each class with the corresponding class label. A number of experiments involving several synthetic and publicly available datasets are implemented to exhibit the advantages of the resulting classifier. The impacts of critical parameters on the performance of the constructed classifier are also revealed.

[1]  Radford M. Neal.  Regression and Classification Using Gaussian Process Priors , 2009 .

[2]  J. K. Kinnear,et al.  Advances in Genetic Programming , 1994 .

[3]  Witold Pedrycz,et al.  Knowledge-based clustering - from data to information granules , 2007 .

[4]  Witold Pedrycz,et al.  Fuzzy granular classification based on the principle of justifiable granularity , 2019, Knowl. Based Syst..

[5]  Witold Pedrycz,et al.  Granular computing for data analytics: a manifesto of human-centric computing , 2018, IEEE/CAA Journal of Automatica Sinica.

[6]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[7]  Saroj K. Meher,et al.  Fusion of progressive granular neural networks for pattern classification , 2018, Soft Computing.

[8]  Francisco Martínez-Álvarez,et al.  A sensitivity study of seismicity indicators in supervised learning to improve earthquake prediction , 2016, Knowl. Based Syst..

[9]  Katrin Franke,et al.  Big data analytics by automated generation of fuzzy rules for Network Forensics Readiness , 2017, Appl. Soft Comput..

[10]  Witold Pedrycz,et al.  Granular classifiers and their design through refinement of information granules , 2017, Soft Comput..

[11]  Sam Kwong,et al.  Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection , 2007, Pattern Recognition.

[12]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[13]  Francisco Herrera,et al.  A Compact Evolutionary Interval-Valued Fuzzy Rule-Based Classification System for the Modeling and Prediction of Real-World Financial Applications With Imbalanced Data , 2015, IEEE Transactions on Fuzzy Systems.

[14]  Lotfi A. Zadeh,et al.  Fuzzy sets and information granularity , 1996 .

[15]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[16]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[17]  Piero P. Bonissone,et al.  A fuzzy random forest , 2010, Int. J. Approx. Reason..

[18]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[19]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[20]  Seok-Beom Roh,et al.  A design of granular fuzzy classifier , 2014, Expert Syst. Appl..

[21]  Andrzej Bargiela,et al.  Toward a Theory of Granular Computing for Human-Centered Information Processing , 2008, IEEE Transactions on Fuzzy Systems.

[22]  Witold Pedrycz,et al.  Fuzzy classifiers with information granules in feature space and logic-based computing , 2018, Pattern Recognit..

[23]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[24]  Hamido Fujita,et al.  Hierarchical cluster ensemble model based on knowledge granulation , 2016, Knowl. Based Syst..

[25]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[26]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[27]  Witold Pedrycz,et al.  Building the fundamentals of granular computing: A principle of justifiable granularity , 2013, Appl. Soft Comput..

[28]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[29]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[30]  Yanqing Zhang,et al.  Granular support vector machines for medical binary classification problems , 2004, 2004 Symposium on Computational Intelligence in Bioinformatics and Computational Biology.

[31]  Witold Pedrycz,et al.  Granular Fuzzy Modeling for Multidimensional Numeric Data: A Layered Approach Based on Hyperbox , 2019, IEEE Transactions on Fuzzy Systems.

[32]  Vassilis G. Kaburlasos,et al.  FCknn: A granular knn classifier based on formal concepts , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[33]  Witold Pedrycz,et al.  Fuzzy C-Means clustering of incomplete data based on probabilistic information granules of missing values , 2016, Knowl. Based Syst..

[34]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[35]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[36]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[37]  Mohammad R. Akbarzadeh-Totonchi,et al.  A hierarchical fuzzy rule-based approach to aphasia diagnosis , 2007, J. Biomed. Informatics.

[38]  Matt J. Aitkenhead,et al.  A co-evolving decision tree classification method , 2008, Expert Syst. Appl..

[39]  Giuseppe De Pietro,et al.  Designing rule-based fuzzy systems for classification in medicine , 2017, Knowl. Based Syst..

[40]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[41]  Henri Prade,et al.  What are fuzzy rules and how to use them , 1996, Fuzzy Sets Syst..

[42]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Hisao Ishibuchi,et al.  Pattern classification by distributed representation of fuzzy rules , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[44]  Witold Pedrycz,et al.  Aggregation of Classifiers: A Justifiable Information Granularity Approach , 2017, IEEE Transactions on Cybernetics.

[45]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[46]  C. Brodley,et al.  Decision tree classification of land cover from remotely sensed data , 1997 .

[47]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..