A Micro-Extended Belief Rule-Based System for Big Data Multiclass Classification Problems

Big data classification problems have drawn great attention from diverse fields, and many classifiers have been developed. Among those classifiers, the extended belief rule-based system (EBRBS) has shown its potential in both big data and multiclass situations, while the time complexity and computing efficiency are two challenging issues to be handled in EBRBS. As such, three improvements of EBRBS are proposed first in this paper to decrease the time complexity and computing efficiency of EBRBS for multiclass classification under the assumption of large amount of data, including the strategy to skip rule weight calculation, a simplified evidential reasoning algorithm, and the domain division-based rule reduction method. This turns out to be a micro version of the EBRBS, called Micro-EBRBS. Moreover, one of commonly used cluster computing, named Apache Spark, is then applied to implement the parallel rule generation and inference schemes of the Micro-EBRBS for big data multiclass classification problems. The comparative analyses of experimental studies demonstrate that the Micro-EBRBS not only can obtain a desired accuracy but also has the comparatively better time complexity and computing efficiency than some popular classifiers, especially for multiclass classification problems.

[1]  Chris D. Nugent,et al.  Optimizing the configuration of an heterogeneous architecture of sensors for activity recognition, using the extended belief rule-based inference methodology , 2017, Microprocess. Microsystems.

[2]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  A review on the combination of binary classifiers in multiclass problems , 2008, Artificial Intelligence Review.

[3]  Xinping Yan,et al.  A Belief Rule-Based Expert System for Fault Diagnosis of Marine Diesel Engines , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  H. Ishibuchi,et al.  A fuzzy classifier system that generates fuzzy if-then rules for pattern classification problems , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[5]  Sara Tedmori,et al.  Mammogram image visual enhancement, mass segmentation and classification , 2015, Appl. Soft Comput..

[6]  Quan Pan,et al.  Combination of Classifiers With Optimal Weight Based on Evidential Reasoning , 2018, IEEE Transactions on Fuzzy Systems.

[7]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[8]  Eyke Hüllermeier,et al.  FURIA: an algorithm for unordered fuzzy rule induction , 2009, Data Mining and Knowledge Discovery.

[9]  Quan Pan,et al.  Belief rule-based classification system: Extension of FRBCS in belief functions framework , 2015, Inf. Sci..

[10]  Quan Pan,et al.  Classifier Fusion With Contextual Reliability Evaluation , 2018, IEEE Transactions on Cybernetics.

[11]  Quan Pan,et al.  A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Lei Chen,et al.  A data envelopment analysis (DEA)-based method for rule reduction in extended belief-rule-based systems , 2017, Knowl. Based Syst..

[13]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[14]  Chang-Hua Hu,et al.  A Model for Hidden Behavior Prediction of Complex Systems Based on Belief Rule Base and Power Set , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Francisco Herrera,et al.  Dynamic ensemble selection for multi-class classification with one-class classifiers , 2018, Pattern Recognit..

[17]  Alberto Calzada,et al.  A New Dynamic Rule Activation Method for Extended Belief Rule-Based Systems , 2015, IEEE Transactions on Knowledge and Data Engineering.

[18]  Neeraj Kumar,et al.  A feature reduced intrusion detection system using ANN classifier , 2017, Expert Syst. Appl..

[19]  Humberto Bustince,et al.  CHI-BD: A fuzzy rule-based classification system for Big Data classification problems , 2017, Fuzzy Sets Syst..

[20]  Francisco Herrera,et al.  A MapReduce Approach to Address Big Data Classification Problems Based on the Fusion of Linguistic Fuzzy Rules , 2015, Int. J. Comput. Intell. Syst..

[21]  Francisco Herrera,et al.  Why Linguistic Fuzzy Rule Based Classification Systems perform well in Big Data Applications? , 2017, Int. J. Comput. Intell. Syst..

[22]  Jian-Bo Yang,et al.  Environmental impact assessment using the evidential reasoning approach , 2006, Eur. J. Oper. Res..

[23]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[24]  Jian-Bo Yang,et al.  Belief rule-base inference methodology using the evidential reasoning Approach-RIMER , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Jian-Bo Yang,et al.  Optimization Models for Training Belief-Rule-Based Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Zhihui Li,et al.  Top-k multi-class SVM using multiple features , 2017, Inf. Sci..

[27]  Jian-Bo Yang,et al.  Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties , 2001, Eur. J. Oper. Res..

[28]  Zhi-Jie Zhou,et al.  Belief rule based expert system for classification problems with new rule activation and weight calculation procedures , 2016, Inf. Sci..

[29]  Maria J. Fuente,et al.  Multi-objective based Fuzzy Rule Based Systems (FRBSs) for trade-off improvement in accuracy and interpretability: A rule relevance point of view , 2017, Knowl. Based Syst..

[30]  Hong Yan,et al.  Fuzzy Algorithms: With Applications to Image Processing and Pattern Recognition , 1996, Advances in Fuzzy Systems - Applications and Theory.

[31]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[32]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[33]  Quan Pan,et al.  Hybrid Classification System for Uncertain Data , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Suprakash Datta,et al.  Evolved Features for DNA Sequence Classification and Their Fitness Landscapes , 2013, IEEE Transactions on Evolutionary Computation.

[35]  Alberto Calzada,et al.  A novel belief rule base representation, generation and its inference methodology , 2013, Knowl. Based Syst..

[36]  Francisco Herrera,et al.  Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big data , 2015, Fuzzy Sets Syst..