Data classification using evidence reasoning rule

In Dempster-Shafer evidence theory (DST) based classifier design, Dempster's combination (DC) rule is commonly used as a multi-attribute classifier to combine evidence collected from different attributes. The main aim of this paper is to present a classification method using a novel combination rule i.e., the evidence reasoning (ER) rule. As an improvement of the DC rule, the newly proposed ER rule defines the reliability and weight of evidence. The former indicates the ability of attribute or its evidence to provide correct assessment for classification problem, and the latter reflects the relative importance of evidence in comparison with other evidence when they need to be combined. The ER rule-based classification procedure is expatiated from evidence acquisition and estimation of evidence reliability and weight to combination of evidence. It is a purely data-driven approach without making any assumptions about the relationships between attributes and class memberships, and the specific statistic distributions of attribute data. Experiential results on five popular benchmark databases taken from University of California Irvine (UCI) machine learning database show high classification accuracy that is competitive with other classical and mainstream classifiers.

[1]  Zhiwu Lu,et al.  Learning descriptive visual representation for image classification and annotation , 2015, Pattern Recognit..

[2]  Glenn Shafer,et al.  Readings in Uncertain Reasoning , 1990 .

[3]  Jian-Bo Yang,et al.  The evidential reasoning approach for multi-attribute decision analysis under interval uncertainty , 2006, Eur. J. Oper. Res..

[4]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[5]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Oscar Castillo,et al.  A review on type-2 fuzzy logic applications in clustering, classification and pattern recognition , 2014, Appl. Soft Comput..

[7]  Luciano Lamberti,et al.  Move limits definition in structural optimization with sequential linear programming. Part I: Optimization algorithm , 2003 .

[8]  Jian-Bo Yang,et al.  On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Yong Hu,et al.  A new method to determine basic probability assignment using core samples , 2014, Knowl. Based Syst..

[10]  Yoav Freund,et al.  The Alternating Decision Tree Learning Algorithm , 1999, ICML.

[11]  Dong-Ling Xu,et al.  Evidential reasoning rule for evidence combination , 2013, Artif. Intell..

[12]  R. D. Richtmyer,et al.  Difference methods for initial-value problems , 1959 .

[13]  川口 光年,et al.  R.D.Richtmyer: Difference Methods for Initial-Value Problems. Interscience Pub. Inc. New York, 1957, xii+238頁, 15×23cm, \2,600. , 1958 .

[14]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[17]  Jian-Bo Yang,et al.  A data-driven approximate causal inference model using the evidential reasoning rule , 2015, Knowl. Based Syst..

[18]  Luciano Lamberti,et al.  Move limits definition in structural optimization with sequential linear programming. Part II: Numerical examples , 2003 .

[19]  Mehmet Aci,et al.  K nearest neighbor reinforced expectation maximization method , 2011, Expert Syst. Appl..

[20]  Irina Rish,et al.  An empirical study of the naive Bayes classifier , 2001 .

[21]  Ting-Yu Chen Calculation of the move limits for the sequential linear programming method , 1993 .

[22]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[23]  Jian-Bo Yang,et al.  A Study on Generalising Bayesian Inference to Evidential Reasoning , 2014, Belief Functions.

[24]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[25]  R. Haftka,et al.  Elements of Structural Optimization , 1984 .

[26]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[27]  Ting-Yu Chen A COMPREHENSIVE SOLUTION FOR ENHANCING THE EFFICIENCY AND THE ROBUSTNESS OF THE SLP ALGORITHM , 1998 .

[28]  Jian-Bo Yang,et al.  Belief rule-based inference for predicting trauma outcome , 2016, Knowl. Based Syst..

[29]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[30]  Sorour Afshar,et al.  Presenting a new multiclass classifier based on learning automata , 2013, Neurocomputing.

[31]  Narendra Karmarkar,et al.  An Interior-Point Approach to NP-Complete Problems , 1990, Conference on Integer Programming and Combinatorial Optimization.

[32]  Wen Chenglin,et al.  Data Fusion Algorithm of Fault Diagnosis Considering Sensor Measurement Uncertainty , 2013 .

[33]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[34]  Jian-Bo Yang,et al.  The evidential reasoning approach for MADA under both probabilistic and fuzzy uncertainties , 2006, Eur. J. Oper. Res..

[35]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[36]  G. Dantzig Making progress during a stall in the simplex algorithm , 1989 .

[37]  Jian-Bo Yang,et al.  Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties , 2001, Eur. J. Oper. Res..

[38]  R. E. Griffith,et al.  A Nonlinear Programming Technique for the Optimization of Continuous Processing Systems , 1961 .

[39]  Oscar Castillo,et al.  Fuzzy granular gravitational clustering algorithm for multivariate data , 2014, Inf. Sci..

[40]  Dong-Ling Xu,et al.  An introduction and survey of the evidential reasoning approach for multiple criteria decision analysis , 2012, Ann. Oper. Res..

[41]  Xiaojing Song,et al.  The optimal design of industrial alarm systems based on evidence theory , 2016 .

[42]  Zhen Zhang,et al.  Interval-valued Evidence Updating with Reliability and Sensitivity Analysis for Fault Diagnosis , 2016, Int. J. Comput. Intell. Syst..

[43]  Pavel V. Sevastjanov,et al.  A new approach to the rule-base evidential reasoning: Stock trading expert system application , 2010, Expert Syst. Appl..

[44]  J. Renaud,et al.  New Adaptive Move-Limit Management Strategy for Approximate Optimization, Part 2 , 1998 .

[45]  Buhong Li,et al.  Pattern recognition of multiple excitation autofluorescence spectra for colon tissue classification. , 2013, Photodiagnosis and photodynamic therapy.

[46]  Francisco Azuaje,et al.  Witten IH, Frank E: Data Mining: Practical Machine Learning Tools and Techniques 2nd edition , 2006 .

[47]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[48]  Zhi-Jie Zhou,et al.  Belief rule based expert system for classification problems with new rule activation and weight calculation procedures , 2016, Inf. Sci..

[49]  Quan Pan,et al.  Belief rule-based classification system: Extension of FRBCS in belief functions framework , 2015, Inf. Sci..

[50]  M. Singh,et al.  An Evidential Reasoning Approach for Multiple-Attribute Decision Making with Uncertainty , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[51]  Jian-Bo Yang,et al.  Effective learning of belief rule based systems with sequential linear programming , 2010 .

[52]  Jalal A. Nasiri,et al.  Least squares twin multi-class classification support vector machine , 2015, Pattern Recognit..

[53]  R. Casini,et al.  REMOVAL OF SPECTRO-POLARIMETRIC FRINGES BY TWO-DIMENSIONAL PATTERN RECOGNITION , 2012 .

[54]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[55]  Fuqiang Chen,et al.  Effective feature selection using feature vector graph for classification , 2015, Neurocomputing.