Dispersed decision-making system with fusion methods from the rank level and the measurement level - A comparative study

Abstract This article discusses the problem of decision-making based on dispersed knowledge that is stored in several independent knowledge bases. The dispersed decision-making system, which was proposed in a previous paper of the authors, is used. In this study, four fusion methods from the rank level and nine methods from the measurement level were used in this dispersed system. These methods were tested on three data sets from the UCI Repository – Soybean, Vehicle Silhouettes and Landsat Satellite. The sets are diverse in terms of the number of objects, the number of conditional attributes and the number of decision classes. There are also various types of conditional attributes in these sets. The experimental section is divided according to the three objectives of the article. The fusion methods were compared in the two groups – rank and measurement levels. In addition, experiments were carried out fusing multiple methods simultaneously in the decision-making process. Methods from the rank level and the measurement level were applied simultaneously in the same decision-making process. Then the decisions that were generated by the methods were merged. The results were compared and conclusions were drawn. The third goal of the article was to compare the efficiency of the inference of fusion method with and without the use of a dispersed system. It was found that the use of a dispersed system improved the efficiency of inference in most cases.

[1]  Alicja Wakulicz-Deja,et al.  A dispersed decision-making system - The use of negotiations during the dynamic generation of a system's structure , 2014, Inf. Sci..

[2]  Dominik Slezak,et al.  Ensembles of Bireducts: Towards Robust Classification and Simple Representation , 2011, FGIT.

[3]  Alicja Wakulicz-Deja,et al.  The strength of coalition in a dispersed decision support system with negotiations , 2016, Eur. J. Oper. Res..

[4]  Juan José Rodríguez Diez,et al.  A weighted voting framework for classifiers ensembles , 2012, Knowledge and Information Systems.

[5]  Malgorzata Przybyla-Kasperek The Borda Count, the Intersection and the Highest Rank Method in a Dispersed Decision-Making System , 2015, RSFDGrC.

[6]  Manfred K. Warmuth,et al.  The Weighted Majority Algorithm , 1994, Inf. Comput..

[7]  Alicja Wakulicz-Deja,et al.  Application of Reduction of the Set of Conditional Attributes in the Process of Global Decision-making , 2013, Fundam. Informaticae.

[8]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Arthur Zimek,et al.  On strategies for building effective ensembles of relative clustering validity criteria , 2015, Knowledge and Information Systems.

[11]  Zdzislaw Pawlak,et al.  An Inquiry into Anatomy of Conflicts , 1998, Inf. Sci..

[12]  Alicja Wakulicz-Deja,et al.  Application of the Method of Editing and Condensing in the Process of Global Decision-making , 2011, Fundam. Informaticae.

[13]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Alicja Wakulicz-Deja,et al.  Global decision-making in multi-agent decision-making system with dynamically generated disjoint clusters , 2016, Appl. Soft Comput..

[15]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[16]  D. Black The theory of committees and elections , 1959 .

[17]  Fabio Roli,et al.  A theoretical and experimental analysis of linear combiners for multiple classifier systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Vicenç Torra,et al.  Modeling decisions - information fusion and aggregation operators , 2007 .

[19]  Xin Yao,et al.  An analysis of diversity measures , 2006, Machine Learning.

[20]  Sebastian Widz,et al.  Is It Important Which Rough-Set-Based Classifier Extraction and Voting Criteria Are Applied Together? , 2010, RSCTC.

[21]  Galina L. Rogova,et al.  Combining the results of several neural network classifiers , 1994, Neural Networks.

[22]  Malgorzata Przybyla-Kasperek Dispersed decision-making system with selected fusion methods from the measurement level—Case study with medical data , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[23]  Jan G. Bazan Hierarchical Classifiers for Complex Spatio-temporal Concepts , 2008, Trans. Rough Sets.

[24]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[25]  Lukasz Sosnowski Framework of compound object comparators , 2015, Intell. Decis. Technol..

[26]  Zdzislaw Pawlak,et al.  On Conflicts , 1984, Int. J. Man Mach. Stud..

[27]  Andrzej Skowron,et al.  Layered Learning for Concept Synthesis , 2004, Trans. Rough Sets.

[28]  Dominik Slezak,et al.  On Generalized Decision Functions: Reducts, Networks and Ensembles , 2015, RSFDGrC.

[29]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[30]  Alicja Wakulicz-Deja,et al.  Global decision-making system with dynamically generated clusters , 2014, Inf. Sci..

[31]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[32]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[33]  Jakub Wroblewski,et al.  Ensembles of Classifiers Based on Approximate Reducts , 2001, Fundam. Informaticae.

[34]  Lars Schmidt-Thieme,et al.  Ensembles of relational classifiers , 2008, Knowledge and Information Systems.

[35]  Dominik Slezak,et al.  Feedforward neural networks for compound signals , 2011, Theor. Comput. Sci..

[36]  Luiz Eduardo Soares de Oliveira,et al.  Feature Selection for Ensembles Using the Multi-Objective Optimization Approach , 2006, Multi-Objective Machine Learning.

[37]  Andrzej Skowron,et al.  Interactive granular computing , 2016 .

[38]  Dominik Slezak,et al.  Rough Set Methods for Attribute Clustering and Selection , 2014, Appl. Artif. Intell..

[39]  Sinh Hoa Nguyen,et al.  Rough Set Approach to Sunspot Classification Problem , 2005, RSFDGrC.