Collaborative decision making by ensemble rule based classification systems

Rule based classification is a popular approach for decision making. It is also achievable that multiple rule based classifiers work together for group decision making by using ensemble learning approach. This kind of expert system is referred to as ensemble rule based classification system by means of a system of systems. In machine learning, an ensemble learning approach is usually adopted in order to improve overall predictive accuracy, which means to provide highly trusted decisions. This chapter introduces basic concepts of ensemble learning and reviews Random Prism to analyze its performance. This chapter also introduces an extended framework of ensemble learning, which is referred to as Collaborative and Competitive Random Decision Rules (CCRDR) and includes Information Entropy Based Rule Generation (IEBRG) and original Prism in addition to PrismTCS as base classifiers. This is in order to overcome the identified limitations of Random Prism. Each of the base classifiers mentioned above is also introduced with respects to its essence and applications. An experimental study is undertaken towards comparative validation between the CCRDR and Random Prism. Contributions and Ongoing and future works are also highlighted.

[1]  Jadzia Cendrowska,et al.  PRISM: An Algorithm for Inducing Modular Rules , 1987, Int. J. Man Mach. Stud..

[2]  Alexander E. Gegov.  Fuzzy Networks for Complex Systems - A Modular Rule Base Approach , 2010, Studies in Fuzziness and Soft Computing.

[3]  Max Bramer,et al.  Induction of Modular Classification Rules: Using Jmax-pruning , 2010, SGAI Conf..

[4]  Max Bramer,et al.  Random Prism: An Alternative to Random Forests , 2011, SGAI Conf..

[5]  Randy Kerber,et al.  ChiMerge: Discretization of Numeric Attributes , 1992, AAAI.

[6]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[7]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[8]  Max Bramer,et al.  Using J-Pruning to Reduce Overfitting of Classification Rules in Noisy Domains , 2002, DEXA.

[9]  Ivan Jordanov,et al.  An overview of the use of neural networks for data mining tasks , 2012, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[10]  Igor Kononenko,et al.  Machine Learning and Data Mining: Introduction to Principles and Algorithms , 2007 .

[11]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[12]  Mohamed Medhat Gaber,et al.  Pocket Data Mining , 2014 .

[13]  Nedyalko Petrov,et al.  Advanced modelling of complex processes by fuzzy networks , 2011 .

[14]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[15]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[16]  Alexander E. Gegov,et al.  Advanced modelling of complex processes by rule based networks , 2010, 2010 5th IEEE International Conference Intelligent Systems.

[17]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[18]  Max Bramer,et al.  Random Prism: a noise-tolerant alternative to Random Forests , 2014, Expert Syst. J. Knowl. Eng..

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  Kenneth J. Schlager,et al.  Systems engineering-key to modern development , 1956, IRE Transactions on Engineering Management.

[21]  Marti A. Hearst.  Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[22]  Max Bramer,et al.  Jmax-pruning: A facility for the information theoretic pruning of modular classification rules , 2012, Knowl. Based Syst..

[23]  Mohamed Medhat Gaber,et al.  Pocket Data Mining: Big Data on Small Devices , 2013 .

[24]  Janusz Kacprzyk,et al.  Innovative Issues in Intelligent Systems , 2016 .

[25]  Han Liu,et al.  J-measure based hybrid pruning for complexity reduction in classification rules , 2013 .

[26]  Michael Wooldridge,et al.  Introduction to Multi-Agent Systems , 2016 .

[27]  Robert E. Machol,et al.  System Engineering: An Introduction to the Design of Large-Scale Systems , 1957 .

[28]  Hans-Peter Kriegel,et al.  Can Shared-Neighbor Distances Defeat the Curse of Dimensionality? , 2010, SSDBM.

[29]  Max Bramer,et al.  Automatic Induction of Classification Rules from Examples Using N-Prism , 2000 .

[30]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[31]  Witold Pedrycz,et al.  Information granularity, big data, and computational intelligence , 2015 .

[32]  Ryszard S. Michalski,et al.  On the Quasi-Minimal Solution of the General Covering Problem , 1969 .

[33]  Han Liu,et al.  Induction of Modular Classification Rules by Information Entropy Based Rule Generation , 2016 .

[34]  Dipti Srinivasan,et al.  An Introduction to Multi-Agent Systems , 2010 .

[35]  A. D. Hall,et al.  A Methodology for Systems Engineering , 1962 .

[36]  Y. Shoham.  Introduction to Multi-Agent Systems , 2002 .

[37]  Han Liu,et al.  Unified framework for construction of rule based classification systems , 2015 .

[38]  Max Bramer,et al.  Inducer: a public domain workbench for data mining , 2005, Int. J. Syst. Sci..