Nature Inspired Multi-Swarm Heuristics for Multi-Knowledge Extraction

Multi-knowledge extraction is significant for many real-world applications. The nature inspired population-based reduction approaches are attractive to find multiple reducts in the decision systems, which could be applied to generate multi-knowledge and to improve decision accuracy. In this Chapter, we introduce two nature inspired population-based computational optimization techniques namely Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) for rough set reduction and multi-knowledge extraction. A Multi-Swarm Synergetic Optimization (MSSO) algorithm is presented for rough set reduction and multi-knowledge extraction. In the MSSO approach, different individuals encodes different reducts. The proposed approach discovers the best feature combinations in an efficient way to observe the change of positive region as the particles proceed throughout the search space. We also attempt to theoretically prove that the multi-swarm synergetic optimization algorithm converges with a probability of 1 towards the global optimal. The performance of the proposed approach is evaluated and compared with Standard Particle Swarm Optimization (SPSO) and Genetic Algorithms (GA). Empirical results illustrate that the approach can be applied for multiple reduct problems and multi-knowledge extraction very effectively.

[1]  Qingxiang Wu,et al.  Multi-knowledge Extraction and Application , 2003, RSFDGrC.

[2]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[3]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[4]  Terence Soule,et al.  Breeding swarms: a GA/PSO hybrid , 2005, GECCO '05.

[5]  Jan Komorowski,et al.  Principles of Data Mining and Knowledge Discovery , 2001, Lecture Notes in Computer Science.

[6]  Andrew Kusiak,et al.  Rough set theory: a data mining tool for semiconductor manufacturing , 2001 .

[7]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[8]  Zdzislaw Pawlak,et al.  Rough sets and intelligent data analysis , 2002, Inf. Sci..

[9]  Ajith Abraham,et al.  SEARCH OPTIMIZATION USING HYBRID PARTICLE SUB- SWARMS AND EVOLUTIONARY ALGORITHMS , 2005 .

[10]  Ajith Abraham,et al.  Applied Soft Computing Technologies: The Challenge of Complexity, Proceedings of the 9th Online World Conference on Soft Computing in Industrial Applications (WSC9), September 20th - October 8th, 2004, held on the World Wide Web , 2004, WSC.

[11]  Emilio Corchado,et al.  Intelligent Data Engineering and Automated Learning - IDEAL 2006, 7th International Conference, Burgos, Spain, September 20-23, 2006, Proceedings , 2006, IDEAL.

[12]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[13]  Moussa Boussouf,et al.  A Hybrid Approach to Feature Selection , 1998, PKDD.

[14]  Lili Diao,et al.  A Heuristic Optimal Reduct Algorithm , 2000, IDEAL.

[15]  Kalyan Moy Gupta,et al.  Rough Set Feature Selection Methods for Case-Based Categorization of Text Documents , 2005, PReMI.

[16]  Bo Li,et al.  Particle Swarm Optimisation from lbest to gbest , 2004, WSC.

[17]  Qiang Shen,et al.  Rough Feature Selection for Neural Network Based Image Classification , 2002, Int. J. Image Graph..

[18]  Hassan M. Emara,et al.  Clubs-based Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[19]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[20]  Guoyin Wang,et al.  Rough reduction in algebra view and information view , 2003, Int. J. Intell. Syst..

[21]  L Hongbo,et al.  An Hybrid Fuzzy Variable Neighborhood Particle Swarm Optimization Algorithm for Solving Quadratic Assignment Problems , 2007 .

[22]  Meng Li,et al.  Stream Operators for Querying Data Streams , 2005, WAIM.

[23]  Xu Zhang,et al.  A Quick Attribute Reduction Algorithm with Complexity of max(O(｜C｜｜U｜),O(｜C｜~2｜U/C｜)) , 2006 .

[24]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[25]  Theresa Beaubouef,et al.  Rough set spatial data modeling for data mining , 2004, Int. J. Intell. Syst..

[26]  Ning Zhong,et al.  Using Rough Sets with Heuristics for Feature Selection , 1999, RSFDGrC.

[27]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[28]  Han Tong Loh,et al.  Applying rough sets to market timing decisions , 2004, Decis. Support Syst..

[29]  Luca Maria Gambardella,et al.  Effective Neighborhood Functions for the Flexible Job Shop Problem , 1998 .

[30]  Francis Eng Hock Tay,et al.  Economic and financial prediction using rough sets model , 2002, Eur. J. Oper. Res..

[31]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[32]  Zdzisław Pawlak,et al.  Rough sets. Present state and the future , 1993 .

[33]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[34]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[35]  Ajith Abraham,et al.  Swarm Intelligence: Foundations, Perspectives and Applications , 2006, Swarm Intelligent Systems.

[36]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[37]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[38]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[39]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[40]  Jing Zhang,et al.  A New Heuristic Reduct Algorithm Base on Rough Sets Theory , 2003, WAIM.

[41]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[42]  Albert A. Groenwold,et al.  A Study of Global Optimization Using Particle Swarms , 2005, J. Glob. Optim..

[43]  Nadia Nedjah,et al.  Swarm Intelligent Systems , 2006, Studies in Computational Intelligence.

[44]  Ran He,et al.  An Improved Particle Swarm Optimization Based on Self-Adaptive Escape Velocity , 2005 .

[45]  Jiang Chuanwen,et al.  A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation , 2005, Math. Comput. Simul..

[46]  SkowronAndrzej,et al.  Rough set methods in feature selection and recognition , 2003 .

[47]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[48]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[49]  Sushmita Mitra,et al.  Feature Selection Using Rough Sets , 2006, Multi-Objective Machine Learning.

[50]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[51]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[52]  Ajith Abraham,et al.  Chaotic dynamic characteristics in swarm intelligence , 2007, Appl. Soft Comput..