Knowledge Acquisition in Fuzzy-Rule-Based Systems With Particle-Swarm Optimization

Knowledge acquisition is a long-standing problem in fuzzy-rule-based systems. In spite of the existence of several approaches, much effort is still required to increase the efficiency of the learning process. This study introduces a new method for the fuzzy-rule evolution that forms an expert system knowledge: the knowledge acquisition with a swarm-intelligence approach (KASIA). Specifically, this strategy is based on the use of particle-swarm optimization (PSO) to obtain the antecedents, consequences, and connectives of the rules. To test the feasibility of the suggested method, the inverted-pendulum problem is studied, and results are compared for two of the most extensively used methodologies in machine learning: the genetic-based Pittsburgh approach and the Q-learning-based strategy, i.e., state-action-reward-state-action (SARSA). Moreover, KASIA is analyzed as a learning strategy in fuzzy-rule-based metascheduler design for grid computing, and performance is compared with other scheduling strategies based on genetic learning and existing scheduling approaches, i.e., EASY-backfilling and ESG+local periodical search. To be more precise, simulation results prove the fact that the proposed strategy outperforms classical learning approaches in terms of final results and computational effort. Furthermore, the main advantage is the capability to control convergence and its simplicity.

[1]  Fumitoshi Matsuno,et al.  A Neuro-Fuzzy Assisted Extended Kalman Filter-Based Approach for Simultaneous Localization and Mapping (SLAM) Problems , 2007, IEEE Transactions on Fuzzy Systems.

[2]  Jennifer M. Schopf,et al.  PBS Pro: Grid computing and scheduling attributes , 2004 .

[3]  Francisco Jurado,et al.  Particle swarm optimization for biomass-fuelled systems with technical constraints , 2008, Eng. Appl. Artif. Intell..

[4]  Mahesan Niranjan,et al.  On-line Q-learning using connectionist systems , 1994 .

[5]  Luis Magdalena,et al.  Knowledge based evaluation of knowledge bases , 1999, EUSFLAT-ESTYLF Joint Conf..

[6]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[7]  Francisco Herrera,et al.  A genetic rule weighting and selection process for fuzzy control of heating, ventilating and air conditioning systems , 2005, Eng. Appl. Artif. Intell..

[8]  Carsten Franke,et al.  Development of scheduling strategies with Genetic Fuzzy systems , 2008, Appl. Soft Comput..

[9]  Nicolás Ruiz-Reyes,et al.  Audio Coding Improvement Using Evolutionary Speech/Music Discrimination , 2007, 2007 IEEE International Fuzzy Systems Conference.

[10]  Chenn-Jung Huang,et al.  Using particle swam optimization for QoS in ad-hoc multicast , 2009, Eng. Appl. Artif. Intell..

[11]  Frank Hoffmann,et al.  Incremental Evolutionary Design of TSK Fuzzy Controllers , 2007, IEEE Transactions on Fuzzy Systems.

[12]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[14]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.

[15]  T. Martin McGinnity,et al.  Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms , 2006, IEEE Transactions on Fuzzy Systems.

[16]  Leandro dos Santos Coelho,et al.  Fuzzy Identification Based on a Chaotic Particle Swarm Optimization Approach Applied to a Nonlinear Yo-yo Motion System , 2007, IEEE Transactions on Industrial Electronics.

[17]  Leandro dos Santos Coelho,et al.  Particle swarm approaches using Lozi map chaotic sequences to fuzzy modelling of an experimental thermal-vacuum system , 2008, Appl. Soft Comput..

[18]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[19]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[20]  Fatos Xhafa,et al.  Meta-heuristics for Grid Scheduling Problems , 2008 .

[21]  Khaled Belarbi,et al.  Design of Mamdani fuzzy logic controllers with rule base minimisation using genetic algorithm , 2005, Eng. Appl. Artif. Intell..

[22]  Dalibor Klusácek,et al.  Comparison Of Multi-Criteria Scheduling Techniques , 2008, CoreGRID Integration Workshop.

[23]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[24]  Mario Drobics,et al.  Creating comprehensible regression models Inductive learning and optimization of fuzzy regression trees using comprehensible fuzzy predicates , .

[25]  Roseli A. F. Romero,et al.  Incorporating fuzzy logic to reinforcement learning [mobile robot navigation] , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[26]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[27]  Francisco Herrera,et al.  Individual and Social Strategies to Deal with Ignorance Situations in Multi-Person Decision Making , 2009, Int. J. Inf. Technol. Decis. Mak..

[28]  Ronald R. Yager,et al.  Perception-based granular probabilities in risk modeling and decision making , 2006, IEEE Transactions on Fuzzy Systems.

[29]  A. J. Yuste,et al.  Evolutionary Fuzzy Scheduler for Grid Computing , 2009, IWANN.

[30]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[31]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[32]  Francisco Herrera,et al.  A Multiobjective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy-Rule-Based Systems , 2009, IEEE Transactions on Fuzzy Systems.

[33]  Hongbing Zhu,et al.  Euclidean Particle Swarm Optimization , 2009, 2009 Second International Conference on Intelligent Networks and Intelligent Systems.

[34]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[35]  A. Abraham,et al.  Scheduling jobs on computational grids using a fuzzy particle swarm optimization algorithm , 2010, Future Gener. Comput. Syst..

[36]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[37]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[38]  Lisa L. Grant,et al.  Collective robotic search using hybrid techniques: Fuzzy logic and swarm intelligence inspired by nature , 2009, Eng. Appl. Artif. Intell..

[39]  T. Hussein,et al.  Comparison between multi-band and self-tuned fuzzy power system stabilizers , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[40]  Mohammad Bagher Menhaj,et al.  A New GA-Based Real Time Controller for the Classical Cart-Pole Balancing Problem , 2004, Fuzzy Days.

[41]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[42]  Dong-ping Tian,et al.  Fuzzy Particle Swarm Optimization Algorithm , 2009, 2009 International Joint Conference on Artificial Intelligence.

[43]  Ajith Abraham,et al.  Swarm Intelligence: Foundations, Perspectives and Applications , 2006, Swarm Intelligent Systems.

[44]  Hing Kai Chan,et al.  A modified genetic algorithm approach for scheduling of perfect maintenance in distributed production scheduling , 2009, Eng. Appl. Artif. Intell..

[45]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[46]  Dalibor Klusácek,et al.  Alea - Grid Scheduling Simulation Environment , 2007, PPAM.

[47]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[48]  Dalibor Klusáček Dealing with uncertainties in Grids through the event-basedscheduling approach , 2008 .

[49]  Reza Shahnazi,et al.  PI Adaptive Fuzzy Control With Large and Fast Disturbance Rejection for a Class of Uncertain Nonlinear Systems , 2008, IEEE Transactions on Fuzzy Systems.

[50]  Rajkumar Buyya,et al.  A grid service broker for scheduling distributed data-oriented applications on global grids , 2004, MGC '04.