Network-based Type-2 Fuzzy System with Water Flow Like Algorithm for System Identification and Signal Processing

This paper introduces a network-based interval type-2 fuzzy inference system (NT2FIS) with a dynamic solution agent algorithm water flow like algorithm (WFA), for nonlinear system identification and blind source separation (BSS) problem. The NT2FIS consists of interval type-2 asymmetric fuzzy membership functions and TSK-type consequent parts to enhance the performance. The proposed scheme is optimized by a new heuristic learning algorithm, WFA, with dynamic solution agents. The proposed WFA is inspired by the natural behavior of water flow. Splitting, moving, merging, evaporation, and precipitation have all been introduced for optimization. Some modifications, including new moving strategies, such as the application of tabu searching and gradient-descent techniques, are proposed to enhance the performance of the WFA in training the NT2FIS systems. Simulation and comparison results for nonlinear system identification and blind signal separation are presented to illustrate the performance and effectiveness of the proposed approach.

[1]  J. Mendel.  Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[2]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[3]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[4]  Shang-Jeng Tsai,et al.  Blind separation with unknown number of sources based on auto-trimmed neural network , 2008, Neurocomputing.

[5]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[6]  Witold Pedrycz,et al.  Design of interval type-2 fuzzy models through optimal granularity allocation , 2011, Appl. Soft Comput..

[7]  Krzysztof Cpalka,et al.  A New Method for Design and Reduction of Neuro-Fuzzy Classification Systems , 2009, IEEE Transactions on Neural Networks.

[8]  Ching-Hung Lee,et al.  Stabilization of nonlinear nonminimum phase systems: adaptive parallel approach using recurrent fuzzy neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Ching-Hung Lee,et al.  A species-based improved electromagnetism-like mechanism algorithm for TSK-type interval-valued neural fuzzy system optimization , 2011, Fuzzy Sets Syst..

[10]  P. Siarry,et al.  FITTING OF TABU SEARCH TO OPTIMIZE FUNCTIONS OF CONTINUOUS VARIABLES , 1997 .

[11]  Chih-Min Lin,et al.  Supervisory recurrent fuzzy neural network control of wing rock for slender delta wings , 2004, IEEE Trans. Fuzzy Syst..

[12]  Oscar Castillo,et al.  A New Method for Adaptive Control of Non-Linear Plants Using Type-2 Fuzzy Logic and Neural Networks , 2002, Int. J. Gen. Syst..

[13]  Oscar Castillo,et al.  Face Recognition With an Improved Interval Type-2 Fuzzy Logic Sugeno Integral and Modular Neural Networks , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[15]  Po-Lei Lee,et al.  Implementation of Pipelined FastICA on FPGA for Real-Time Blind Source Separation , 2008, IEEE Transactions on Neural Networks.

[16]  Frank Hoffmann,et al.  Incremental Evolutionary Design of TSK Fuzzy Controllers , 2007, IEEE Transactions on Fuzzy Systems.

[17]  Tai-Hsi Wu,et al.  A water flow-like algorithm for manufacturing cell formation problems , 2010, Eur. J. Oper. Res..

[18]  Germano Lambert-Torres,et al.  A genetic-based neuro-fuzzy approach for modeling and control of dynamical systems , 1998, IEEE Trans. Neural Networks.

[19]  S.C. Douglas,et al.  Adaptive step size techniques for decorrelation and blind source separation , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[20]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[21]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[22]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[23]  Feng-Cheng Yang,et al.  WATER FLOW-LIKE ALGORITHM FOR OBJECT GROUPING PROBLEMS , 2007 .

[24]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[25]  Jerry M. Mendel,et al.  On the importance of interval sets in type-2 fuzzy logic systems , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[26]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[27]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[28]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[30]  Oscar Castillo,et al.  Adaptive noise cancellation using type-2 fuzzy logic and neural networks , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[31]  Ching-Hung Lee,et al.  Performance enhancement for neural fuzzy systems using asymmetric membership functions , 2009, Fuzzy Sets Syst..

[32]  James V. Stone.  Independent Component Analysis: A Tutorial Introduction , 2007 .

[33]  E. Oja,et al.  Independent Component Analysis , 2013 .

[34]  Shun-Tian Lou,et al.  Fuzzy-based learning rate determination for blind source separation , 2003, IEEE Trans. Fuzzy Syst..

[35]  Oscar Castillo,et al.  An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms , 2012, Expert Syst. Appl..

[36]  Patrick Siarry,et al.  Tabu Search applied to global optimization , 2000, Eur. J. Oper. Res..

[37]  Ching-Hung Lee,et al.  Nonlinear systems design by a novel fuzzy neural system via hybridization of electromagnetism-like mechanism and particle swarm optimisation algorithms , 2012, Inf. Sci..

[38]  Oscar Castillo,et al.  A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks , 2009, Inf. Sci..

[39]  Elmar Wolfgang Lang,et al.  Blind source separation and independent component analysis , 2006, Neurocomputing.

[40]  Tsung-Ying Sun,et al.  Effective Learning Rate Adjustment of Blind Source Separation Based on an Improved Particle Swarm Optimizer , 2008, IEEE Transactions on Evolutionary Computation.

[41]  Oscar Castillo,et al.  Optimization of type-2 fuzzy systems based on bio-inspired methods: A concise review , 2012, Inf. Sci..

[42]  N. N. Karnik,et al.  Introduction to type-2 fuzzy logic systems , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[43]  Ching-Hung Lee,et al.  A hybrid of electromagnetism-like mechanism and back-propagation algorithms for recurrent neural fuzzy systems design , 2012, Int. J. Syst. Sci..