An Interval Type-2 Neural Fuzzy Chip With On-Chip Incremental Learning Ability for Time-Varying Data Sequence Prediction and System Control

This paper proposes a new circuit to implement a Mamdani-type interval type-2 neural fuzzy chip with on-chip incremental learning ability (IT2NFC-OL) for applications in changing environments. Traditional interval type-2 fuzzy systems use an iterative procedure to find the system outputs, which is computationally expensive, especially for hardware implementation. To address this problem, the IT2NFC-OL uses a simplified type reduction operation to reduce the hardware implementation cost without degrading the learning performance. The software-implemented IT2NFC-OL is characterized by online structure learning and parameter learning using a gradient descent algorithm. The learned fuzzy model is then implemented in a field-programmable gate array (FPGA) chip. The FPGA-implemented IT2NFC-OL performs not only fuzzy inference but also online consequent parameter learning for applications in changing environments. Novel circuits for the computation of system outputs and the update of interval consequent values are proposed. The learning performance of the software-implemented IT2NFC-OL and the on-chip learning ability are verified with applications to time-varying data sequence prediction and system control problems and by comparisons with different software-implemented type-1 and type-2 neural fuzzy systems and interval type-2 fuzzy chips.

[1]  Yoshiyasu Takefuji,et al.  Implementing fuzzy rule-based systems on silicon chips , 1990, IEEE Expert.

[2]  J.L. Grantner,et al.  Digital fuzzy logic controller: design and implementation , 1996, IEEE Trans. Fuzzy Syst..

[3]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[4]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[5]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[6]  Vincenzo Catania,et al.  VLSI hardware architecture for complex fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[7]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[8]  Jerry M. Mendel,et al.  Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters , 2000, IEEE Trans. Fuzzy Syst..

[9]  Valentina Salapura,et al.  A fuzzy RISC processor , 2000, IEEE Trans. Fuzzy Syst..

[10]  Jer-Min Jou,et al.  An adaptive fuzzy logic controller: its VLSI architecture and applications , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[11]  Bogdan M. Wilamowski,et al.  Implementing a fuzzy system on a field programmable gate array , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[12]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[13]  Jerry M. Mendel,et al.  Uncertainty bounds and their use in the design of interval type-2 fuzzy logic systems , 2002, IEEE Trans. Fuzzy Syst..

[14]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[16]  Antonio García,et al.  Pro-Two: a hardware based platform for real time type-2 fuzzy inference , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[17]  Chia-Feng Juang,et al.  Temperature control by chip-implemented adaptive recurrent fuzzy controller designed by evolutionary algorithm , 2005, IEEE Trans. Circuits Syst. I Regul. Pap..

[18]  Dongrui Wu,et al.  Computationally Efficient Type-Reduction Strategies for a Type-2 Fuzzy Logic Controller , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[19]  Shih-Hsu Huang,et al.  VLSI implementation of type-2 fuzzy inference processor , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[20]  Yew-Soon Ong,et al.  A context switchable fuzzy inference chip , 2006, IEEE Transactions on Fuzzy Systems.

[21]  Chia-Feng Juang,et al.  Water bath temperature control by a recurrent fuzzy controller and its FPGA implementation , 2006, IEEE Transactions on Industrial Electronics.

[22]  J. M. Tarela,et al.  Digital Gaussian membership function circuit for neuro-fuzzy hardware , 2006 .

[23]  I. Burhan Türksen,et al.  Discrete Interval Type 2 Fuzzy System Models Using Uncertainty in Learning Parameters , 2007, IEEE Transactions on Fuzzy Systems.

[24]  C.A. Pena-Reyes,et al.  Implementing Interval Type-2 Fuzzy Processors [Developmental Tools] , 2007, IEEE Computational Intelligence Magazine.

[25]  Robert Ivor John,et al.  Geometric Type-1 and Type-2 Fuzzy Logic Systems , 2007, IEEE Transactions on Fuzzy Systems.

[26]  Iluminada Baturone,et al.  FPGA Implementation of Embedded Fuzzy Controllers for Robotic Applications , 2007, IEEE Transactions on Industrial Electronics.

[27]  Chia-Feng Juang,et al.  A Type-2 Self-Organizing Neural Fuzzy System and Its FPGA Implementation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Javier Echanobe,et al.  Efficient Hardware/Software Implementation of an Adaptive Neuro-Fuzzy System , 2008, IEEE Transactions on Fuzzy Systems.

[29]  Wen Yu,et al.  Hierarchical Fuzzy CMAC for Nonlinear Systems Modeling , 2008, IEEE Transactions on Fuzzy Systems.

[30]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[31]  Oscar Castillo,et al.  A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks , 2009, Inf. Sci..

[32]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[33]  Chia-Feng Juang,et al.  Reinforcement Ant Optimized Fuzzy Controller for Mobile-Robot Wall-Following Control , 2009, IEEE Transactions on Industrial Electronics.

[34]  Oscar Castillo,et al.  Modeling and Simulation of the Defuzzification Stage of a Type-2 Fuzzy Controller Using the Xilinx System Generator and Simulink , 2009, Evolutionary Design of Intelligent Systems in Modeling, Simulation and Control.

[35]  Chia-Feng Juang,et al.  Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[36]  Okyay Kaynak,et al.  Type 2 Fuzzy Neural Structure for Identification and Control of Time-Varying Plants , 2010, IEEE Transactions on Industrial Electronics.

[37]  Indre Zliobaite,et al.  Learning under Concept Drift: an Overview , 2010, ArXiv.

[38]  Hiok Chai Quek,et al.  eFSM—A Novel Online Neural-Fuzzy Semantic Memory Model , 2010, IEEE Transactions on Neural Networks.

[39]  Plamen P. Angelov,et al.  Uniformly Stable Backpropagation Algorithm to Train a Feedforward Neural Network , 2011, IEEE Transactions on Neural Networks.

[40]  Shyi-Ming Chen,et al.  Weighted Fuzzy Rule Interpolation Based on GA-Based Weight-Learning Techniques , 2011, IEEE Transactions on Fuzzy Systems.

[41]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.

[42]  Xuemei Ren,et al.  Identification of Extended Hammerstein Systems Using Dynamic Self-Optimizing Neural Networks , 2011, IEEE Transactions on Neural Networks.

[43]  Türkay Dereli,et al.  Industrial applications of type-2 fuzzy sets and systems: A concise review , 2011, Comput. Ind..

[44]  Chia-Feng Juang,et al.  An incremental support vector machine-trained TS-type fuzzy system for online classification problems , 2011, Fuzzy Sets Syst..

[45]  Oscar Castillo,et al.  Embedding a Fuzzy Locomotion Pose Controller for a Wheeled Mobile Robot into an FPGA , 2011, Soft Computing for Intelligent Control and Mobile Robotics.

[46]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[47]  Oscar Castillo,et al.  Embedding a high speed interval type-2 fuzzy controller for a real plant into an FPGA , 2012, Appl. Soft Comput..

[48]  Oscar Castillo,et al.  An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms , 2012, Expert Syst. Appl..

[49]  Wei Wu,et al.  Boundedness and convergence of batch back-propagation algorithm with penalty for feedforward neural networks , 2012, Neurocomputing.

[50]  Oscar Castillo,et al.  A review on the design and optimization of interval type-2 fuzzy controllers , 2012, Appl. Soft Comput..

[51]  Fevrier Valdez,et al.  Comparative study of bio-inspired algorithms applied to the optimization of type-1 and type-2 fuzzy controllers for an autonomous mobile robot , 2012, Inf. Sci..

[52]  Francisco Escolano,et al.  Entropy-Based Incremental Variational Bayes Learning of Gaussian Mixtures , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Arash Miranian,et al.  Developing a Local Least-Squares Support Vector Machines-Based Neuro-Fuzzy Model for Nonlinear and Chaotic Time Series Prediction , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[55]  Chia-Feng Juang,et al.  Evolutionary Robot Wall-Following Control Using Type-2 Fuzzy Controller With Species-DE-Activated Continuous ACO , 2013, IEEE Transactions on Fuzzy Systems.