ARPOP: An Appetitive Reward-Based Pseudo-Outer-Product Neural Fuzzy Inference System Inspired From the Operant Conditioning of Feeding Behavior in Aplysia

Appetitive operant conditioning in Aplysia for feeding behavior via the electrical stimulation of the esophageal nerve contingently reinforces each spontaneous bite during the feeding process. This results in the acquisition of operant memory by the contingently reinforced animals. Analysis of the cellular and molecular mechanisms of the feeding motor circuitry revealed that activity-dependent neuronal modulation occurs at the interneurons that mediate feeding behaviors. This provides evidence that interneurons are possible loci of plasticity and constitute another mechanism for memory storage in addition to memory storage attributed to activity-dependent synaptic plasticity. In this paper, an associative ambiguity correction-based neuro-fuzzy network, called appetitive reward-based pseudo-outer-product-compositional rule of inference [ARPOP-CRI(S)], is trained based on an appetitive reward-based learning algorithm which is biologically inspired by the appetitive operant conditioning of the feeding behavior in Aplysia. A variant of the Hebbian learning rule called Hebbian concomitant learning is proposed as the building block in the neuro-fuzzy network learning algorithm. The proposed algorithm possesses the distinguishing features of the sequential learning algorithm. In addition, the proposed ARPOP-CRI(S) neuro-fuzzy system encodes fuzzy knowledge in the form of linguistic rules that satisfies the semantic criteria for low-level fuzzy model interpretability. ARPOP-CRI(S) is evaluated and compared against other modeling techniques using benchmark time-series datasets. Experimental results are encouraging and show that ARPOP-CRI(S) is a viable modeling technique for time-variant problem domains.

[1]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[2]  J. Byrne,et al.  More than synaptic plasticity: role of nonsynaptic plasticity in learning and memory , 2010, Trends in Neurosciences.

[3]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  Alan Boon Hwee. Teo,et al.  Development and verification of kinematic wave analytical rainfall-runoff model. , 2009 .

[6]  O. Kiehn Locomotor circuits in the mammalian spinal cord. , 2006, Annual review of neuroscience.

[7]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  M. Sugeno,et al.  ErratumFuzzy modelling and control of multilayer incinerator , 1988 .

[9]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[10]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[11]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[12]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[13]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[14]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[15]  J. Byrne,et al.  4.40 – Plasticity of Intrinsic Excitability as a Mechanism for Memory Storage , 2008 .

[16]  I. Hurwitz,et al.  B64, a newly identified central pattern generator element producing a phase switch from protraction to retraction in buccal motor programs of Aplysia californica. , 1996, Journal of neurophysiology.

[17]  Ruowei Zhou,et al.  POPFNN: A Pseudo Outer-product Based Fuzzy Neural Network , 1996, Neural Networks.

[18]  J. Moody,et al.  Performance functions and reinforcement learning for trading systems and portfolios , 1998 .

[19]  D. A. Baxter,et al.  In Vitro Analog of Operant Conditioning inAplysia. II. Modifications of the Functional Dynamics of an Identified Neuron Contribute to Motor Pattern Selection , 1999, The Journal of Neuroscience.

[20]  Feng Liu,et al.  A Novel Generic Hebbian Ordering-Based Fuzzy Rule Base Reduction Approach to Mamdani Neuro-Fuzzy System , 2007, Neural Computation.

[21]  Terrence J. Sejnowski,et al.  The Hebb Rule for Synaptic Plasticity: Algorithms and Implementations , 1989 .

[22]  Michel Pasquier,et al.  POPFNN-CRI(S): pseudo outer product based fuzzy neural network using the compositional rule of inference and singleton fuzzifier , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[24]  L. Pozzo-Miller,et al.  Activity-Dependent Structural Plasticity of Dendritic Spines , 2008 .

[25]  J. Jing,et al.  The Construction of Movement with Behavior-Specific and Behavior-Independent Modules , 2004, The Journal of Neuroscience.

[26]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[27]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[28]  Hiok Chai Quek,et al.  R-POPTVR: A Novel Reinforcement-Based POPTVR Fuzzy Neural Network for Pattern Classification , 2009, IEEE Transactions on Neural Networks.

[29]  S. Schor STATISTICS: AN INTRODUCTION. , 1965, The Journal of trauma.

[30]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[31]  T. Brown The intrinsic factors in the act of progression in the mammal , 1911 .

[32]  J. Jing,et al.  Generation of Variants of a Motor Act in a Modular and Hierarchical Motor Network , 2005, Current Biology.

[33]  Hiok Chai Quek,et al.  GenSoFNN: a generic self-organizing fuzzy neural network , 2002, IEEE Trans. Neural Networks.

[34]  D. Whitteridge Lectures on Conditioned Reflexes , 1942, Nature.

[35]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[36]  D. A. Baxter,et al.  Operant Reward Learning in Aplysia: Neuronal Correlates and Mechanisms , 2002, Science.

[37]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[38]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Sten Grillner,et al.  Biological Pattern Generation: The Cellular and Computational Logic of Networks in Motion , 2006, Neuron.

[40]  Krzysztof Cpalka,et al.  A New Method for Design and Reduction of Neuro-Fuzzy Classification Systems , 2009, IEEE Transactions on Neural Networks.

[41]  Roger E. Kirk,et al.  Statistics: An Introduction , 1998 .

[42]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[43]  Chuen-Tsai Sun,et al.  Rule-base structure identification in an adaptive-network-based fuzzy inference system , 1994, IEEE Trans. Fuzzy Syst..

[44]  J. Simmers,et al.  Cellular and Network Mechanisms of Operant Learning-Induced Compulsive Behavior in Aplysia , 2009, Current Biology.

[45]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[46]  Ruowei Zhou,et al.  The POP learning algorithms: reducing work in identifying fuzzy rules , 2001, Neural Networks.

[47]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[48]  Bartlett W. Mel,et al.  Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue , 2001, Neuron.

[49]  Kai Keng Ang POPFNN-CRI(S) : a fuzzy neural network based on the compositional rule of inference , 1998 .

[50]  W. Pedrycz Why triangular membership functions , 1994 .

[51]  J. Buckley,et al.  Fuzzy expert systems and fuzzy reasoning , 2004 .

[52]  Ken Lukowiak,et al.  Associative learning and memory in Lymnaea stagnalis: how well do they remember? , 2003, Journal of Experimental Biology.

[53]  J. Born,et al.  Maintaining memories by reactivation , 2007, Current Opinion in Neurobiology.

[54]  Luis Magdalena,et al.  Interpretability Improvements to Find the Balance Interpretability-Accuracy in Fuzzy Modeling: An Overview , 2003 .

[55]  J. Byrne Learning and memory : a comprehensive reference , 2008 .

[56]  Ruowei Zhou,et al.  POPFNN-AAR(S): a pseudo outer-product based fuzzy neural network , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[57]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[58]  Richard L. Huganir,et al.  Activity-Dependent Dendritic Spine Structural Plasticity Is Regulated by Small GTPase Rap1 and Its Target AF-6 , 2005, Neuron.

[59]  James J. Buckley,et al.  Fuzzy Expert Systems and Fuzzy Reasoning: Siler/Fuzzy Expert Systems , 2004 .

[60]  Hiok Chai Quek,et al.  A Novel Blood Glucose Regulation Using TSK$^{0}$-FCMAC: A Fuzzy CMAC Based on the Zero-Ordered TSK Fuzzy Inference Scheme , 2009, IEEE Transactions on Neural Networks.

[61]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[62]  Eric R Kandel,et al.  The Biology of Memory: A Forty-Year Perspective , 2009, The Journal of Neuroscience.

[63]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[64]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[65]  Ted Abel,et al.  Molecular mechanisms of memory acquisition, consolidation and retrieval , 2001, Current Opinion in Neurobiology.

[66]  Elena B. Pasquale,et al.  Molecular mechanisms of dendritic spine development and remodeling , 2005, Progress in Neurobiology.

[67]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[68]  Chia-Feng Juang,et al.  An adaptive neural fuzzy filter and its applications , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[69]  Michel Pasquier,et al.  POP-TRAFFIC: a novel fuzzy neural approach to road traffic analysis and prediction , 2006, IEEE Transactions on Intelligent Transportation Systems.

[70]  D. A. Baxter,et al.  Feeding behavior of Aplysia: a model system for comparing cellular mechanisms of classical and operant conditioning. , 2006, Learning & memory.

[71]  D. A. Baxter,et al.  In Vitro Analog of Operant Conditioning inAplysia. I. Contingent Reinforcement Modifies the Functional Dynamics of an Identified Neuron , 1999, The Journal of Neuroscience.

[72]  P. J. Andres-Barquin,et al.  Ramón y Cajal: a century after the publication of his masterpiece. , 2001, Endeavour.

[73]  S. J. Martin,et al.  New life in an old idea: The synaptic plasticity and memory hypothesis revisited , 2002, Hippocampus.

[74]  Hiok Chai Quek,et al.  ACPOP: Ambiguity correction-based pseudo-outer-product fuzzy rule identification algorithm , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[75]  B. Roche,et al.  The Behavior of Organisms? , 1997 .

[76]  Jonathan L. C. Lee Reconsolidation: maintaining memory relevance , 2009, Trends in Neurosciences.

[77]  Kai Keng Ang,et al.  RSPOP: Rough SetBased Pseudo Outer-Product Fuzzy Rule Identification Algorithm , 2005, Neural Computation.

[78]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[79]  W. Brown Animal Intelligence: Experimental Studies , 1912, Nature.

[80]  E. Cropper,et al.  Proprioceptive Input to Feeding Motor Programs inAplysia , 1998, The Journal of Neuroscience.

[81]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[82]  Hiok Chai Quek,et al.  POP-Yager: a novel self-organizing fuzzy neural network based on the Yager inference , 2000, SPIE Optics + Photonics.

[83]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..