A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

This survey samples from the ever-growing family of adaptive resonance theory (ART) neural network models used to perform the three primary machine learning modalities, namely, unsupervised, supervised and reinforcement learning. It comprises a representative list from classic to contemporary ART models, thereby painting a general picture of the architectures developed by researchers over the past 30 years. The learning dynamics of these ART models are briefly described, and their distinctive characteristics such as code representation, long-term memory, and corresponding geometric interpretation are discussed. Useful engineering properties of ART (speed, configurability, explainability, parallelization and hardware implementation) are examined along with current challenges. Finally, a compilation of online software libraries is provided. It is expected that this overview will be helpful to new and seasoned ART researchers.

[1]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[2]  Michael Georgiopoulos,et al.  Convergence Properties of Learning in ART1 , 1990, Neural Computation.

[3]  Dong Xu,et al.  Semi-Supervised Heterogeneous Fusion for Multimedia Data Co-Clustering , 2014, IEEE Transactions on Knowledge and Data Engineering.

[4]  Chee Peng Lim,et al.  Art-Based Autonomous Learning Systems: Part I — Architectures and Algorithms , 2000 .

[5]  Ah-Hwee Tan,et al.  Adaptive Resonance Theory in Social Media Data Clustering , 2019, Advanced Information and Knowledge Processing.

[6]  Jong-Hwan Kim,et al.  Developmental Resonance Network , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Gail A. Carpenter,et al.  Distributed ARTMAP: a neural network for fast distributed supervised learning , 1998, Neural Networks.

[8]  Ah-Hwee Tan,et al.  Creating Autonomous Adaptive Agents in a Real-Time First-Person Shooter Computer Game , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[9]  Chee Peng Lim,et al.  Modified Fuzzy ARTMAP Approaches Bayes Optimal Classification Rates: An Empirical Demonstration , 1997, Neural Networks.

[10]  Yannis A. Dimitriadis,et al.  Artmap: Use of Mutual Information for Category Reduction in Fuzzy Artmap , 2002 .

[11]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[12]  G. Bartfai,et al.  Hierarchical clustering with ART neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[13]  Donald C. Wunsch,et al.  Dual vigilance fuzzy adaptive resonance theory , 2019, Neural Networks.

[14]  Hugo Guterman,et al.  Advanced Developments and Applications of the Fuzzy ARTMAP Neural Network in Pattern Classification , 2008, Computational Intelligence Paradigms.

[15]  Hongbing Ji,et al.  TPPFAM: Use of threshold and posterior probability for category reduction in fuzzy ARTMAP , 2014, Neurocomputing.

[16]  M. J. Healy,et al.  Episodic memory: A hierarchy of spatiotemporal concepts , 2019, Neural Networks.

[17]  Ah-Hwee Tan,et al.  Adaptive Scaling of Cluster Boundaries for Large-Scale Social Media Data Clustering , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Senén Barro,et al.  Polytope ARTMAP: Pattern Classification Without Vigilance Based on General Geometry Categories , 2007, IEEE Transactions on Neural Networks.

[19]  Michael Georgiopoulos,et al.  Order of Search in Fuzzy ART and Fuzzy ARTMAP: Effect of the Choice Parameter , 1996, Neural Networks.

[20]  B. Moore,et al.  ART1 and pattern clustering , 1989 .

[21]  Gail A. Carpenter,et al.  ART-EMAP: A neural network architecture for object recognition by evidence accumulation , 1995, IEEE Trans. Neural Networks.

[22]  R. Schapire.  The Strength of Weak Learnability , 1990, Machine Learning.

[23]  Chee Peng Lim,et al.  An enhanced generalized adaptive resonance theory neural network and its application to medical pattern classification , 2010, J. Intell. Fuzzy Syst..

[24]  Andreas G. Andreou,et al.  Adaptive Resonance Theory Microchips: Circuit Design Techniques , 2012 .

[25]  Yoshifumi Nishio,et al.  Fuzzy Adaptive Resonance Theory with Group Learning and its Applications , 2007 .

[26]  Ah-Hwee Tan,et al.  Vigilance adaptation in adaptive resonance theory , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[27]  Michael Georgiopoulos,et al.  Fuzzy ART properties , 1995, Neural Networks.

[28]  Ajalmar R. da Rocha Neto,et al.  Opposite-to-Noise ARTMAP Neural Network , 2017, IWANN.

[29]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[30]  Nor Ashidi Mat Isa,et al.  Feature-Based Ordering Algorithm for Data Presentation of Fuzzy ARTMAP Ensembles , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Yvon Savaria,et al.  Generalization, discrimination, and multiple categorization using adaptive resonance theory , 1999, IEEE Trans. Neural Networks.

[32]  Thomas P. Caudell,et al.  A neural architecture for pattern sequence verification through inferencing , 1993, IEEE Trans. Neural Networks.

[33]  Donald C. Wunsch,et al.  Unified Computational Intelligence for Complex Systems , 2010 .

[34]  Donald C. Wunsch,et al.  Validity index-based vigilance test in adaptive resonance theory neural networks , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[35]  Pierre Lavoie,et al.  Choosing a choice function: granting new capabilities to ART , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[36]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[37]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[38]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[39]  T P Caudell,et al.  Hybrid optoelectronic adaptive resonance theory neural processor, ART1. , 1992, Applied optics.

[40]  Robert Kozma,et al.  Adaptive Resonance Theory Design in Mixed Memristive-Fuzzy Hardware , 2012 .

[41]  Donald C. Wunsch,et al.  Information Fusion and Situation Awareness using ARTMAP and Partially Observable Markov Decision Processes , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[42]  Le Song,et al.  Kernel Bayes' rule: Bayesian inference with positive definite kernels , 2013, J. Mach. Learn. Res..

[43]  Jeong Su Lee,et al.  Learning method for fuzzy ARTMAP in a noisy environment , 1998 .

[44]  Daniel R. Tauritz,et al.  Nested monte carlo search expression discovery for the automated design of fuzzy ART category choice functions , 2019, GECCO.

[45]  J. Hannan,et al.  Introduction to probability and mathematical statistics , 1986 .

[46]  Razvan Andonie,et al.  Function Approximation with ARTMAP Architectures , 2014, Int. J. Comput. Commun. Control.

[47]  Donald C. Wunsch,et al.  Clustering Data of Mixed Categorical and Numerical Type With Unsupervised Feature Learning , 2015, IEEE Access.

[48]  Marko Tscherepanow,et al.  An Incremental On-line Classifier for Imbalanced, Incomplete, and Noisy Data , 2012 .

[49]  Shawn E. Taylor,et al.  Applying category theory to improve the performance of a neural architecture , 2009, Neurocomputing.

[50]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[51]  Ah-Hwee Tan,et al.  Self-Organizing Neural Architectures and Cooperative Learning in a Multiagent Environment , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[52]  Gail A. Carpenter,et al.  Self-supervised ARTMAP , 2010, Neural Networks.

[53]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[54]  Y.A. Dimitriadis,et al.  Safe-/spl mu/ARTMAP: a new solution for reducing category proliferation in fuzzy ARTMAP , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[55]  J. A. Swope,et al.  ARTdECOS, adaptive evolving connectionist model and application to heart rate variability , 2012, Evolving Systems.

[56]  Yannis Dimitriadis,et al.  Fasart: A New Neuro-Fuzzy Architecture for Incremental Learning in System Identification , 1996 .

[57]  Razvan Andonie,et al.  Bayesian ARTMAP for regression , 2013, Neural Networks.

[58]  Razvan Andonie.  A converse H-theorem for inductive processes , 1990 .

[59]  Matthias Blume,et al.  Fuzzy Artmap Modifications for Intersecting Class Distributions , 2000 .

[60]  Gregory L. Heileman,et al.  Rademacher penalization applied to fuzzy ARTMAP and boosted ARTMAP , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[61]  Marko Tscherepanow,et al.  A hierarchical ART network for the stable incremental learning of topological structures and associations from noisy data , 2011, Neural Networks.

[62]  Gail A Carpenter,et al.  Looking to the future: Learning from experience, averting catastrophe , 2019, Neural Networks.

[63]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[64]  Bernabé Linares-Barranco,et al.  A Modified ART 1 Algorithm more Suitable for VLSI Implementations , 1996, Neural Networks.

[65]  Ah-Hwee Tan,et al.  Integrating Temporal Difference Methods and Self-Organizing Neural Networks for Reinforcement Learning With Delayed Evaluative Feedback , 2008, IEEE Transactions on Neural Networks.

[66]  Ah-Hwee Tan,et al.  A self-organizing neural architecture integrating desire, intention and reinforcement learning , 2010, Neurocomputing.

[67]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[68]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[69]  Georgios C. Anagnostopoulos,et al.  Cross-validation in Fuzzy ARTMAP for large databases , 2001, Neural Networks.

[70]  Gail A. Carpenter,et al.  Default ARTMAP 2 , 2007, 2007 International Joint Conference on Neural Networks.

[71]  Robert F. Harrison,et al.  A modified fuzzy ARTMAP architecture for the approximation of noisy mappings , 1995, Neural Networks.

[72]  Naoyuki Kubota,et al.  Multi-channel Bayesian Adaptive Resonance Associate Memory for on-line topological map building , 2016, Appl. Soft Comput..

[73]  Wenwen Wang,et al.  Neural Modeling of Episodic Memory: Encoding, Retrieval, and Forgetting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[74]  Vladimir Koltchinskii,et al.  Rademacher penalties and structural risk minimization , 2001, IEEE Trans. Inf. Theory.

[75]  Gail A. Carpenter,et al.  Biased ART: A neural architecture that shifts attention toward previously disregarded features following an incorrect prediction , 2010, Neural Networks.

[76]  Gail A. Carpenter,et al.  A distributed outstar network for spatial pattern learning , 1994, Neural Networks.

[77]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[78]  Alysson Ribeiro da Silva,et al.  HearthBot: An Autonomous Agent Based on Fuzzy ART Adaptive Neural Networks for the Digital Collectible Card Game HearthStone , 2018, IEEE Transactions on Games.

[79]  Martial Mermillod,et al.  The stability-plasticity dilemma: investigating the continuum from catastrophic forgetting to age-limited learning effects , 2013, Front. Psychol..

[80]  Francisco Javier Díaz Pernas,et al.  Fuzzy ART Neural Network Parallel Computing on the GPU , 2007, IWANN.

[81]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[82]  Michael Georgiopoulos,et al.  The N-N-N conjecture in ART1 , 1992, Neural Networks.

[83]  Michael Anderson,et al.  NIRS: Large scale ART-1 neural architectures for engineering design retrieval , 1994, Neural Networks.

[84]  Min Han,et al.  Semi-supervised Bayesian ARTMAP , 2010, Applied Intelligence.

[85]  Valeriu Beiu,et al.  A Modified Fuzzy ARTMAP Architecture for Incremental Learning Function Approximation , 2003, Neural Networks and Computational Intelligence.

[86]  G. Carpenter.  Default ARTMAP , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[87]  Ramaswamy Palaniappan,et al.  Using genetic algorithm to select the presentation order of training patterns that improves simplified fuzzy ARTMAP classification performance , 2009, Appl. Soft Comput..

[88]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[89]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[90]  R. White,et al.  Incremental Learning and Optimization of Hierarchical Clusterings with Art-Based Modular Networks , 2000 .

[91]  T. Cacoullos.  Estimation of a multivariate density , 1966 .

[92]  Michael Georgiopoulos,et al.  Boosted ARTMAP , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[93]  Donald E. Knuth,et al.  backus normal form vs. Backus Naur form , 1964, CACM.

[94]  Georgios C. Anagnostopoulos,et al.  Off-line structural risk minimization and BARTMAP-S , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[95]  Marko Tscherepanow,et al.  An Extended TopoART Network for the Stable On-line Learning of Regression Functions , 2011, ICONIP.

[96]  Yoshifumi Nishio,et al.  Fuzzy Adaptive Resonance Theory Combining Overlapped Category in consideration of connections , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[97]  Gail A. Carpenter.  Distributed ART Networks for Learning, Recognition, and Prediction , 1996 .

[98]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[99]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[100]  Donald C. Wunsch,et al.  ART properties of interest in engineering applications , 2009, 2009 International Joint Conference on Neural Networks.

[101]  Gail A. Carpenter,et al.  Distributed Learning, Recognition, and Prediction by ART and ARTMAP Neural Networks , 1997, Neural Networks.

[102]  Marko Tscherepanow,et al.  Episodic Clustering of Data Streams Using a Topology-Learning Neural Network , 2012 .

[103]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[104]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[105]  Michael Georgiopoulos,et al.  Properties of learning related to pattern diversity in ART1 , 1991, Neural Networks.

[106]  G. Bartfai,et al.  A fuzzy ART-based modular neuro-fuzzy architecture for learning hierarchical clusterings , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[107]  Wenwen Wang,et al.  Memory formation, consolidation, and forgetting in learning agents , 2012, AAMAS.

[108]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[109]  David G. Stork,et al.  Pattern Classification , 1973 .

[110]  Chu Kiong Loo,et al.  A Kernel Bayesian Adaptive Resonance Theory with A Topological Structure , 2019, Int. J. Neural Syst..

[111]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[112]  Louis Massey.  Discovery of hierarchical thematic structure in text collections with adaptive resonance theory , 2008, Neural Computing and Applications.

[113]  Ah-Hwee Tan,et al.  Adaptive resonance associative map , 1995, Neural Networks.

[114]  Ah-Hwee Tan,et al.  A hybrid agent architecture integrating desire, intention and reinforcement learning , 2011, Expert Syst. Appl..

[115]  S. Grossberg.  Some Networks That Can Learn, Remember, and Reproduce any Number of Complicated Space-Time Patterns, I , 1969 .

[116]  Daniel R. Tauritz,et al.  Evolutionary computation for the automated design of category functions for fuzzy ART: an initial exploration , 2017, GECCO.

[117]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[118]  Mansooreh Mollaghasemi,et al.  AG-ART: An adaptive approach to evolving ART architectures , 2009, Neurocomputing.

[119]  Ah-Hwee Tan,et al.  iFALCON: A neural architecture for hierarchical planning , 2012, Neurocomputing.

[120]  Donald Wunsch,et al.  Particle Swarm Optimization in an adaptive resonance framework , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[121]  Mu-Chun Su,et al.  A novel class of neural networks with quadratic junctions , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[122]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[123]  CHEE PENG LIM,et al.  An Incremental Adaptive Network for On-line Supervised Learning and Probability Estimation , 1997, Neural Networks.

[124]  Michael Georgiopoulos,et al.  The N-N-N conjecture in ART1 , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[125]  Yannis Dimitriadis,et al.  FasBack: matching-error based learning for automatic generation of fuzzy logic systems , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[126]  Ke-Lin Du,et al.  Clustering: A neural network approach , 2010, Neural Networks.

[127]  Chee Peng Lim,et al.  A review of online learning in supervised neural networks , 2014, Neural Computing and Applications.

[128]  Georgios C. Anagnostopoulos,et al.  Ellipsoid ART and ARTMAP for incremental unsupervised and supervised learning , 2001, SPIE Defense + Commercial Sensing.

[129]  Marko Tscherepanow,et al.  Incremental On-line Clustering with a Topology-Learning Hierarchical ART Neural Network Using Hyperspherical Categories , 2012, ICDM.

[130]  Ah-Hwee Tan,et al.  Creating Human-like Autonomous Players in Real-time First Person Shooter Computer Games , 2009 .

[131]  Ah-Hwee Tan,et al.  FALCON: a fusion architecture for learning, cognition, and navigation , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[132]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[133]  Y. Nishio,et al.  Fuzzy ART Combining Overlapped Categories Using Variable Vigilance Parameters , 2009 .

[134]  Yannis A. Dimitriadis,et al.  MicroARTMAP: use of mutual information for category reduction in fuzzy ARTMAP , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[135]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[136]  Yannis A. Dimitriadis,et al.  Learning from noisy information in FasArt and FasBack neuro-fuzzy systems , 2001, Neural Networks.

[137]  D. Levine.  Introduction to Neural and Cognitive Modeling , 2018 .

[138]  Stephen Grossberg,et al.  Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes , 2004, Kybernetik.

[139]  Georgios C. Anagnostopoulos,et al.  Universal approximation with Fuzzy ART and Fuzzy ARTMAP , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[140]  Mu-Chun Su,et al.  A hierarchical approach to ART-like clustering algorithm , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[141]  Thomas P. Caudell,et al.  Guaranteed two-pass convergence for supervised and inferential learning , 1998, IEEE Trans. Neural Networks.

[142]  Peter C. M. Molenaar,et al.  Exact ART: A Complete Implementation of an ART Network , 1997, Neural Networks.

[143]  Rui Xu,et al.  BARTMAP: A viable structure for biclustering , 2011, Neural Networks.

[144]  Gail A. Carpenter,et al.  Fuzzy ART Choice Functions , 1993 .

[145]  Stephen Grossberg,et al.  ART 2-A: An adaptive resonance algorithm for rapid category learning and recognition , 1991, Neural Networks.

[146]  Yannis A. Dimitriadis,et al.  Study of distributed learning as a solution to category proliferation in Fuzzy ARTMAP based neural systems , 2003, Neural Networks.

[147]  Yannis Dimitriadis,et al.  ART-Based Model Set for Pattern Recognition: FasArt Family , 2000 .

[148]  Guszti Bartfai,et al.  An ART-based modular architecture for learning hierarchical clusterings , 1996, Neurocomputing.

[149]  Jauwairia Nasir,et al.  User Preference-Based Dual-Memory Neural Model With Memory Consolidation Approach , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[150]  Francisco Javier Díaz Pernas,et al.  Fuzzy ARTMAP Based Neural Networks on the GPU for High-Performance Pattern Recognition , 2011, IWINAC.

[151]  P. K. Simpson,et al.  Fuzzy min-max neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[152]  Yvon Savaria,et al.  A comparison of self-organizing neural networks for fast clustering of radar pulses , 1998, Signal Process..

[153]  S. Grossberg,et al.  ART 2: self-organization of stable category recognition codes for analog input patterns. , 1987, Applied optics.

[154]  Gail A. Carpenter,et al.  Distributed Activation, Search, and Learning by ART and ARTMAP Neural Networks , 1996 .

[155]  Lei Meng,et al.  Self-organizing neural networks for universal learning and multimodal memory encoding , 2019, Neural Networks.

[156]  Donald C. Wunsch,et al.  A GPU based Parallel Hierarchical Fuzzy ART clustering , 2011, The 2011 International Joint Conference on Neural Networks.

[157]  Wenwen Wang,et al.  Semantic Memory Modeling and Memory Interaction in Learning Agents , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[158]  J. Manuel Cano Izquierdo,et al.  dFasArt: Dynamic neural processing in FasArt model , 2009, Neural Networks.

[159]  Thomas P. Caudell,et al.  Ontologies and Worlds in Category Theory: Implications for Neural Systems , 2006 .

[160]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[161]  Euntai Kim,et al.  An efficient genetic selection of the presentation order in simplified fuzzy ARTMAP patterns , 2014, Appl. Soft Comput..

[162]  Chee Peng Lim,et al.  An online pruning strategy for supervised ARTMAP-based neural networks , 2009, Neural Computing and Applications.

[163]  Razvan Andonie,et al.  A Fuzzy ARTMAP Probability Estimator with Relevance Factor , 2003, ESANN.

[164]  Edwin Lughofer,et al.  Extensions of vector quantization for incremental clustering , 2008, Pattern Recognit..

[165]  Donald C. Wunsch,et al.  A study on exploiting VAT to mitigate ordering effects in Fuzzy ART , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[166]  Ah-Hwee Tan,et al.  Cascade ARTMAP: integrating neural computation and symbolic knowledge processing , 1997, IEEE Trans. Neural Networks.

[167]  Ah-Hwee Tan,et al.  Self-organizing Neural Architecture for Reinforcement Learning , 2006, ISNN.

[168]  Georgios C. Anagnostopoulos,et al.  Category regions as new geometrical concepts in Fuzzy-ART and Fuzzy-ARTMAP , 2002, Neural Networks.

[169]  Chee Peng Lim,et al.  A Hybrid Art-grnn Online Learning Neural Network with a -insensitive Loss Function , 2022 .

[170]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[171]  Chu Kiong Loo,et al.  Semi-supervised topo-Bayesian ARTMAP for noisy data , 2018, Appl. Soft Comput..

[172]  Ajalmar R. da Rocha Neto,et al.  OnARTMAP: A Fuzzy ARTMAP-based Architecture , 2018, Neural Networks.

[173]  Bart Kosko,et al.  Fuzzy entropy and conditioning , 1986, Inf. Sci..

[174]  Mu-Chun Su,et al.  Application of neural networks in cluster analysis , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[175]  Sejun Kim.  Novel approaches to clustering, biclustering algorithms based on adaptive resonance theory and intelligent control , 2016 .

[176]  Michael Georgiopoulos,et al.  Analogue circuit design and implementation of an adaptive resonance theory (ART) neural network architecture , 1994 .

[177]  Georgios C. Anagnostopoulos,et al.  Hypersphere ART and ARTMAP for unsupervised and supervised, incremental learning , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[178]  N. DeClaris,et al.  Introduction to the theory and applications of neural networks with quadratic junctions , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[179]  Aditya Gupta,et al.  Uncertain fuzzy self-organization based clustering: interval type-2 fuzzy approach to adaptive resonance theory , 2018, Inf. Sci..

[180]  R. Sambasiva Rao,et al.  Mathematical Neural Network (MaNN) Models Part III: ART and ARTMAP in OMNI_METRICS , 2014 .

[181]  Donald C. Wunsch,et al.  Coordinated machine learning and decision support for situation awareness , 2009, Neural Networks.

[182]  Gail A. Carpenter,et al.  ARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases , 1998, Neural Networks.

[183]  Michael Georgiopoulos,et al.  Ordered fuzzy ARTMAP: a fuzzy ARTMAP algorithm with a fixed order of pattern presentation , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[184]  François Michaud,et al.  Design and integration of a spatio-temporal memory with emotional influences to categorize and recall the experiences of an autonomous mobile robot , 2015, Autonomous Robots.

[185]  Georgios C. Anagnostopoulos,et al.  Putting the Utility of Match Tracking in Fuzzy ARTMAP Training to the Test , 2003, KES.

[186]  Chu Kiong Loo,et al.  Kernel Bayesian ART and ARTMAP , 2018, Neural Networks.

[187]  Stephen Grossberg,et al.  A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems , 1995, IEEE Trans. Neural Networks.

[188]  Ah-Hwee Tan,et al.  Neural modeling of sequential inferences and learning over episodic memory , 2015, Neurocomputing.

[189]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[190]  Issam Dagher,et al.  An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performance , 1999, IEEE Trans. Neural Networks.

[191]  Chee Peng Lim,et al.  A hybrid model of fuzzy ARTMAP and genetic algorithm for data classification and rule extraction , 2016, Expert Syst. Appl..

[192]  Yukihiro Matsubara,et al.  ART1.5SSS for Kansei engineering expert system , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[193]  François Michaud,et al.  Fusion Adaptive Resonance Theory Networks Used as Episodic Memory for an Autonomous Robot , 2014, AGI.

[194]  Boaz Lerner,et al.  The Bayesian ARTMAP , 2007, IEEE Transactions on Neural Networks.

[195]  Roger White,et al.  Adaptive Resonance Theory-based Modular Networks for Incremental Learning of Hierarchical Clusterings , 1997, Connect. Sci..

[196]  Lakhmi C. Jain,et al.  Innovations in ART neural networks , 2000 .

[197]  Donald C. Wunsch,et al.  Distributed dual vigilance fuzzy adaptive resonance theory learns online, retrieves arbitrarily-shaped clusters, and mitigates order dependence , 2018, Neural Networks.

[198]  Ashraf M. Abdelbar,et al.  Biclustering ARTMAP collaborative filtering recommender system , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[199]  Marko Tscherepanow,et al.  TopoART: A Topology Learning Hierarchical ART Network , 2010, ICANN.

[200]  Francisco Javier Díaz Pernas,et al.  Adaptative Resonance Theory Fuzzy Networks Parallel Computation Using CUDA , 2009, IWANN.

[201]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[202]  Ferda Nur Alpaslan,et al.  Behavior categorization using Correlation Based Adaptive Resonance Theory , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[203]  Robert W. Newcomb,et al.  VLSI implementation of ART1 memories , 1991, IEEE Trans. Neural Networks.

[204]  Chee Peng Lim,et al.  ART-BASED AUTONOMOUS LEARNING SYSTEMS: PART II­ APPLICATIONS , 2000 .

[205]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[206]  Jauwairia Nasir,et al.  ART neural network-based integration of episodic memory and semantic memory for task planning for robots , 2019, Auton. Robots.

[207]  Gee Wah Ng,et al.  Managing Category Proliferation in Fuzzy ARTMAP Caused by Overlapping Classes , 2009, IEEE Transactions on Neural Networks.

[208]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[209]  Chee Peng Lim,et al.  Improved GART Neural Network Model for Pattern Classification and Rule Extraction With Application to Power Systems , 2011, IEEE Transactions on Neural Networks.

[210]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[211]  Michael Georgiopoulos,et al.  Properties of learning in ARTMAP , 1994, Neural Networks.

[212]  Razvan Andonie,et al.  Fuzzy ARTMAP with relevance factor , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[213]  Jong-Hwan Kim,et al.  Deep ART Neural Model for Biologically Inspired Episodic Memory and Its Application to Task Performance of Robots , 2018, IEEE Transactions on Cybernetics.

[214]  Mu-Chun Su,et al.  Application of neural networks using quadratic junctions in cluster analysis , 2001, Neurocomputing.

[215]  Mahesan Niranjan,et al.  On-line Q-learning using connectionist systems , 1994 .

[216]  J. Bezdek,et al.  VAT: a tool for visual assessment of (cluster) tendency , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[217]  Narayan Srinivasa,et al.  Learning and generalization of noisy mappings using a modified PROBART neural network , 1997, IEEE Trans. Signal Process..

[218]  Guszti Bartfai,et al.  A comparison of two ART-based neural networks for hierarchical clustering , 1995, Proceedings 1995 Second New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems.

[219]  G. Bartfai,et al.  Learning and optimisation of hierarchical clusterings with ART-based modular networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[220]  Stephen Grossberg,et al.  Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world , 2013, Neural Networks.

[221]  Razvan Andonie,et al.  Fuzzy ARTMAP with input relevances , 2006, IEEE Transactions on Neural Networks.

[222]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[223]  Michael Georgiopoulos,et al.  Boosted ARTMAP: Modifications to fuzzy ARTMAP motivated by boosting theory , 2006, Neural Networks.

[224]  S. Grossberg.  A prediction theory for some nonlinear functional-differential equations. II. Learning of patterns☆ , 1968 .

[225]  Nikola Pavesic,et al.  A Fast Simplified Fuzzy ARTMAP Network , 2003, Neural Processing Letters.

[226]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[227]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[228]  Stephen Grossberg,et al.  Intelligence Through Interaction: Towards a Unified Theory for Learning , 2007, ISNN.

[229]  Yukihiro Matsubara,et al.  arboART: ART based hierarchical clustering and its application to questionnaire data analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[230]  Georgios C. Anagnostopoulos,et al.  Ellipsoid ART and ARTMAP for incremental clustering and classification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[231]  Mu-Chun Su,et al.  A new approach to clustering data with arbitrary shapes , 2005, Pattern Recognit..