Nested monte carlo search expression discovery for the automated design of fuzzy ART category choice functions

While the performance of many neural network and machine learning schemes has been improved through the automated design of various components of their architectures, the automated improvement of Adaptive Resonance Theory (ART) neural networks remains relatively unexplored. Recent work introduced a genetic programming (GP) approach to improve the performance of the Fuzzy ART neural network employing a hyper-heuristic approach to tailor Fuzzy ART's category choice function to specific problems. The GP method showed promising results. However, GP is not the only tool that can be used for automatic improvement. Among other methods, Nested Monte Carlo Search (NMCS) was recently applied to expression discovery and outperformed traditional evolutionary approaches by finding better solutions in fewer evaluations. This work applies NMCS to the discovery of new Fuzzy ART category choice functions targeted to specific problems with results demonstrating its ability to find better performing Fuzzy ART networks than the GP approach.

[1]  Rong Li,et al.  Multi-objective memetic evolution of ART-based classifiers , 2010, IEEE Congress on Evolutionary Computation.

[2]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[3]  Gabriel Kronberger,et al.  Evolution of Covariance Functions for Gaussian Process Regression Using Genetic Programming , 2013, EUROCAST.

[4]  Daniel R. Tauritz,et al.  Evolutionary computation for the automated design of category functions for fuzzy ART: an initial exploration , 2017, GECCO.

[5]  Mansooreh Mollaghasemi,et al.  AG-ART: An adaptive approach to evolving ART architectures , 2009, Neurocomputing.

[6]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[7]  Tristan Cazenave,et al.  Forecasting Financial Volatility Using Nested Monte Carlo Expression Discovery , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[8]  Tristan Cazenave,et al.  Monte-Carlo Expression Discovery , 2013, Int. J. Artif. Intell. Tools.

[9]  Tristan Cazenave,et al.  Nested Monte-Carlo Expression Discovery , 2010, ECAI.

[10]  Mansooreh Mollaghasemi,et al.  An Adaptive Multiobjective Approach to Evolving ART Architectures , 2010, IEEE Transactions on Neural Networks.

[11]  Roman Neruda,et al.  Combining top-down and bottom-up approaches for automated discovery of typed programs , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[12]  Ole J. Mengshoel,et al.  Interpretable Categorization of Heterogeneous Time Series Data , 2017, SDM.

[13]  Marzuki Khalid,et al.  Evolutionary Fuzzy ARTMAP Neural Networks for Classification of Semiconductor Defects , 2015, IEEE Transactions on Neural Networks and Learning Systems.