A deep cascade neuro-fuzzy system for high-dimensional online fuzzy clustering

A deep cascade system (based on neuro-fuzzy nodes) and its online learning procedure are proposed in this paper. A number of layers can grow unlimitedly during a self-learning procedure. The system is based on nodes of a special type. A goal function of a special type is used for probabilistic high-dimensional fuzzy clustering. To assess a clustering quality of data processing, a neuron's architecture of a special type is introduced.

[1]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Michel Verleysen,et al.  The Concentration of Fractional Distances , 2007, IEEE Transactions on Knowledge and Data Engineering.

[3]  Nikola Kasabov,et al.  Evolving connectionist systems , 2002 .

[4]  Eyke Hüllermeier,et al.  Online clustering of parallel data streams , 2006, Data Knowl. Eng..

[5]  Oleksii K. Tyshchenko,et al.  An Ensemble of Adaptive Neuro-Fuzzy Kohonen Networks for Online Data Stream Fuzzy Clustering , 2016, ArXiv.

[6]  Frank Klawonn,et al.  What Is Fuzzy about Fuzzy Clustering? Understanding and Improving the Concept of the Fuzzifier , 2003, IDA.

[7]  Jürgen Schmidhuber,et al.  Highway Networks , 2015, ArXiv.

[8]  Plamen Angelov,et al.  Evolving Takagi-Sugeno fuzzy systems from data streams (eTS+). , 2010 .

[9]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[10]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[11]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[12]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[13]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[14]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[15]  Ming-Syan Chen,et al.  Adaptive Clustering for Multiple Evolving Streams , 2006, IEEE Transactions on Knowledge and Data Engineering.

[16]  James C. Bezdek,et al.  Validity-guided (re)clustering with applications to image segmentation , 1996, IEEE Trans. Fuzzy Syst..

[17]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[18]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[19]  J. Bezdek.  Cluster Validity with Fuzzy Sets , 1973 .

[20]  Oleksii K. Tyshchenko,et al.  A hybrid cascade neural network with an optimized pool in each cascade , 2015, Soft Comput..

[21]  Ye. Bodyanskiy,et al.  Adaptive fuzzy clustering with a variable fuzzifier , 2013 .

[22]  Yevgeniy Bodyanskiy,et al.  An Evolving Cascade Neuro-Fuzzy System for Data Stream Fuzzy Clustering , 2015 .

[23]  Plamen P. Angelov,et al.  Data-driven evolving fuzzy systems using eTS and FLEXFIS: comparative analysis , 2008, Int. J. Gen. Syst..

[24]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.

[25]  Jürgen Schmidhuber,et al.  Training Very Deep Networks , 2015, NIPS.

[26]  Oleksii K. Tyshchenko,et al.  A Multidimensional Cascade Neuro-Fuzzy System with Neuron Pool Optimization in Each Cascade , 2014, ArXiv.

[27]  Jerry M. Mendel,et al.  IEEE Press Series on Computational Intelligence , 2014 .

[28]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[29]  Oleksii K. Tyshchenko,et al.  Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks , 2016, Evol. Syst..

[30]  P. Angelov,et al.  Two approaches to data-driven design of evolving fuzzy systems: eTS and FLEXFIS , 2005, NAFIPS 2005 - 2005 Annual Meeting of the North American Fuzzy Information Processing Society.