Non-ontogenic sparse neural networks

Almost all artificial neural networks are by default fully connected, which often implies a large amount of redundancy and high complexity. Little research has been devoted to the study of sparse neural networks, with its potential advantages of reduced training and recall time, improved generalization capabilities, reduced hardware requirements, as well as being one step closer to biological reality. This publication presents a summary of the various kinds sparse neural networks, clustered into a lucid framework.

[1]  Shengrui Wang,et al.  A PCMN neural network for isolated word recognition , 1989, Speech Commun..

[2]  Richard T. J. Bostock,et al.  Improving classification performance in the bumptree network by optimising topology with a genetic algorithm , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[3]  Lilly Spirkovska,et al.  Connectivity strategies for higher-order neural networks applied to pattern recognition , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[4]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[5]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[6]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[7]  Wolfram Schiffmann,et al.  Synthesis and Performance Analysis of Multilayer Neural Network Architectures , 1992 .

[8]  Renato Stefanelli,et al.  Radix-r Implementation of Neural Nets , 1990 .

[9]  S. Nara,et al.  A Sparsely Connected Asymmetric Neural Network and Its Possible Application to the Processing of Transient Spatio-Temporal Signals , 1990 .

[10]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[11]  Frédéric Gruau,et al.  Genetic Synthesis of Modular Neural Networks , 1993, ICGA.

[12]  Kimmo Kaski,et al.  Choosing optimal network structure , 1990 .

[13]  S. Yoshizawa,et al.  Dynamics of an auto-associative neural network model with arbitrary connectivity and noise in the threshold , 1991 .

[14]  Jude W. Shavlik,et al.  Constructive Induction in Knowledge-Based Neural Networks , 1991, ML.

[15]  Brad Fullmer and Risto Miikkulainen.  Using Marker-Based Genetic Encoding Of Neural Networks To Evolve Finite-State Behaviour , 1991 .

[16]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[17]  D. R. McGregor,et al.  Designing application-specific neural networks using the structured genetic algorithm , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[18]  Peter J. B. Hancock,et al.  Genetic algorithms and permutation problems: a comparison of recombination operators for neural net structure specification , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[19]  Michael I. Jordan,et al.  Learning piecewise control strategies in a modular neural network architecture , 1993, IEEE Trans. Syst. Man Cybern..

[20]  E. Fiesler,et al.  Comparative Bibliography of Ontogenic Neural Networks , 1994 .

[21]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[22]  M. Balsi,et al.  MODA: moving object detecting architecture , 1993 .

[23]  Karl E. Kürten,et al.  Quasi-optimized memorization and retrieval dynamics in sparsely connected neural network models , 1990 .

[24]  S. Naganathan,et al.  Locally versus globally interlayer-connected feed-forward neural networks: a performance comparison , 1990, Defense, Security, and Sensing.

[25]  Derong Liu,et al.  Sparsely interconnected neural networks for associative memories with applications to cellular neural networks , 1994 .

[26]  Synaptic Growth As A Learning Model , 1991 .

[27]  Kanter,et al.  Properties of sparsely connected excitatory neural networks. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[28]  M. Schmitt.  Network configuration and initialization using mathematical morphology: theoretical study of measurement functions , 1991 .

[29]  Françoise Fogelman-Soulié,et al.  Multi-Modular Neural Network Architectures: Applications in Optical Character and Human Face Recognition , 1993, Int. J. Pattern Recognit. Artif. Intell..

[30]  Emile Fiesler.  Minimal and High Order Neural Network Topologies , 1993 .

[31]  Emile Fiesler,et al.  Neural network classification and formalization , 1994 .