An introduction to neural networks

From the Publisher: An Introduction to Nueral Networks will be warmly welcomed by a wide readership seeking an authoritative treatment of this key subject without an intimidating level of mathematics in the presentation.

[1]  Anthony Kuh,et al.  A combined self-organizing feature map and multilayer perceptron for isolated word recognition , 1992, IEEE Trans. Signal Process..

[2]  H. Graf,et al.  A CMOS associative memory chip based on neural networks , 1987, 1987 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[3]  Norio Baba,et al.  A new approach for finding the global minimum of error function of neural networks , 1989, Neural Networks.

[4]  I. Aleksander,et al.  Microcircuit learning nets: some tests with handwritten numerals , 1968 .

[5]  Kevin Gurney,et al.  Design, manufacture and evaluation of a scalable high-performance neural system , 1994 .

[6]  D. Hubel,et al.  Sequence regularity and geometry of orientation columns in the monkey striate cortex , 1974, The Journal of comparative neurology.

[7]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[8]  D. M. Titterington,et al.  Neural Networks: A Review from a Statistical Perspective , 1994 .

[9]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[11]  Timothy Masters,et al.  Practical neural network recipes in C , 1993 .

[12]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[13]  S. Hochreiter.  Recurrent Neural Net Learning and Vanishing , 1998 .

[14]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[15]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[16]  Stephen Grossberg,et al.  ART 2-A: an adaptive resonance algorithm for rapid category learning and recognition , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[17]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[18]  Igor Aleksander,et al.  Learning algorithms for probabilistic neural nets , 1988, Neural Networks.

[19]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[20]  Y. Nesterov.  A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2) , 1983 .

[21]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[22]  I. Aleksander,et al.  WISARD·a radical step forward in image recognition , 1984 .

[23]  Amiram Grinvald,et al.  Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns , 1991, Nature.

[24]  Sheng-Fuu Lin,et al.  Adaptive hamming net: A fast-learning ART 1 model without searching , 1995, Neural Networks.

[25]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[26]  Raj Reddy,et al.  Foundations and grand challenges of artificial intelligence , 1988 .

[27]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[28]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[29]  Teuvo Kohonen,et al.  The 'neural' phonetic typewriter , 1988, Computer.

[30]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[31]  W. W. Bledsoe,et al.  Improved Memory Matrices for the n-Tuple Pattern Recognition Method , 1962, IRE Trans. Electron. Comput..

[32]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[33]  Michael Anderson,et al.  NIRS: Large scale ART-1 neural architectures for engineering design retrieval , 1994, Neural Networks.

[34]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[35]  Andrew S. Tanenbaum,et al.  Structured Computer Organization , 1976 .

[36]  P. Anandan,et al.  Pattern-recognizing stochastic learning automata , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[37]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[38]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[39]  Juha Karhunen,et al.  Generalizations of principal component analysis, optimization problems, and neural networks , 1995, Neural Networks.

[40]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[41]  John Shawe-Taylor.  Threshold Network Learning in the Presence of Equivalences , 1991, NIPS.

[42]  A. Roli.  Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[43]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[44]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[45]  S. Kauffman.  Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[46]  D. Gorse,et al.  AN ANALYSIS OF NOISY RAM AND NEURAL NETS , 1989 .

[47]  Xia Lin.  Self-organizing semantic maps as graphical interfaces for information retrieval , 1993 .

[48]  John P. McDermott,et al.  R1: A Rule-Based Configurer of Computer Systems , 1982, Artif. Intell..

[49]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[50]  Kevin Gurney.  Weighted Nodes and RAM-Nets: A Unified Approach , 1992 .

[51]  James C. Bezdek,et al.  A note on self-organizing semantic maps , 1995, IEEE Trans. Neural Networks.

[52]  Ron Sun,et al.  How Do Symbols and Networks Fit Together - A Report from the Workshop on Integrating Neural and Symbolic Processes , 1993, AI Mag..

[53]  W. Rall.  Branching dendritic trees and motoneuron membrane resistivity. , 1959, Experimental neurology.

[54]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[55]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[56]  H. L. Cather.  Techniques in Computational Learning—an Introduction , 1993 .

[57]  E. H. Mamdani,et al.  Microcircuit learning nets: improved recognition by means of pattern feedback , 1968 .

[58]  Richard Durbin,et al.  A dimension reduction framework for understanding cortical maps , 1990, Nature.

[59]  S. Grossberg.  Contour Enhancement , Short Term Memory , and Constancies in Reverberating Neural Networks , 1973 .

[60]  H. K. Hartline,et al.  The Nerve Messages in the Fibers of the Visual Pathway , 1940 .

[61]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[62]  Kumpati S. Narendra,et al.  Learning Automata - A Survey , 1974, IEEE Trans. Syst. Man Cybern..

[63]  W. Little.  The existence of persistent states in the brain , 1974 .

[64]  Yillbyung Lee,et al.  Handwritten Hangul recognition using a modified neocognitron , 1991, Neural Networks.

[65]  W. Rall.  Membrane time constant of motoneurons. , 1957, Science.

[66]  Kevin N. Gurney.  Training nets of stochastic units using system identification , 1993, Neural Networks.

[67]  D. V. van Essen,et al.  The representation of the visual field in parvicellular and magnocellular layers of the lateral geniculate nucleus in the macaque monkey , 1984, The Journal of comparative neurology.

[68]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[69]  Albert Y. Zomaya,et al.  Toward generating neural network structures for function approximation , 1994, Neural Networks.

[70]  Malcolm I. Heywood,et al.  A framework for improved training of Sigma-Pi networks , 1995, IEEE Trans. Neural Networks.

[71]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[72]  Kunihiko Fukushima,et al.  Analysis of the process of visual pattern recognition by the neocognitron , 1989, Neural Networks.

[73]  Achilleas Zapranis,et al.  Stock performance modeling using neural networks: A comparative study with regression models , 1994, Neural Networks.

[74]  Mark D. Plumbley.  Efficient information transfer and anti-Hebbian neural networks , 1993, Neural Networks.

[75]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[76]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[77]  Tommaso Toffoli,et al.  Cellular automata : proceedings of an interdisciplinary workshop, Los Alamos, New Mexico 87545, USA, March 7-11, 1983 , 1984 .

[78]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[79]  T. Poggio,et al.  Retinal ganglion cells: a functional interpretation of dendritic morphology. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[80]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[81]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[82]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[83]  Ron Sun,et al.  Computational Architectures Integrating Neural And Symbolic Processes , 1994 .

[84]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[85]  Fernando Mendes de Azevedo,et al.  Connectionist expert systems as medical decision aid , 1993, Artif. Intell. Medicine.

[86]  T. J. Stonham,et al.  Guide to pattern recognition using random-access memories , 1979 .

[87]  Michael Georgiopoulos,et al.  Properties of learning related to pattern diversity in ART1 , 1991, Neural Networks.

[88]  I. Aleksander.  Fused logic element which learns by example , 1965 .

[89]  B. Connors,et al.  Intrinsic firing patterns of diverse neocortical neurons , 1990, Trends in Neurosciences.

[90]  Edmund T. Rolls.  Methods in neuronal modeling: From synapses to networks C. Koch and I. Segev (eds.),(Bradford books, MIT Press, Cambridge, MA and London, 1989) pp. 524, £40.50 , 1990, Biological Psychology.

[91]  Stephen Grossberg,et al.  Invariant recognition of cluttered scenes by a self-organizing ART architecture: CORT-X boundary segmentation , 1989, Neural Networks.

[92]  R. Linsker,et al.  From basic network principles to neural architecture , 1986 .

[93]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[94]  Vijaykumar Gullapalli,et al.  A stochastic reinforcement learning algorithm for learning real-valued functions , 1990, Neural Networks.

[95]  A G Barto,et al.  Learning by statistical cooperation of self-interested neuron-like computing elements. , 1985, Human neurobiology.

[96]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[97]  Jim Austin,et al.  The design and application of associative memories for scene analysis , 1986 .

[98]  G. E. Davis,et al.  A neural network that predicts psychiatric length of stay. , 1993, M.D. computing : computers in medical practice.

[99]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[100]  G. Shepherd.  Microcircuits in the nervous system. , 1978, Scientific American.

[101]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[102]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[103]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[104]  John von Neumann,et al.  First draft of a report on the EDVAC , 1993, IEEE Annals of the History of Computing.

[105]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[106]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[107]  K.N. Gumey,,et al.  Digital Nets and Intelligent Systems , 1992 .

[108]  Jean-Pierre Martens,et al.  On the initialization and optimization of multilayer perceptrons , 1994, IEEE Trans. Neural Networks.

[109]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[110]  Arun Jagota,et al.  Approximating maximum clique with a Hopfield network , 1995, IEEE Trans. Neural Networks.

[111]  Myung Won Kim,et al.  The effect of initial weights on premature saturation in back-propagation learning , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[112]  Kevin N. Gurney.  Learning in networks of structured hypercubes , 1989 .

[113]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[114]  D. S. Jones,et al.  Elementary information theory , 1979 .

[115]  Kevin N. Gurney.  Training Recurrent Nets of Hardware Realisable Sigma-PI Units , 1992, Int. J. Neural Syst..

[116]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[117]  Shixin Cheng,et al.  Dynamic learning rate optimization of the backpropagation algorithm , 1995, IEEE Trans. Neural Networks.

[118]  R. O. Duda,et al.  PROSPECTOR—A computer-based consultation system for mineral exploration , 1978 .

[119]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[120]  S. Grossberg,et al.  Probing cognitive processes through the structure of event-related potentials during learning: an experimental and theoretical analysis. , 1987, Applied optics.

[121]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[122]  Igor Aleksander,et al.  A probabilistic logic neuron network for associative learning , 1989 .

[123]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[124]  Maureen Caudill.  Expert networks , 1990 .

[125]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[126]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[127]  J. Makhoul,et al.  Formation of disconnected decision regions with a single hidden layer , 1989, International 1989 Joint Conference on Neural Networks.

[128]  H. Ritter,et al.  A principle for the formation of the spatial structure of cortical feature maps. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[129]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[130]  D. Parisi,et al.  “Genotypes” for neural networks , 1998 .

[131]  S. Grossberg,et al.  A self-organizing neural network for supervised learning, recognition, and prediction , 1992, IEEE Communications Magazine.

[132]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[133]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[134]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..