Discussion: McCulloch-Pitts and related neural nets from 1943 to 1989

The McCulloch-Pitts paper “A Logical Calculus of the Ideas Immanent in Nervous Activity” was published in theBulletin of Mathematical Biophysics in 1943, a decade before the work of Hodgkin, Huxley, Katz and Eccles. The McCulloch-Pitts neuron is an extremely simplified representation of neural properties, based simply on the existence of a threshold for the activation of an action potential.

[1]  Solomon Lefschetz,et al.  Stability by Liapunov's Direct Method With Applications , 1962 .

[2]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[4]  Albert B Novikoff,et al.  ON CONVERGENCE PROOFS FOR PERCEPTRONS , 1963 .

[5]  B. Cragg,et al.  Memory: the analogy with ferromagnetic hysteresis. , 1955, Brain : a journal of neurology.

[6]  D. Gabor.  Associative holographic memories , 1969 .

[7]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[8]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[9]  D. H. Paul.  The physiology of nerve cells , 1975 .

[10]  S. Kaplan.  The Physiology of Thought , 1950 .

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[13]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[14]  W. Ashby,et al.  The stability of a randomly assembled nerve-network. , 1950, Electroencephalography and clinical neurophysiology.

[15]  A. Turing,et al.  On Computable Numbers, with an Application to the Entscheidungsproblem. A Correction , 1938 .

[16]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[17]  B. Cragg,et al.  The organisation of neurones: a co-operative analogy. , 1954, Electroencephalography and clinical neurophysiology.

[18]  S. Winograd,et al.  Reliable Computation in the Presence of Noise , 1963 .

[19]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[20]  J. Cowan.  The problem of organismic reliability. , 1965, Progress in brain research.

[21]  D J Willshaw,et al.  A marker induction mechanism for the establishment of ordered neural mappings: its application to the retinotectal problem. , 1979, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[24]  E. Caianiello.  Outline of a theory of thought-processes and thinking machines. , 1961, Journal of theoretical biology.

[25]  E. Nordeen,et al.  Androgens prevent normally occurring cell death in a sexually dimorphic spinal nucleus. , 1985, Science.

[26]  R. L. Beurle.  Properties of a mass of cells capable of regenerating pulses , 1956, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[27]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[28]  G. Brindley.  The classification of modifiable synapses and their use in models for conditioning , 1967, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[29]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[30]  David B. Parker,et al.  A comparison of algorithms for neuron-like cells , 1987 .

[31]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[32]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[33]  J. D. Cowan,et al.  Statistical Mechanics of Nervous Nets , 1968 .

[34]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[35]  J. Cowan,et al.  Temporal oscillations in neuronal nets , 1979, Journal of mathematical biology.

[36]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[37]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[38]  N. Wiener,et al.  Behavior, Purpose and Teleology , 1943, Philosophy of Science.

[39]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[40]  J. von Neumann,et al.  Probabilistic Logic and the Synthesis of Reliable Organisms from Unreliable Components , 1956 .

[41]  W A Little,et al.  A statistical theory of short and long term memory. , 1975, Behavioral biology.

[42]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[43]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[44]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[45]  Henry M. Sheffer.  A set of five independent postulates for Boolean algebras, with application to logical constants , 1913 .

[46]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.