Connectionist Models: Not Just a Notational Variant Not a Panacea

Connectionist models inherently include features and exhibit behaviors which are difficult to achieve with traditional logic-based models. Among the more important of such characteristics are 1) the ability to compute nearest match rather than requiring unification or exact match; 2) learning; 3) fault tolerance through the integration of overlapping modules, each of which may be incomplete or fallible, and 4) the possibility of scaling up such systems by many orders of magnitude, to operate more rapidly or to handle much larger problems, or both. However, it is unlikely that connectionist models will be able to learn all of language from experience, because it is unlikely that a full cognitive system could be built via learning from an initially random network; any successful large-scale connectionist learning system will have to be to some degree "genetically" prewired.

[1]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[2]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[3]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[4]  Michael K. Tanenhaus,et al.  The time course of lexical ambiguity resolution in context , 1980 .

[5]  Mitchell P. Marcus,et al.  A theory of syntactic recognition for natural language , 1979 .

[6]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[7]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[8]  W. Daniel Hillis,et al.  The connection machine , 1985 .

[9]  P. Kay Basic Color Terms: Their Universality and Evolution , 1969 .

[10]  Marvin Minsky,et al.  K-Lines: A theory of Memory , 1980, Cogn. Sci..

[11]  Z. Pylyshyn Computation and cognition: issues in the foundations of cognitive science , 1980, Behavioral and Brain Sciences.

[12]  Gary Sabot Bulk Processing of Text on a Massively Parallel Computer , 1986, ACL.

[13]  A. Battersby Plans and the Structure of Behavior , 1968 .

[14]  Lokendra Shastri,et al.  Evidential Reasoning in Semantic Networks: A Formal Theory , 1985, IJCAI.

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  George Lakoff,et al.  Women, Fire, and Dangerous Things , 1987 .

[17]  David L. Waltz,et al.  Toward memory-based reasoning , 1986, CACM.

[18]  Patrick Henry Winston,et al.  Representing and Using Real-World Knowledge , 1982 .

[19]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[20]  Nils J. Nilsson,et al.  Artificial Intelligence Prepares for 2001 , 1983, AI Mag..

[21]  W. Marslen-Wilson,et al.  The temporal structure of spoken language understanding , 1980, Cognition.

[22]  Scott E. Fahlman,et al.  NETL: A System for Representing and Using Real-World Knowledge , 1979, CL.

[23]  Steven Lawrence Small,et al.  Word expert parsing: a theory of distributed word-based natural language understanding , 1980 .

[24]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[25]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[26]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[27]  John W. Backus,et al.  Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs , 1978, CACM.

[28]  James Alexander Hendler,et al.  integrating Marker Passing and Problem Solving: A Spreading Activation Approach To Improved Choice in Planning , 1987 .

[29]  Alex Pentland,et al.  A More Rational View of Logic, Or, Up Against the Wall, Logic Imperialists! , 1983, AI Mag..

[30]  Geoffrey E. Hinton,et al.  Symbols Among the Neurons: Details of a Connectionist Inference Architecture , 1985, IJCAI.

[31]  Penny Nii,et al.  Blackboard systems part two: Blackboard application systems , 1986 .

[32]  Edward E. Smith,et al.  Categories and concepts , 1984 .

[33]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[34]  Jordan B. Pollack,et al.  Massively Parallel Parsing: A Strongly Interactive Model of Natural Language Interpretation , 1988, Cogn. Sci..