Generalized Lattices Express Parallel Distributed Concept Learning

Concepts have been expressed mathematically as propositions in a distributive lattice. A more comprehensive formulation is that of a generalized lattice, or category, in which the concepts are related in hierarchical fashion by lattice-like links called concept morphisms. A concept morphism describes how a more abstract concept is used within a more specialized concept, as the color "red" is used in describing "apples". Often, an abstract concept can be used in a more specialized concept in more than one way as with "color", which can appear in "apples" as either "red", "yellow" or "green". Further, "color" appears in "apples" because it appears in "red", "yellow" and "green", which in turn appear in "apples", expressed via the composition of concept morphisms. Using categorical constructs based upon composition together with structure-preserving mappings that preserve compositional structure, a recently-developed semantic theory shows how abstract and specialized concepts are learned by a neural network.

[1]  S. Lane.  Categories for the Working Mathematician , 1971 .

[2]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[3]  M. K. Bennett.  Affine and Projective Geometry , 1995 .

[4]  Yunhai Xiao,et al.  From categorical semantics to neural network design , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[5]  Roy L. Crole,et al.  Categories for Types , 1994, Cambridge mathematical textbooks.

[6]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[7]  Vassilios Petridis,et al.  Fuzzy Lattice Neurocomputing (FLN) models , 2000, Neural Networks.

[8]  Nikola IL Kasabov.  Adaptable neuro production systems , 1996, Neurocomputing.

[9]  Ingrid Wickelgren,et al.  Cognitive Neuroscience: Getting a Grasp on Working Memory , 1997, Science.

[10]  M. J. Healy,et al.  Modification of the ART-1 architecture based on category theoretic design principles , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[11]  Thomas P. Caudell,et al.  Ontologies and Worlds in Category Theory: Implications for Neural Systems , 2006 .

[12]  Benjamin C. Peirce,et al.  Basic Category Theory for Computer Scientists , 1991 .

[13]  Sankar K. Pal,et al.  Fuzzy multi-layer perceptron, inferencing and rule generation , 1995, IEEE Trans. Neural Networks.

[14]  Peter Sussner,et al.  Generalizing Operations of Binary Autoassociative Morphological Memories Using Fuzzy Set Theory , 2003, Journal of Mathematical Imaging and Vision.

[15]  Joseph A. Goguen,et al.  Institutions: abstract model theory for specification and programming , 1992, JACM.

[16]  Horst Herrlich,et al.  Abstract and concrete categories , 1990 .

[17]  M. Arbib.  Brains, Machines, and Mathematics , 1987, Springer US.

[18]  Michael J. Healy.  A Topological Semantics for Rule Extraction with Neural Networks , 1999, Connect. Sci..

[19]  Steven Vickers,et al.  Applications of Categories in Computer Science: Geometric theories and databases , 1992 .

[20]  S. Vickers.  Topology via Logic , 1989 .

[21]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[22]  Jirí Síma,et al.  Neural expert systems , 1995, Neural Networks.

[23]  A. Damasio.  Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[24]  Thomas P. Caudell,et al.  Acquiring rule sets as a product of learning in a logical neural architecture , 1997, IEEE Trans. Neural Networks.

[25]  Jude W. Shavlik,et al.  Learning Symbolic Rules Using Artificial Neural Networks , 1993, ICML.

[26]  S. Maclane,et al.  Categories for the Working Mathematician , 1971 .

[27]  D. Corfield.  Conceptual mathematics: a first introduction to categories , 2002 .

[28]  Keith E. Williamson,et al.  Industrial Applications of Software Synthesis via Category Theory—Case Studies Using Specware , 2004, Automated Software Engineering.

[29]  H. Eichenbaum.  Hippocampus Cognitive Processes and Neural Representations that Underlie Declarative Memory , 2004, Neuron.

[30]  M. K. Bennett.  Affine and Projective Geometry: Bennett/Affine , 1995 .

[31]  Gadi Pinkas,et al.  Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge , 1995, Artif. Intell..

[32]  José Meseguer,et al.  General Logics , 2006 .

[33]  Michael Georgiopoulos,et al.  The generalization capabilities of ARTMAP , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).