An Architecture for Adaptive Algorithmic Hybrids

We describe a cognitive architecture for creating more robust intelligent systems. Our approach is to enable hybrids of algorithms based on different computational formalisms to be executed. The architecture is motivated by some features of human cognitive architecture and the following beliefs: 1) Most existing computational methods often exhibit some of the characteristics desired of intelligent systems at the cost of other desired characteristics and 2) a system exhibiting robust intelligence can be designed by implementing hybrids of these computational methods. The main obstacle to this approach is that the various relevant computational methods are based on data structures and algorithms that are difficult to integrate into one system. We describe a new method of executing hybrids of algorithms using the focus of attention of multiple modules. The key to this approach is the following two principles: 1) Algorithms based on very different computational frameworks (e.g., logical reasoning, probabilistic inference, and case-based reasoning) can be implemented using the same set of five common functions and 2) each of these common functions can be executed using multiple data structures and algorithms. This approach has been embodied in the Polyscheme cognitive architecture. Systems based on Polyscheme in planning, spatial reasoning, robotics, and information retrieval illustrate that this approach to hybridizing algorithms enables qualitative and measurable quantitative advances in the abilities of intelligent systems.

[1]  Lenhart K. Schubert,et al.  Determining Type, Part, Color, and Time Relationships , 1983, Computer.

[2]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[3]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[4]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[5]  Jacob Beal Learning by learning to communicate , 2007 .

[6]  Susan L. Epstein Pragmatic Navigation: Reactivity, Heuristics, and Search , 1998, Artif. Intell..

[7]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1988, IJCAI 1989.

[8]  Pedro M. Domingos,et al.  Memory-Efficient Inference in Relational Domains , 2006, AAAI.

[9]  Sharad Malik,et al.  Chaff: engineering an efficient SAT solver , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).

[10]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[11]  Jun Gu,et al.  Efficient local search for very large-scale satisfiability problems , 1992, SGAR.

[12]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[13]  Nicholas L. Cassimatis,et al.  Inference with Relational Theories over Infinite Domains , 2009, FLAIRS Conference.

[14]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[15]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[16]  John E. Laird,et al.  Predicate Projection in a Bimodal Spatial Reasoning System , 2007, AAAI.

[17]  松原 仁 20世紀の名著名論:Marvin Minsky : A Framework for Representing knowledge , 2003 .

[18]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[19]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[20]  Donald W. Loveland,et al.  A machine program for theorem-proving , 2011, CACM.

[21]  Nicholas L. Cassimatis A Framework for Answering Queries using Multiple Representation and Inference Techniques , 2003, KRDB.

[22]  Nicholas L. Cassimatis,et al.  Parsing PCFG within a General Probabilistic Inference Framework , 2009 .

[23]  J. Gregory Trafton,et al.  Integrating cognition, perception and action through mental simulation in robots , 2004, Robotics Auton. Syst..

[24]  Alexander Egyed,et al.  Self-Adaptive Systems for Information Survivability: PMOP and AWDRAT , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[25]  David H. Wolpert,et al.  Coevolutionary free lunches , 2005, IEEE Transactions on Evolutionary Computation.

[26]  Nicholas L. Cassimatis,et al.  A Cognitive Substrate for Achieving Human-Level Intelligence , 2006, AI Mag..

[27]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[28]  Albert Oliveras,et al.  MiniMaxSAT: An Efficient Weighted Max-SAT solver , 2008, J. Artif. Intell. Res..

[29]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[30]  Robert Laddaga,et al.  Introduction to Self-adaptive Software: Applications , 2001, IWSAS.

[31]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[32]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[33]  Nicholas L. Cassimatis Reasoning as Cognitive Self-Regulation , 2007, Integrated Models of Cognitive Systems.

[34]  Niklas Een,et al.  MiniSat v1.13 - A SAT Solver with Conflict-Clause Minimization , 2005 .

[35]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[36]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[38]  Barruquer Moner IX. References , 1971 .

[39]  Ron Sun,et al.  Cognition and Multi-Agent Interaction: The CLARION Cognitive Architecture: Extending Cognitive Modeling to Social Simulation , 2005 .

[40]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[41]  Robert Laddaga,et al.  Self-adaptive software : applications : Second International Workshop, IWSAS 2001, Balatonfüred, Hungary, May 17-19, 2001 : revised papers , 2003 .

[42]  Jacob Beal Shared focus of attention for heterogeneous agents , 2008, AAMAS.

[43]  Satyajit Rao,et al.  Visual routines and attention , 1998 .