What's between KISS and KIDS: A Keep It Knowledgeable (KIKS) Principle for Cognitive Agent Design

The two common design principles for agent-based models, KISS (Keep It Simple, Stupid) and KIDS (Keep It Descriptive, Stupid) offer limited traction for developing cognitive agents, who typically have strong ties to research findings and established theories of cognition. A KIKS principle (Keep It Knowledgeable, Stupid) is proposed to capture the fact that cognitive agents are grounded in published research findings and theory, rather than simply selecting parameters in an adhoc way. In short, KIKS suggests that modelers should not focus on how many parameters, but should instead focus on choosing the right research papers and implement each of their key parameters and mechanisms. Based on this principle, a design process for creating cognitive agents based on cognitive models is proposed. This process is centered around steps that cognitive agent designers are already consider (e.g., literature search, validation, implementing a computational model). However, the KIKS process suggests two differences. First, KIKS calls for reporting explicit metadata on the empirical and theoretical relationships that an agent’s cognitive model is intended to capture. Each such relationship should be associated with a published paper that supports it. This metadata would serve a valuable purpose for comprehending, validating, and comparing the cognitive models used by different agents. Second, KIKS calls for validation tests to be specified before creating an agent’s cognitive model computationally. This process, known as test-driven design, can be used to monitor the adherence of a cognitive agent to its underlying knowledge base as it evolves through different versions. Implications, advantages, and limitations of the proposed process for KIKS are discussed.

[1]  R. Fazio,et al.  On the orienting value of attitudes: attitude accessibility as a determinant of an object's attraction of visual attention. , 1992, Journal of personality and social psychology.

[2]  A. Newell Unified Theories of Cognition , 1990 .

[3]  Aniket Kittur,et al.  The Cognitive Atlas: Toward a Knowledge Foundation for Cognitive Neuroscience , 2011, Front. Neuroinform..

[4]  Ron Sun,et al.  Cognitive Social Simulation Incorporating Cognitive Architectures , 2007, IEEE Intelligent Systems.

[5]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[6]  Marvin Minsky,et al.  Logical Versus Analogical or Symbolic Versus Connectionist or Neat Versus Scruffy , 1991, AI Mag..

[7]  Richard M. Burton,et al.  Computational Laboratories for Organization Science: Questions, Validity and Docking , 2003, Comput. Math. Organ. Theory.

[8]  David G. Rand,et al.  The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments. , 2012, Journal of theoretical biology.

[9]  Barry G. Silverman,et al.  Toward A Human Behavior Models Anthology for Synthetic Agent Development , 2001 .

[10]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[11]  R. Sun Cognition and Multi-Agent Interactions: From Cognitive Modeling to Social Simulation , 2005 .

[12]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[13]  Shigeaki Yamazaki,et al.  Adoption of structured abstracts by general medical journals and format for a structured abstract. , 2005, Journal of the Medical Library Association : JMLA.

[14]  Kevin O'Brien,et al.  Human Behavior Models for Agents in Simulators and Games: Part I: Enabling Science with PMFserv , 2006, Presence: Teleoperators & Virtual Environments.

[15]  L. Grivell,et al.  Text mining for biology - the way forward: opinions from leading scientists , 2008, Genome Biology.

[16]  Barry G. Silverman,et al.  Systems Social Seience: A design inquiry approach for stabilization and reconstruction of social systems , 2010, Intell. Decis. Technol..

[17]  John E. Laird,et al.  Extending the Soar Cognitive Architecture , 2008, AGI.

[18]  Mark A. Pitt,et al.  Cognitive Modeling Repository , 2010 .

[19]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[20]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[21]  Gnana Bharathy,et al.  Human Behavior Models for Agents in Simulators and Games: Part II: Gamebot Engineering with PMFserv , 2006, Presence: Teleoperators & Virtual Environments.

[22]  Eric Solano,et al.  Agent-Based Model (ABM) Validation Considerations , 2011 .

[23]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[24]  Jessica A. Turner,et al.  The Cognitive Paradigm Ontology: Design and Application , 2011, Neuroinformatics.