One Hundred Challenge Problems for Logical Formalizations of Commonsense Psychology

We present a new set of challenge problems for the logical formalization of commonsense knowledge, called TriangleCOPA. This set of one hundred problems is smaller than other recent commonsense reasoning question sets, but is unique in that it is specifically designed to support the development of logic-based commonsense theories, via two means. First, questions and potential answers are encoded in logical form using a fixed vocabulary of predicates, eliminating the need for sophisticated natural language processing pipelines. Second, the domain of the questions is tightly constrained so as to focus formalization efforts on one area of inference, namely the commonsense reasoning that people do about human psychology. We describe the authoring methodology used to create this problem set, and our analysis of the scope of requisite commonsense knowledge. We then show an example of how problems can be solved using an implementation of weighted abduction.

[1]  Alex M. Andrew,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2002 .

[2]  James F. Allen,et al.  Actions and Events in Interval Temporal Logic , 1994 .

[3]  Jerry R. Hobbs,et al.  Axiomatizing Complex Concepts from Fundamentals , 2014, CICLing.

[4]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[5]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[6]  Ido Dagan,et al.  The Third PASCAL Recognizing Textual Entailment Challenge , 2007, ACL-PASCAL@ACL.

[7]  Cosmin Adrian Bejan,et al.  Commonsense Causal Reasoning Using Millions of Personal Stories , 2011, AAAI.

[8]  John McCarthy,et al.  Programs with common sense , 1960 .

[9]  Murray Shanahan,et al.  The Event Calculus Explained , 1999, Artificial Intelligence Today.

[10]  Zornitsa Kozareva,et al.  SemEval-2012 Task 7: Choice of Plausible Alternatives: An Evaluation of Commonsense Causal Reasoning , 2011, *SEMEVAL.

[11]  Alexander Gelbukh.  Computational linguistics and intelligent text processing : 15th International Conference, CICLing 2014, Kathmandu, Nepal, April 6-12, 2014 : proceedings , 2014 .

[12]  Jerry R. Hobbs.  Ontological Promiscuity , 1985, ACL.

[13]  Vincent Ng,et al.  Resolving Complex Cases of Definite Pronouns: The Winograd Schema Challenge , 2012, EMNLP.

[14]  F. Heider.  The psychology of interpersonal relations , 1958 .

[15]  Andrew S. Gordon,et al.  Triangle charades: a data-collection game for recognizing actions in motion trajectories , 2014, IUI.

[16]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[17]  Ernest Lepore,et al.  Actions and Events , 1985 .

[18]  E. Davis,et al.  Common Sense Reasoning , 2014, Encyclopedia of Social Network Analysis and Mining.

[19]  James F. Allen,et al.  Actions and Events in Interval Temporal Logic , 1994, J. Log. Comput..

[20]  Kentaro Inui,et al.  ILP-based Inference for Cost-based Abduction on First-order Predicate Logic , 2013 .

[21]  Jerry R. Hobbs,et al.  Formalizations of Commonsense Psychology , 2004, AI Mag..

[22]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[23]  Hector J. Levesque,et al.  The Winograd Schema Challenge , 2011, AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.

[24]  Sanda M. Harabagiu,et al.  UTDHLT: COPACETIC System for Choosing Plausible Alternatives , 2012, *SEMEVAL.

[25]  J Quinonero Candela,et al.  Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual Entailment , 2006, Lecture Notes in Computer Science.