Why Machines Don’t (yet) Reason Like People

AI has never come to grips with how human beings reason in daily life. Many automated theorem-proving technologies exist, but they cannot serve as a foundation for automated reasoning systems. In this paper, we trace their limitations back to two historical developments in AI: the motivation to establish automated theorem-provers for systems of mathematical logic, and the formulation of nonmonotonic systems of reasoning. We then describe why human reasoning cannot be simulated by current machine reasoning or deep learning methodologies. People can generate inferences on their own instead of just evaluating them. They use strategies and fallible shortcuts when they reason. The discovery of an inconsistency does not result in an explosion of inferences—instead, it often prompts reasoners to abandon a premise. And the connectives they use in natural language have different meanings than those in classical logic. Only recently have cognitive scientists begun to implement automated reasoning systems that reflect these human patterns of reasoning. A key constraint of these recent implementations is that they compute, not proofs or truth values, but possibilities.

[1]  Sangeet Khemlani,et al.  Immediate inferences from quantified assertions , 2015, Quarterly journal of experimental psychology.

[2]  Noah D. Goodman,et al.  Some arguments are probably valid: Syllogistic reasoning as communication , 2014, CogSci.

[3]  Maria Paola Bonacina,et al.  A Taxonomy of Theorem-Proving Strategies , 1999, Artificial Intelligence Today.

[4]  Niki Pfeifer,et al.  The new psychology of reasoning: A mental probability logical perspective , 2013 .

[5]  Geoffrey P. Goodwin,et al.  Logic, probability, and human reasoning , 2015, Trends in Cognitive Sciences.

[6]  David S. Touretzky,et al.  The Mathematics of Inheritance Systems , 1984 .

[7]  W. W. Bledsoe,et al.  Non-Resolution Theorem Proving , 1977, Artif. Intell..

[8]  Jacques D. Fleuriot,et al.  Machine Learning for Inductive Theorem Proving , 2018, AISC.

[9]  Geoff Sutcliffe The 9th IJCAR Automated Theorem Proving System Competition - CASC-J9 , 2018, AI Commun..

[10]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Igor Douven,et al.  The New Paradigm and Mental Models , 2015, Trends in Cognitive Sciences.

[12]  Gabriele Kern-Isberner,et al.  Formal Nonmonotonic Theories and Properties of Human Defeasible Reasoning , 2017, Minds and Machines.

[13]  Matthew L. Ginsberg AI and nonmonotonic reasoning , 1994 .

[14]  Sangeet Khemlani,et al.  Illusions in Reasoning , 2017, Minds and Machines.

[15]  Philip N Johnson-Laird,et al.  The Quarterly Journal of Experimental Psychology the Need to Explain , 2022 .

[16]  Philip N. Johnson-Laird,et al.  Facts and Possibilities: A Model-Based Theory of Sentential Reasoning , 2018, Cogn. Sci..

[17]  Philip N. Johnson-Laird,et al.  Strategies in sentential reasoning , 2002, Cogn. Sci..

[18]  Sangeet Khemlani,et al.  The processes of inference , 2013, Argument Comput..

[19]  Seyed-Mohsen Moosavi-Dezfooli,et al.  DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  P. Johnson-Laird How We Reason , 2006 .

[21]  Roderic A. Girle,et al.  Modal Logics and Philosophy , 2000 .

[22]  Thomas Hinterecker,et al.  Modality, probability, and mental models. , 2016, Journal of experimental psychology. Learning, memory, and cognition.

[23]  G. Reeke Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[24]  Gerhard Gentzen,et al.  Investigations into Logical Deduction , 1970 .

[25]  M. Braine On the Relation Between the Natural Logic of Reasoning and Standard Logic. , 1978 .

[26]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[27]  P. Johnson-Laird,et al.  Propositional reasoning by model. , 1992, Psychological review.

[28]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[29]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[30]  P. Johnson-Laird,et al.  Cognitive changes from explanations , 2013 .

[31]  Victor W. Marek,et al.  Nonmonotonic logic - context-dependent reasoning , 1997, Artificial intelligence.

[32]  Sangeet Khemlani,et al.  Naive Probability: Model-Based Estimates of Unique Events , 2015, Cogn. Sci..

[33]  Joseph Y. Halpern,et al.  Model Checking vs. Theorem Proving: A Manifesto , 1991, KR.

[34]  Sonya E. Keene,et al.  Object-oriented programming in COMMON LISP - a programmer's guide to CLOS , 1989 .

[35]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[36]  J. Gregory Trafton,et al.  Episodes, events, and models , 2015, Front. Hum. Neurosci..

[37]  Drew McDermott,et al.  Non-Monotonic Logic I , 1987, Artif. Intell..

[38]  C. Hartshorne,et al.  Collected Papers of Charles Sanders Peirce , 1935, Nature.

[39]  Markus Knauff,et al.  A theory and a computational model of spatial reasoning with preferred mental models. , 2013, Psychological review.

[40]  Robert Kowalski Computational Logic and Human Thinking: Truth , 2011 .

[41]  Allen Newell,et al.  Empirical explorations with the logic theory machine: a case study in heuristics , 1995 .

[42]  P N Johnson-Laird,et al.  Reasoning about relations. , 2005, Psychological review.

[43]  David E. Over,et al.  New paradigm psychology of reasoning: An introduction to the special issue edited by Elqayam, Bonnefon, and Over , 2013 .

[44]  Masasi Hattori Probabilistic representation in syllogistic reasoning: A theory to integrate mental models and heuristics , 2016, Cognition.

[45]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[46]  John McCarthy,et al.  Applications of Circumscription to Formalizing Common Sense Knowledge , 1987, NMR.

[47]  Donald W. Loveland,et al.  Automated theorem proving: a logical basis , 1978, Fundamental studies in computer science.

[48]  P. Johnson-Laird,et al.  Reasoning from inconsistency to consistency. , 2004, Psychological review.

[49]  Philip N. Johnson-Laird,et al.  Reasoning about possibilities: human reasoning violates all normal modal logics , 2018, CogSci.

[50]  Jürgen Dix,et al.  Nonmonotonic Reasoning: An Overview , 1997, CSLI Lecture Notes.

[51]  Kouichi Sakurai,et al.  One Pixel Attack for Fooling Deep Neural Networks , 2017, IEEE Transactions on Evolutionary Computation.

[52]  J. A. Robinson,et al.  Logic, form and function , 1979 .

[53]  L. Rips Cognitive Processes in Propositional Reasoning. , 1983 .

[54]  Michael Kinyon,et al.  Proof simplification and automated theorem proving , 2018, Philosophical Transactions of the Royal Society A.

[55]  Drew McDermott,et al.  A critique of pure reason 1 , 1987, The Philosophy of Artificial Intelligence.

[56]  Joshua B. Tenenbaum,et al.  Building machines that learn and think like people , 2016, Behavioral and Brain Sciences.

[57]  Maria Paola Bonacina,et al.  On First-Order Model-Based Reasoning , 2015, Logic, Rewriting, and Concurrency.

[58]  John McCarthy,et al.  Programs with common sense , 1960 .

[59]  Francis Jeffry Pelletier,et al.  Seventy-five problems for testing automatic theorem provers , 1986, Journal of Automated Reasoning.

[60]  R. Jeffrey Formal Logic: Its Scope and Limits , 1981 .

[61]  Monica Bucciarelli,et al.  Kinematic mental simulations in abduction and deduction , 2013, Proceedings of the National Academy of Sciences.

[62]  R. Smullyan First-Order Logic , 1968 .

[63]  Sharmin Jalal Non-Monotonic Reasoning: Mimicking Human Thought Process through Argumentation , 2015 .

[64]  Larry Wos,et al.  Automated reasoning - 33 basic research problems , 1988 .

[65]  P N Johnson-Laird,et al.  Hidden conflicts: explanations make inconsistencies harder to detect. , 2012, Acta psychologica.

[66]  William McCune,et al.  Solution of the Robbins Problem , 1997, Journal of Automated Reasoning.

[67]  Robert A. Kowalski,et al.  Semantic Trees in Automatic Theorem-Proving , 1983 .