Logic and Complexity in Cognitive Science

This chapter surveys the use of logic and computational complexity theory in cognitive science. We emphasize in particular the role played by logic in bridging the gaps between Marr’s three levels: representation theorems for non-monotonic logics resolve algorithmic/implementation debates, while complexity theory probes the relationship between computational task analysis and algorithms. We argue that the computational perspective allows feedback from empirical results to guide the development of increasingly subtle computational models. We defend this perspective via a survey of the role of logic in several classic problems in cognitive science (the Wason selection task, the frame problem, the connectionism/symbolic systems debate) before looking in more detail at case studies involving quantifier processing and social cognition. In these examples, models developed by Johan van Benthem have been supplemented with complexity analysis to drive successful programs of empirical research.

[1]  J.F.A.K. van Benthem Cognition as Interaction , 2005 .

[2]  Peter Pagin,et al.  Communication And The complexity of semantics , 2012 .

[3]  Rineke Verbrugge,et al.  Logic and Social Cognition , 2009, J. Philos. Log..

[4]  P. Smolensky Connectionism, Constituency, and the Language of Thought ; CU-CS-416-88 , 1988 .

[5]  John R. Anderson The Adaptive Character of Thought , 1990 .

[6]  Daniel Taylor,et al.  Evolution of the social contract , 2014 .

[7]  William G. Faris Shadows of the Mind: A Search for the Missing Science of Consciousness , 1997 .

[8]  Han L. J. van der Maas,et al.  An Analytic Tableaux Model for Deductive Mastermind Empirically Tested with a Massively Used Online Learning System , 2013, J. Log. Lang. Inf..

[9]  Robin Clark,et al.  Neural basis for generalized quantifier comprehension , 2005, Neuropsychologia.

[10]  Rineke Verbrugge,et al.  Logic and Cognition: Special Issue of Best Papers of the ESSLLI 2012 Workshop , 2013, J. Log. Lang. Inf..

[11]  T. Gelder,et al.  Classical Questions, Radical Answers: Connectionism and the Structure of Mental Representations , 1991 .

[12]  Camilo Thorne,et al.  Studying the Distribution of Fragments of English Using Deep Semantic Annotation , 2012 .

[13]  Jakub Szymanik,et al.  Exploring the tractability border in epistemic tasks , 2012, Synthese.

[14]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[15]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[16]  A. Clark Supersizing the Mind , 2008 .

[17]  Iris van Rooij,et al.  Parameterized Complexity in Cognitive Modeling: Foundations, Applications and Opportunities , 2008, Comput. J..

[18]  W. Freeman Waves, Pulses, and the Theory of Neural Masses , 1972 .

[19]  Herbert A. Simon,et al.  Trial and error search in solving difficult problems: Evidence from the game of chess , 2007 .

[20]  William G. Faris The number sense: How the mind creates mathematics by Stanislas Dehaene , 1998, Complex..

[21]  Uziel Sandler,et al.  Neural cell behavior and fuzzy logic , 2008 .

[22]  Jakub Szymanik,et al.  Quantifiers and Working Memory , 2009, Amsterdam Colloquium on Logic, Language and Meaning.

[23]  Aldo Rustichini,et al.  Experience and insight in the Race game , 2010 .

[24]  Sarit Kraus,et al.  Nonmonotonic Reasoning, Preferential Models and Cumulative Logics , 1990, Artif. Intell..

[25]  Hava T. Siegelmann,et al.  Analog computation via neural networks , 1993, [1993] The 2nd Israel Symposium on Theory and Computing Systems.

[26]  Giorgio Gambosi,et al.  Complexity and Approximation , 1999, Springer Berlin Heidelberg.

[27]  N. Foo Conceptual Spaces—The Geometry of Thought , 2022 .

[28]  Peter van Emde Boas,et al.  Machine Models and Simulation , 1990, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[29]  J.F.A.K. van Benthem,et al.  Language in Action: Categories, Lambdas and Dynamic Logic , 1997 .

[30]  Rineke Verbrugge,et al.  Strategic Reasoning: Building Cognitive Models from Logical Formulas , 2014, Journal of Logic, Language and Information.

[31]  Johan van Benthem,et al.  Logic and Reasoning: do the facts matter? , 2008, Stud Logica.

[32]  Hannes Leitgeb,et al.  Interpreted Dynamical Systems and Qualitative Laws: from Neural Networks to Evolutionary Systems , 2005, Synthese.

[33]  Giorgio Gambosi,et al.  Complexity and approximation: combinatorial optimization problems and their approximability properties , 1999 .

[34]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[35]  Pascal Hitzler,et al.  Logic programs and connectionist networks , 2004, J. Appl. Log..

[36]  Richard A. Griggs,et al.  The elusive thematic‐materials effect in Wason's selection task , 1982 .

[37]  Sanjeev Arora,et al.  Computational Complexity: A Modern Approach , 2009 .

[38]  H. Rijn,et al.  The Facilitative Effect of Context on Second-Order Social Reasoning , 2010 .

[39]  Allen Newell The Knowledge Level (Presidential Address) , 1980, AI Mag..

[40]  Jakub Szymanik,et al.  Comprehension of Simple Quantifiers: Empirical Evaluation of a Computational Model , 2010, Cogn. Sci..

[41]  Jakub Szymanik,et al.  Quantifiers in TIME and SPACE : computational complexity of generalized quantifiers in natural language , 2009 .

[42]  Nina Gierasimczuk,et al.  A note on a generalization of the Muddy Children puzzle , 2011, TARK XIII.

[43]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[44]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[45]  T. Gelder,et al.  The dynamical hypothesis in cognitive science , 1998, Behavioral and Brain Sciences.

[46]  Salil P. Vadhan,et al.  Computational Complexity , 2005, Encyclopedia of Cryptography and Security.

[47]  Apostolos Syropoulos,et al.  Hypercomputation: Computing Beyond the Church-Turing Barrier (Monographs in Computer Science) , 2007 .

[48]  Gadi Pinkas,et al.  Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge , 1995, Artif. Intell..

[49]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[50]  W. Hoek,et al.  Dynamic Epistemic Logic , 2007 .

[51]  Aldo Rustichini,et al.  Experience and Abstract Reasoning in Learning Backward Induction , 2011, Front. Neurosci..

[52]  Jakub Szymanik,et al.  A comment on a neuroimaging study of natural language quantifier comprehension , 2007, Neuropsychologia.

[53]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[54]  Manindra Agrawal,et al.  PRIMES is in P , 2004 .

[55]  Rineke Verbrugge,et al.  Using intrinsic complexity of turn-taking games to predict participants' reaction times , 2013, CogSci.

[56]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[57]  A. Clark,et al.  Supersizing The Mind Embodiment Action And Cognitive Extension Andy Clark , 2016 .

[58]  P. Wason,et al.  Natural and contrived experience in a reasoning problem , 1971 .

[59]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[60]  L. Cosmides The logic of social exchange: Has natural selection shaped how humans reason? Studies with the Wason selection task , 1989, Cognition.

[61]  Jeffrey Lidz,et al.  The Meaning of ‘Most’: Semantics, Numerosity and Psychology , 2009 .

[62]  D. Bernstein DISTINGUISHING PRIME NUMBERS FROM COMPOSITE NUMBERS , 2022 .

[63]  Paul M. B. Vitányi,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1993, Graduate Texts in Computer Science.

[64]  Jakub Szymanik,et al.  Automata and Complexity in Multiple-Quantifier Sentence Verification , 2013 .

[65]  Murray Shanahan Solving the frame problem - a mathematical investigation of the common sense law of inertia , 1997 .

[66]  J. Benthem Essays in Logical Semantics , 1986 .

[67]  Rineke Verbrugge,et al.  Learning to Apply Theory of Mind , 2008, J. Log. Lang. Inf..

[68]  Ronald Fagin Generalized first-order spectra, and polynomial. time recognizable sets , 1974 .

[69]  Rineke Verbrugge,et al.  I Do Know What You Think I Think: Second-Order Theory Of Mind In Strategic Games Is Not That Difficult , 2011, CogSci.

[70]  Tomohiro Hoshi,et al.  Merging DEL and ETL , 2010, J. Log. Lang. Inf..

[71]  Neil Immerman,et al.  Descriptive Complexity , 1999, Graduate Texts in Computer Science.

[72]  Iris van Rooij,et al.  The Tractable Cognition Thesis , 2008, Cogn. Sci..

[73]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[74]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[75]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[76]  Rineke Verbrugge,et al.  Logic Meets Cognition: Empirical Reasoning in Games , 2010, MALLOW.

[77]  P. Smolensky On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[78]  Yoav Shoham,et al.  A semantical approach to nonmonotonic logics , 1987, LICS 1987.

[79]  Johan van Benthem,et al.  Extensive Games as Process Models , 2002, J. Log. Lang. Inf..

[80]  H. Oosterbeek,et al.  Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-Analysis , 2001 .

[81]  Keith Stenning,et al.  Human Reasoning and Cognitive Science , 2008 .

[82]  D. Chalmers Why Fodor and Pylyshyn Were Wrong: The Simplest Refutation , 1990 .

[83]  W. Freeman How Brains Make Up Their Minds , 1999 .

[84]  Nina Gierasimczuk,et al.  Invariance Properties of Quantifiers and Multiagent Information Exchange , 2011, MOL.

[85]  P. Boas Machine models and simulations , 1991 .

[86]  T. Hedden,et al.  What do you think I think you think?: Strategic reasoning in matrix games , 2002, Cognition.

[87]  Yehoshua Bar-Hillel,et al.  The Intrinsic Computational Difficulty of Functions , 1969 .

[88]  J. Edmonds Paths, Trees, and Flowers , 1965, Canadian Journal of Mathematics.

[89]  Bart Verheij,et al.  How much does it help to know what she knows you know? An agent-based simulation study , 2013, Artif. Intell..

[90]  Yuri Gurevich The Value, if any, of Decidability , 1995, Bull. EATCS.

[91]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[92]  Apostolos Syropoulos,et al.  Hypercomputation: Computing Beyond the Church-Turing Barrier , 2008 .

[93]  Krysia Broda,et al.  Neural-symbolic learning systems - foundations and applications , 2012, Perspectives in neural computing.

[94]  Melvin Fitting,et al.  Fixpoint Semantics for Logic Programming a Survey , 2001, Theor. Comput. Sci..

[95]  Jakub Szymanik,et al.  A computational approach to quantifiers as an explanation for some language impairments in schizophrenia. , 2011, Journal of communication disorders.

[96]  Dov M. Gabbay,et al.  What Is Negation as Failure? , 2012, Logic Programs, Norms and Action.

[97]  Oliver Bott,et al.  Interpreting tractable versus intractable reciprocal sentences , 2011, IWCS.

[98]  Shane Steinert-Threlkeld,et al.  Iterating semantic automata , 2013 .

[99]  Hava T. Siegelmann,et al.  Neural and Super-Turing Computing , 2003, Minds and Machines.

[100]  R. Shillcock,et al.  Proceedings of the Twenty-Sixth Annual Conference of the Cognitive Science Society , 1998 .

[101]  Jakub Szymanik,et al.  Computational complexity of polyadic lifts of generalized quantifiers in natural language , 2010 .

[102]  L. Cosmides,et al.  Cognitive adaptations for social exchange. , 1992 .

[103]  P. Johnson-Laird,et al.  REASONING AND A SENSE OF REALITY , 1972 .

[104]  Oliver Bott,et al.  Easy Solutions for a Hard Problem? The Computational Complexity of Reciprocals with Quantificational Antecedents , 2013, ESSLLI Logic & Cognition Workshop.

[105]  Johan van Benthem,et al.  Logical Dynamics of Information and Interaction , 2014 .

[106]  B. Skyrms The Stag Hunt and the Evolution of Social Structure , 2003 .

[107]  Steffen Hölldobler,et al.  Towards a New Massively Parallel Computational Model for Logic Programming , 1994 .

[108]  Jakub Szymanik,et al.  Contribution of working memory in parity and proportional judgments , 2011, Cognitive and Empirical Pragmatics.

[109]  Iris van Rooij,et al.  Sources of complexity in subset choice , 2005 .

[110]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[111]  Sujata Ghosh,et al.  On combining cognitive and formal modeling: A case study involving strategic reasoning , 2011 .

[112]  Pavel Pudlák,et al.  A Note on Applicability of the Incompleteness Theorem to Human Mind , 1999, Ann. Pure Appl. Log..

[113]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[114]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[115]  Marcin Mostowski,et al.  Computational semantics for monadic quantifiers , 1998, J. Appl. Non Class. Logics.

[116]  Paul Benacerraf,et al.  God, The Devil, And Gödel , 1967 .

[117]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[118]  Yuri GurevichElectrical Feasible Functions , 1993 .

[119]  Maartje E. J. Raijmakers,et al.  Children’s strategy use when playing strategic games , 2012, Synthese.

[120]  J. Lucas Minds, Machines and Gödel , 1961, Philosophy.

[121]  P. Hayes,et al.  Cognitive Wheels : The Frame Problem of AI , 2022 .

[122]  Reinhard Blutner Nonmonotonic Inferences and Neural Networks , 2004 .

[123]  H. Gintis,et al.  A Cooperative Species: Human Reciprocity and Its Evolution , 2011 .

[124]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[125]  J. Tenenbaum,et al.  Probabilistic models of cognition: where next? , 2006, Trends in Cognitive Sciences.

[126]  K. Holyoak,et al.  Pragmatic versus syntactic approaches to training deductive reasoning , 1986, Cognitive Psychology.

[127]  Daniel Ansari,et al.  The Evolution of Numerical Cognition: From Number Neurons to Linguistic Quantifiers , 2008, The Journal of Neuroscience.

[128]  A. Rosas A COOPERATIVE SPECIES: HUMAN RECIPROCITY AND ITS EVOLUTION , 2013 .

[129]  H T Siegelmann,et al.  Dating and Context of Three Middle Stone Age Sites with Bone Points in the Upper Semliki Valley, Zaire , 2007 .

[130]  Marcello Frixione,et al.  Tractable Competence , 2001, Minds and Machines.

[131]  Christopher Cherniak,et al.  Minimal Rationality , 1986, Computational models of cognition and perception.

[132]  Wc Taylor,et al.  Special Issue , 2000, International Journal of Recent Technology and Engineering.

[133]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[134]  Dirk Herrmann,et al.  Essays In Logical Semantics , 2016 .

[135]  Hannes Leitgeb,et al.  Nonmonotonic reasoning by inhibition nets , 2001, Artif. Intell..

[136]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[137]  Marcin Mostowski,et al.  Computational complexity of the semantics of some natural language constructions , 2004, Ann. Pure Appl. Log..

[138]  Ian Pratt-Hartmann,et al.  Fragments of Language , 2004, J. Log. Lang. Inf..

[139]  Marco Schaerf,et al.  A Survey of Complexity Results for Nonmonotonic Logics , 1993, J. Log. Program..

[140]  L. Cosmides,et al.  The Adapted mind : evolutionary psychology and the generation of culture , 1992 .

[141]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[142]  P. Kugel,et al.  Thinking may be more than computing , 1986, Cognition.

[143]  John McCarthy,et al.  Circumscription - A Form of Non-Monotonic Reasoning , 1980, Artif. Intell..

[144]  T. Gelder,et al.  What Might Cognition Be, If Not Computation? , 1995 .

[145]  Tomohiro Hoshi,et al.  Synchronizing Diachronic Uncertainty , 2011, J. Log. Lang. Inf..

[146]  Han L. J. van der Maas,et al.  Logical and psychological analysis of deductive mastermind , 2012, ESSLLI Logic & Cognition Workshop.

[147]  Adam Gifford,et al.  The Evolution of the Social Contract , 2002 .

[148]  Rineke Verbrugge,et al.  Children’s Application of Theory of Mind in Reasoning and Language , 2008, J. Log. Lang. Inf..

[149]  Eric Sven Ristad The language complexity game , 1993 .

[150]  Barbara Tomaszewicz Quantifiers and visual cognition: the processing of proportional and superlative most in Bulgarian and Polish , 2012, ESSLLI Logic & Cognition Workshop.

[151]  Johan van Benthem,et al.  Merging Frameworks for Interaction , 2009, J. Philos. Log..

[152]  Tim van Gelder,et al.  Compositionality: A Connectionist Variation on a Classical Theme , 1990, Cogn. Sci..

[153]  Hannes Leitgeb,et al.  Nonmonotonic Reasoning by Inhibition Nets II , 2003, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[154]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[155]  W. Freeman Second Commentary: On the proper treatment of connectionism by Paul Smolensky (1988) - Neuromachismo Rekindled , 1989 .

[156]  Andy Clark,et al.  Finding the Mind , 2011 .

[157]  Solomon Feferman,et al.  Penrose’s Gödelian argument , 2002 .

[158]  N. Taatgen,et al.  What Eye Movements Can Tell about Theory of Mind in a Strategic Game , 2012, PloS one.

[159]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[160]  Daniel C. Dennett,et al.  Cognitive Wheels: The Frame Problem of AI , 1990, The Philosophy of Artificial Intelligence.

[161]  Robin Clark,et al.  Quantifier comprehension in corticobasal degeneration , 2006, Brain and Cognition.

[162]  H. Levesque Logic and the complexity of reasoning , 1988 .