An Analytic Tableaux Model for Deductive Mastermind Empirically Tested with a Massively Used Online Learning System

The paper is concerned with the psychological relevance of a logical model for deductive reasoning. We propose a new way to analyze logical reasoning in a deductive version of the Mastermind game implemented within a popular Dutch online educational learning system (Math Garden). Our main goal is to derive predictions about the difficulty of Deductive Mastermind tasks. By means of a logical analysis we derive the number of steps needed for solving these tasks (a proxy for working memory load). Our model is based on the analytic tableaux method, known from proof theory. We associate the difficulty of Deductive Mastermind game-items with the size of the corresponding logical trees obtained by the tableaux method. We derive empirical hypotheses from this model. A large group of students (over 37 thousand children, 5–12 years of age) played the Deductive Mastermind game, which gave empirical difficulty ratings of all 321 game-items. The results show that our logical approach predicts these item ratings well, which supports the psychological relevance of our model.

[1]  R. Smullyan.  First-Order Logic , 1968 .

[2]  Yousef Saad,et al.  Modified Krylov acceleration for parallel environments , 1999 .

[3]  Guo-Qiang Zhang,et al.  Mastermind is NP-Complete , 2005, ArXiv.

[4]  Rineke Verbrugge,et al.  Logic Meets Cognition: Empirical Reasoning in Games , 2010, MALLOW.

[5]  Jakub Szymanik,et al.  Quantifiers in TIME and SPACE : computational complexity of generalized quantifiers in natural language , 2009 .

[6]  Daniel A. Braun,et al.  Risk-Sensitivity in Sensorimotor Control , 2011, Front. Hum. Neurosci..

[7]  Jakub Szymanik,et al.  Computational complexity of polyadic lifts of generalized quantifiers in natural language , 2010 .

[8]  Sujata Ghosh,et al.  On combining cognitive and formal modeling: A case study involving strategic reasoning , 2011 .

[9]  Han L J van der Maas,et al.  Distinct discrimination learning strategies and their relation with spatial memory and attentional control in 4- to 14-year-olds. , 2012, Journal of experimental child psychology.

[10]  Eric Sven Ristad.  The language complexity game , 1993 .

[11]  Evert W. Beth,et al.  Semantic Entailment And Formal Derivability , 1955 .

[12]  Nina Gierasimczuk,et al.  Branching Quantification v. Two-way Quantification , 2009, J. Semant..

[13]  Iris van Rooij,et al.  The Tractable Cognition Thesis , 2008, Cogn. Sci..

[14]  Radek Pelánek,et al.  Difficulty Rating of Sudoku Puzzles by a Computational Model , 2011, FLAIRS.

[15]  K. Koyama,et al.  An Optimal Mastermind Strategy , 1993 .

[16]  Ingmar Visser,et al.  The dynamics of development on the Dimensional Change Card Sorting task. , 2011, Developmental science.

[17]  Robert C. Berwick,et al.  Computational complexity and natural language , 1987 .

[18]  Robert C. Berwick,et al.  The Grammatical Basis of Linguistic Performance: Language Use and Acquisition , 1986 .

[19]  D. Knuth.  The Computer as Master Mind , 1977 .

[20]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[21]  Rineke Verbrugge,et al.  Learning to Apply Theory of Mind , 2008, J. Log. Lang. Inf..

[22]  Johan Kwisthout,et al.  Intentional Communication: Computationally Easy or Difficult? , 2011, Front. Hum. Neurosci..

[23]  Brenda R. J. Jansen,et al.  Statistical Test of the Rule Assessment Methodology by Latent Class Analysis , 1997 .

[24]  S. Klinkenberg,et al.  Rekentuin.nl: combinatie van oefenen en toetsen , 2010 .

[25]  G. Maris,et al.  Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy , 2012 .

[26]  H.L.J. van der Maas,et al.  Stagewise cognitive development: an application of catastrophe theory. , 1992, Psychological review.

[27]  N. Taatgen,et al.  What Eye Movements Can Tell about Theory of Mind in a Strategic Game , 2012, PloS one.

[28]  Jakub Szymanik,et al.  Comprehension of Simple Quantifiers: Empirical Evaluation of a Computational Model , 2010, Cogn. Sci..

[29]  S. Klinkenberg,et al.  Computer adaptive practice of Maths ability using a new item response model for on the fly ability and difficulty estimation , 2011, Comput. Educ..

[30]  Barteld P. Kooi.  Yet Another Mastermind Strategy , 2005, J. Int. Comput. Games Assoc..

[31]  Jakub Szymanik,et al.  A computational approach to quantifiers as an explanation for some language impairments in schizophrenia. , 2011, Journal of communication disorders.