A computational model for solving problems from the Raven’s Progressive Matrices intelligence test using iconic visual representations

We describe a computational model for solving problems from Raven's Progressive Matrices (RPM), a family of standardized intelligence tests. Existing computational models for solving RPM problems generally reason over amodal propositional representations of test inputs. However, there is considerable evidence that humans can also apply imagery-based reasoning strategies to RPM problems, in which processes rooted in perception operate over modal representations of test inputs. In this paper, we present the ''affine model,'' a computational model that simulates modal reasoning by using iconic visual representations together with affine and set transformations over these representations to solve a given RPM problem. Various configurations of the affine model successfully solve between 33 and 38 of the 60 problems on the Standard Progressive Matrices, which matches levels of performance for typically developing 9- to 11-year-old children. This suggests that, for at least a sizeable subset of RPM problems, it is not always necessary to extract amodal symbols in order to arrive at the correct answer, and iconic visual representations constitute a sufficient form of representation to successfully solve these problems. We intend for the affine model to serve as a complementary computational account to existing propositional models, which together may provide an integrated, dual-process account of human problem solving on the RPM.

[1]  S. Kosslyn,et al.  The case for mental imagery , 2006 .

[2]  N. J. Mackintosh,et al.  What do Raven's Matrices measure? An analysis in terms of sex differences , 2005 .

[3]  David F. Lohman,et al.  A Factor Analysis of Raven's Advanced Progressive Matrices Freed of Difficulty Factors , 1981 .

[4]  Sven Bölte,et al.  Brief Report: The Level and Nature of Autistic Intelligence Revisited , 2009, Journal of Autism and Developmental Disorders.

[5]  Barbara Tversky,et al.  Pictorial Encoding of Sentences in Sentence—Picture Comparison , 1975 .

[6]  Jeffrey Coney Individual differences and task format in sentence verification , 1988 .

[7]  Ricardo Primi,et al.  Complexity of Geometric Inductive Reasoning Tasks: Contribution to the Understanding of Fluid Intelligence. , 2001 .

[8]  Ashok K. Goel,et al.  Function-Follows-Form Transformations in Scientific Problem Solving , 2000 .

[9]  M. Meo,et al.  Element salience as a predictor of item difficulty for Raven's Progressive Matrices , 2007 .

[10]  Simone Cirillo,et al.  An Anthropomorphic Solver for Raven's Progressive Matrices , 2010 .

[11]  J. Desmond,et al.  Neural Substrates of Fluid Reasoning: An fMRI Study of Neocortical Activation during Performance of the Raven's Progressive Matrices Test , 1997, Cognitive Psychology.

[12]  Ashok K. Goel,et al.  Visual analogy: Viewing analogical retrieval and mapping as constraint satisfaction problems , 2006, Applied Intelligence.

[13]  Mary Lou Maher,et al.  KRITIK: An Early Case-Based Design System , 2014 .

[14]  B. Stafford Visual Analogy: Consciousness as the Art of Connecting , 1999 .

[15]  Ashok K. Goel,et al.  Visual Models in Analogical Problem Solving , 2005 .

[16]  Jim Davies,et al.  Proteus: Visuospatial analogy in problem-solving , 2008, Knowl. Based Syst..

[17]  Nancy J. Nersessian,et al.  Creating Scientific Concepts , 2008 .

[18]  Michael Leyton,et al.  A generative theory of shape , 2004, Proceedings Shape Modeling Applications, 2004..

[19]  A. Goel,et al.  How thinking in pictures can explain many characteristic behaviors of autism , 2008, 2008 7th IEEE International Conference on Development and Learning.

[20]  Peter G. Underwood Issues and applications of case‐based reasoning in design , 1998 .

[21]  Herbert H. Clark,et al.  On the process of comparing sentences against pictures , 1972 .

[22]  J. Clement Creative Model Construction in Scientists and Students: The Role of Imagery, Analogy, and Mental Simulation , 2008 .

[23]  David J. Chalmers,et al.  High-level perception, representation, and analogy: a critique of artificial intelligence methodology , 1992, J. Exp. Theor. Artif. Intell..

[24]  Ashok K. Goel,et al.  Visual Re-Representation in Creative Analogies , 2007 .

[25]  S E Palmer,et al.  Structural aspects of visual similarity , 1978, Memory & cognition.

[26]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[27]  Aljoscha C. Neubauer,et al.  Reaction times in a sentence-picture verification test and intelligence: Individual strategies and effects of extended practice ☆ , 1994 .

[28]  Amitash Ojha,et al.  PERCEPTUAL VS CONCEPTUAL SIMILARITIES AND CREATION OF NEW FEATURES IN VISUAL METAPHORS , 2009 .

[29]  Selmer Bringsjord,et al.  What is Artificial Intelligence? Psychometric AI as an Answer , 2003, IJCAI.

[30]  Ashok K. Goel,et al.  Use of design patterns in analogy-based design , 2004, Adv. Eng. Informatics.

[31]  J. L. Ellis,et al.  A Rasch analysis of Raven’s standard progressive matrices , 2000 .

[32]  D. Gentner,et al.  Advances in Analogy Research: Integration of Theory and Data from the Cognitive, Computational, and Neural Sciences , 1997, Cognitive Psychology.

[33]  B. Kokinov Analogy is like Cognition: Dynamic, Emergent, and Context-Sensitive , 1999 .

[34]  Thomas G. Evans,et al.  A heuristic program to solve geometric-analogy problems , 1964, AFIPS '64 (Spring).

[35]  Marcel Adam Just,et al.  Sentence comprehension: A psycholinguistic processing model of verification. , 1975 .

[36]  David Chan,et al.  Verbal overshadowing effects on Raven's advanced progressive matrices: Evidence for multidimensional performance determinants , 1995 .

[37]  Jim Davies,et al.  Visual Analogy in Problem Solving , 2001, IJCAI.

[38]  A. Tversky Features of Similarity , 1977 .

[39]  Linda Jeffery,et al.  Race-specific norms for coding face identity and a functional role for norms. , 2010, Journal of vision.

[40]  Erik D. Reichle,et al.  The Neural Bases of Strategy and Skill in Sentence–Picture Verification , 2000, Cognitive Psychology.

[41]  Douglas R. Hofstadter,et al.  Fluid Concepts and Creative Analogies , 1995 .

[42]  Gabriela Goldschmidt,et al.  Expertise and the use of visual analogy: implications for design education , 1999 .

[43]  K GoelAshok,et al.  A computational model for solving problems from the Raven's Progressive Matrices intelligence test using iconic visual representations , 2013 .

[44]  J. Schooler,et al.  Verbal overshadowing of visual memories: Some things are better left unsaid , 1990, Cognitive Psychology.

[45]  Maithilee Kunda,et al.  Reasoning on the Raven's Advanced Progressive Matrices Test with Iconic Visual Representations , 2012, CogSci.

[46]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[47]  Jim Davies,et al.  A computational model of visual analogies in design , 2009, Cognitive Systems Research.

[48]  Bipin Indurkhya,et al.  On Creation of Features and Change of Representation , 1998 .

[49]  Maithilee Kunda,et al.  Thinking in Pictures as a Cognitive Account of Autism , 2011, Journal of autism and developmental disorders.

[50]  Paul Thagard,et al.  Dynamic Imagery: A Computational Model of Motion and Visual Analogy , 2002 .

[51]  Per B Sederberg,et al.  A novel method for analyzing sequential eye movements reveals strategic influence on Raven's Advanced Progressive Matrices. , 2011, Journal of vision.

[52]  A. Smith,et al.  Diaschisis, site, time and other factors in raven performances of adults with focal cerebral lesions. , 1988, The International journal of neuroscience.

[53]  Earl Hunt,et al.  Individual Differences in the Verification of Sentence-Picture Relationships , 1978 .

[54]  D. Bors,et al.  Eye-movement analysis demonstrates strategic influences on intelligence , 2006 .

[55]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[56]  Maithilee Kunda,et al.  A Fractal Analogy Approach to the Raven's Test of Intelligence , 2010, Visual Representations and Reasoning.

[57]  J. Allik,et al.  Sex Differences on Three Factors Identified in Raven's Standard Progressive Matrices , 2004 .

[58]  T. Zeffiro,et al.  Enhanced visual processing contributes to matrix reasoning in autism , 2009, Human brain mapping.

[59]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[60]  Michael J. Lawson,et al.  Effects of strategy training on Progressive Matrices performance , 1983 .

[61]  C. Spearman The nature of "intelligence" and the principles of cognition , 1926 .

[62]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[63]  J. Belliveau,et al.  Cognitive Differences in Pictorial Reasoning Between High-Functioning Autism and Asperger’s Syndrome , 2009, Journal of autism and developmental disorders.

[64]  C. E. Bethell-Fox,et al.  Adaptive reasoning: Componential and eye movement analysis of geometric analogy performance ☆ , 1984 .

[65]  PATRICK W. YANER,et al.  VISUAL ANALOGY: VIEWING RETRIEVAL AND MAPPING AS CONSTRAINT SATISFACTION PROBLEMS , 2004 .

[66]  Kenneth D. Forbus,et al.  A Structure-Mapping Model of Raven's Progressive Matrices , 2010 .

[67]  Laurent Mottron,et al.  The Level and Nature of Autistic Intelligence , 2007, Psychological science.

[68]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[69]  Margaret A. Boden,et al.  Douglas Hofstadter and the Fluid Analogies Research Group, Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought , 2004, Minds and Machines.

[70]  Chris Eliasmith,et al.  A Neural Model of Rule Generation in Inductive Reasoning , 2011, Top. Cogn. Sci..

[71]  Kevin M. Brooks,et al.  Thoughts beyond words : When language overshadows insight , 1993 .

[72]  Douglas A. Bors,et al.  The quest for item types based on information processing: An analysis of Raven's Advanced Progressive Matrices, with a consideration of gender differences , 2008 .

[73]  G J Hitch,et al.  Manipulation of visual mental images in children and adults. , 1992, Journal of experimental child psychology.

[74]  C. Villardita,et al.  Raven's Colored Progressive Matrices and Intellectual Impairment in Patients with Focal Brain Damage , 1985, Cortex.