Guiding Attention Produces Inferences in Diagram-Based Problem Solving

Many eye-tracking studies have shown that visual attention patterns during diagram-based problem solving, measured by eye movements, reveal critical aspects of the problem solving process that traditional measures like solution time and accuracy cannot address. In our first experiment (n = 14), we use this method during the solution of a widely-studied high level reasoning problem, Duncker's (1945) radiation problem, to show that differences in visual attention to a particular diagram feature corresponds with correctly solving the problem. We then extend these findings in a second experiment (n = 81) to evaluate cognative sensitivity to perceptual changes in the diagram. We show that problem solvers are highly sensitive to the diagram structure, and that the shifts in attention that result from subtle perceptual changes in the diagram appear to have a dramatic positive effect on reasoning.

[1]  Jon Barwise,et al.  Logical reasoning with diagrams , 1996 .

[2]  P Langley,et al.  Proceedings of the 19th Annual Conference of the Cognitive Science Society , 1997 .

[3]  Heinz Mandl,et al.  Knowledge Acquisition from Text and Pictures , 1989 .

[4]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[5]  Kim J. Vicente,et al.  Local applications of the ecological approach to human-machine systems , 1995 .

[6]  R E Mayer.  Comprehension as affected by structure of problem representation , 1976, Memory & cognition.

[7]  K. Duncker,et al.  On problem-solving , 1945 .

[8]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[9]  Barry H. Cohen,et al.  Evidence for image-scanning eye movements during transitive inference , 1998, Biological Psychology.

[10]  R. Mayer.  Thinking, Problem Solving, Cognition , 1983 .

[11]  Gary E. Raney,et al.  An eye movement study of insight problem solving , 2001, Memory & cognition.

[12]  P. Johnson-Laird,et al.  PSYCHOLOGICAL SCIENCE Research Article HOW DIAGRAMS CAN IMPROVE REASONING , 2022 .

[13]  J. Barwise,et al.  Visual information and valid reasoning , 1991 .

[14]  Mary Hegarty,et al.  The Mechanics of Comprehension and Comprehension of Mechanics , 1992 .

[15]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[16]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[17]  J. Greeno.  THE SITUATIVITY OF KNOWING, LEARNING, AND RESEARCH , 1998 .

[18]  P Suppes,et al.  Eye Movements during Geometrical Problem Solving , 1997 .

[19]  Mary L. Gick.  12 Two Functions of Diagrams in Problem Solving by Analogy , 1989 .

[20]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[21]  K. Holyoak,et al.  The use of diagrams in analogical problem solving , 2001, Memory & cognition.

[22]  Michael J. Spivey,et al.  Mechanical Reasoning about Gear-and-belt Diagrams: Do Eye-movements Predict Performance? , 2002, Diagrammatic Representation and Reasoning.

[23]  Daniel C. Richardson,et al.  Representation, space and Hollywood Squares: looking at things that aren't there anymore , 2000, Cognition.

[24]  Jon Barwise,et al.  Diagrams and the concept of logical system , 1994 .

[25]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[26]  E. Parkins,et al.  Visual representation in analogical problem solving , 1987, Memory & cognition.

[27]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[28]  Adrian M. Owen,et al.  The Strategic Control of Gaze Direction in the Tower of London Task , 2000, Journal of Cognitive Neuroscience.

[29]  Michael J. Spivey,et al.  Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects , 2001, Psychological research.

[30]  Mary L. Gick.  The effect of a diagram retrieval cue on spontaneous analogical transfer , 1985 .

[31]  Lyn D. English,et al.  Mathematical reasoning : analogies, metaphors, and images , 1997 .