Spatial Principles in Control of Focus in Reasoning with Mental Representations, Images, and Diagrams

The effective control of attentional focus is an essential requirement in mental reasoning based on mental models and men tal images, as well as in the interaction with external diagrams. In this paper, we argue for spatial or ganization principles common to various mental subsystems that entail a non-centralistic con trol of focus. We give a brief overview of mental spatial rea soning and present a review of psy chological findings related to cognitive con trol. We review existing mod eling approaches that realize control of focus in imagery, scene recognition, and men tal animation. Based on these founda tions, we identify basic spatial or ganizing principles that are shared by the diverse subsystems col laborating in mental spatial reasoning. We discuss the implica tions of these principles in the frame work of a computational modeling ap proach and give an outline of the con ception of control of focus in our com putational architecture Casimir.

[1]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[2]  D. Broadbent Perception and communication , 1958 .

[3]  N. Moray Attention in Dichotic Listening: Affective Cues and the Influence of Instructions , 1959 .

[4]  Kevin Lynch,et al.  The Image of the City , 1960 .

[5]  Anne Treisman,et al.  Monitoring and storage of irrelevant messages in selective attention , 1964 .

[6]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[7]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[8]  R. Moyer Comparing objects in memory: Evidence suggesting an internal psychophysics , 1973 .

[9]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[10]  S. Kosslyn,et al.  Imagery, propositions, and the form of internal representations , 1977, Cognitive Psychology.

[11]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[12]  Albert C. Stevens,et al.  Distortions in judged spatial relations , 1978, Cognitive Psychology.

[13]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[14]  S. Kosslyn Image and mind , 1982 .

[15]  B. Kuipers The "Map in the Head" Metaphor , 1982 .

[16]  P. Johnson-Laird Mental models , 1989 .

[17]  F. J. Friedrich,et al.  Effects of parietal injury on covert orienting of attention , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[19]  N. Cowan Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[20]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[21]  Dimitrios Papadias,et al.  A Representation Scheme for Computational Imagery , 1991 .

[22]  Kim Sterelny,et al.  The Imagery Debate , 1991 .

[23]  C. Colby,et al.  Heterogeneity of extrastriate visual areas and multiple parietal areas in the Macaque monkey , 1991, Neuropsychologia.

[24]  M. Hegarty Mental animation: inferring motion from static displays of mechanical systems. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Daniel Reisberg,et al.  What an image depicts depends on what an image means , 1992, Cognitive Psychology.

[26]  S. Rose Selective attention , 1992, Nature.

[27]  D. Papadias,et al.  Computational Imagery , 1992, Cogn. Sci..

[28]  Andrew U. Frank,et al.  Theories and Methods of Spatio-Temporal Reasoning in Geographic Space , 1992, Lecture Notes in Computer Science.

[29]  Daniel R. Montello,et al.  The Geometry of Environmental Knowledge , 1992, Spatio-Temporal Reasoning.

[30]  Daniel R. Montello,et al.  Spatial Information Theory A Theoretical Basis for GIS , 1995, Lecture Notes in Computer Science.

[31]  Y. Aloimonos Active Perception , 1993 .

[32]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[33]  David E. Meyer,et al.  Synergies in experimental psychology, artificial intelligence, and cognitive neuroscience , 1993 .

[34]  A. Allport Attention and control: have we been asking the wrong questions? A critical review of twenty-five years , 1993 .

[35]  Alastair Hannay,et al.  The Imagery Debate. , 1993 .

[36]  D. Meyer,et al.  Attention before and during the Decade of the Brain , 1993 .

[37]  Jon Oberlander,et al.  A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation , 1995, Cogn. Sci..

[38]  Gabriela Goldschmidt,et al.  The designer as a team o f one , 1995 .

[39]  D. Sagi,et al.  Common mechanisms of visual imagery and perception. , 1995, Science.

[40]  M. Goodale Image and Brain: The Resolution of the Imagery Debate , 1995 .

[41]  Stephen M. Kosslyn,et al.  Roles of imagery in perception: Or, there is no such thing as immaculate perception , 1995 .

[42]  Jon Barwise,et al.  Logical reasoning with diagrams , 1996 .

[43]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[44]  Atsushi Shimojima,et al.  Operational constraints in diagrammatic reasoning , 1996 .

[45]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[46]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..

[47]  D. Sagi,et al.  From the National Institutes of Health. , 1993, Journal of the American Medical Association (JAMA).

[48]  M Hegarty,et al.  Mental animation in the visuospatial sketchpad: Evidence from dual-task studies , 1997, Memory & cognition.

[49]  R. Cowie,et al.  The perception of structure , 1997 .

[50]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[51]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[52]  R. Hamel,et al.  Creative discovery in imagery and perception: combining is relatively easy, restructuring takes a sketch. , 1998, Acta psychologica.

[53]  John S. Gero,et al.  Drawings and the design process , 1998 .

[54]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: congruent visual and somatic response properties. , 1998, Journal of neurophysiology.

[55]  Max J. Egenhofer,et al.  Spatial and temporal reasoning in geographic information systems , 1998 .

[56]  Boicho Kokinov,et al.  Micro-Level Hybridization in the Cognitive Architecture DUAL , 1999 .

[57]  N. Cowan An embedded-processes model of working memory , 1999 .

[58]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[59]  Randy L. Buckner,et al.  Set-and Code-Specific Activation in the Frontal Cortex: An fMRI Study of Encoding and Retrieval of Faces and Words , 1999, Journal of Cognitive Neuroscience.

[60]  Stephen Monsell,et al.  Banishing the Control Homunculus , 2000 .

[61]  Mary Hegarty,et al.  Capacity Limits in Diagrammatic Reasoning , 2000, Diagrams.

[62]  Leslie G. Ungerleider,et al.  Distributed Neural Systems for the Generation of Visual Images , 2000, Neuron.

[63]  D. Kieras,et al.  Modern computational perspectives on executive mental processes and cognitive control: Where to from here? , 2000 .

[64]  Daniel C. Richardson,et al.  Representation, space and Hollywood Squares: looking at things that aren't there anymore , 2000, Cognition.

[65]  Stephen Monsell,et al.  Control of Cognitive Processes , 2000 .

[66]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[67]  Gerhard Krieger,et al.  Scene analysis with saccadic eye movements: Top-down and bottom-up modeling , 2001, J. Electronic Imaging.

[68]  Robert Logie Working memory: A mental space for design and discovery. , 2001 .

[69]  Thomas Barkowsky Mental Representation and Processing of Geographic Knowledge - A Computational Approach , 2002, Künstliche Intell..

[70]  Thomas Barkowsky,et al.  Mental Representation and Processing of Geographic Knowledge , 2002, Lecture Notes in Computer Science.

[71]  S. Kosslyn,et al.  Visual mental images can be ambiguous: insights from individual differences in spatial transformation abilities , 2002, Cognition.

[72]  B. Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002 .

[73]  Yasuhiro Katagiri,et al.  Introduction: interactive graphical communication , 2002, Int. J. Hum. Comput. Stud..

[74]  Sylvie Chokron,et al.  Orienting of attention in left unilateral neglect , 2002, Neuroscience & Biobehavioral Reviews.

[75]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[76]  Yasuhiro Katagiri,et al.  Graphical representation in graphical dialogue , 2002, Int. J. Hum. Comput. Stud..

[77]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[78]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[79]  Z. Pylyshyn Return of the mental image: are there really pictures in the brain? , 2003, Trends in Cognitive Sciences.

[80]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[81]  Volker Haarslev,et al.  Theory and Application of Diagrams , 2003, Lecture Notes in Computer Science.

[82]  Martin Eimer,et al.  Anterior and posterior attentional control systems use different spatial reference frames: ERP evidence from covert tactile-spatial orienting. , 2003, Psychophysiology.

[83]  J. Zacks,et al.  What is primed in priming from imagery? , 2003, Psychological research.

[84]  Bernhard Hommel,et al.  Exorcizing the homunculus, phase two: editors' introduction. , 2004, Acta psychologica.

[85]  Christian Freksa,et al.  ASPECTUALIZE AND CONQUER IN ARCHITECTURAL DESIGN , 2004 .

[86]  Marty G. Woldorff,et al.  Mechanisms of Moving the Mind's Eye: Planning and Execution of Spatial Shifts of Attention , 2004, Journal of Cognitive Neuroscience.

[87]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.