Eye movements and smart technology

From a cognitive science/artificial intelligence perspective, this paper identifies the scanpath concept as the instantiation of a general sequencing principle that permeates the organization of spatial scene knowledge throughout the levels of mental processing. As such, it helps create methodologies to open up windows onto higher-level cognitive processes, particularly by relating shifts of visual focus to shifts of attention in mental reasoning. The paper argues that these methodologies form a robust basis for smart applications that employ eye movements to assess and to assist in diagrammatic problem solving.

[1]  J. Findlay,et al.  The Relationship between Eye Movements and Spatial Attention , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[2]  Claude Bédard,et al.  Specifications for computer-aided conceptual building design , 2003 .

[3]  D. Sagi,et al.  From the National Institutes of Health. , 1993, Journal of the American Medical Association (JAMA).

[4]  T Moore,et al.  Control of eye movements and spatial attention. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Peter De Weerd,et al.  Responses of cells in monkey visual cortex during perceptual filling-in of an artificial scotoma , 1995, Nature.

[6]  S. Kosslyn,et al.  Visual mental images can be ambiguous: insights from individual differences in spatial transformation abilities , 2002, Cognition.

[7]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[8]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[9]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[10]  R. Cowie,et al.  The perception of structure , 1997 .

[11]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[12]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[13]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[14]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[15]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[16]  Michael J. Spivey,et al.  Eye Movements and Problem Solving , 2003, Psychological science.

[17]  C. Freksa,et al.  Visual Attention and Cognition , 1996 .

[18]  D. Sagi,et al.  Common mechanisms of visual imagery and perception. , 1995, Science.

[19]  Sven Bertel,et al.  Spatial Principles in Control of Focus in Reasoning with Mental Representations, Images, and Diagrams , 2004, Spatial Cognition.

[20]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[21]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[22]  Gary E. Raney,et al.  An eye movement study of insight problem solving , 2001, Memory & cognition.

[23]  B. Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002 .

[24]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[25]  K. Holmqvist,et al.  What Do Eye Movements Reveal About Mental Imagery? Evidence From Visual And Verbal Elicitations. , 2005 .

[26]  Stephen M. Kosslyn,et al.  Roles of imagery in perception: Or, there is no such thing as immaculate perception , 1995 .