ScanMatch: A novel method for comparing fixation sequences

We present a novel approach to comparing saccadic eye movement sequences based on the Needleman-Wunsch algorithm used in bioinformatics to compare DNA sequences. In the proposed method, the saccade sequence is spatially and temporally binned and then recoded to create a sequence of letters that retains fixation location, time, and order information. The comparison of two letter sequences is made by maximizing the similarity score computed from a substitution matrix that provides the score for all letter pair substitutions and a penalty gap. The substitution matrix provides a meaningful link between each location coded by the individual letters. This link could be distance but could also encode any useful dimension, including perceptual or semantic space. We show, by using synthetic and behavioral data, the benefits of this method over existing methods. The ScanMatch toolbox for MATLAB is freely available online (www.scanmatch.co.uk).

[1]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[2]  Reinhold Kliegl,et al.  Mathematical models of eye movements in reading: a possible role for autonomous saccades , 2001, Biological Cybernetics.

[3]  Lizzie Maughan,et al.  Like more, look more. Look more, like more: The evidence from eye-tracking , 2007 .

[4]  David S. Broomhead,et al.  Mathematical models of eye movements , 2003 .

[5]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[6]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[7]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[8]  Graham L. Pierce,et al.  Eye movements during scene viewing: Evidence for mixed control of fixation durations , 2008, Psychonomic bulletin & review.

[9]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[10]  L W Stark,et al.  String editing analysis of human visual search. , 1995, Optometry and vision science : official publication of the American Academy of Optometry.

[11]  Sean R. Eddy,et al.  Biological sequence analysis: Contents , 1998 .

[12]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[13]  Lawrence W. Stark,et al.  Visual perception and sequences of eye movement fixations: a stochastic modeling approach , 1992, IEEE Trans. Syst. Man Cybern..

[14]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[15]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[16]  David R. Wozny,et al.  Human trimodal perception follows optimal statistical inference. , 2008, Journal of vision.

[17]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[18]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[19]  T. Speed,et al.  Biological Sequence Analysis , 1998 .

[20]  Tamotsu Kasai,et al.  A Method for the Correction of Garbled Words Based on the Levenshtein Metric , 1976, IEEE Transactions on Computers.

[21]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[22]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[23]  J. Felblinger,et al.  Saccadic eye movement changes in Parkinson's disease dementia and dementia with Lewy bodies. , 2005, Brain : a journal of neurology.

[24]  Christus,et al.  A General Method Applicable to the Search for Similarities in the Amino Acid Sequence of Two Proteins , 2022 .

[25]  Thomas L. Madden,et al.  Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. , 1997, Nucleic acids research.

[26]  D. Mount,et al.  Comparison of the PAM and BLOSUM Amino Acid Substitution Matrices. , 2008, CSH protocols.

[27]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[28]  G. T. Buswell.  How People Look At Pictures: A Study Of The Psychology Of Perception In Art , 2012 .

[29]  Carolina M. Zingale,et al.  Planning sequences of saccades , 1987, Vision Research.

[30]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[31]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[32]  A WagnerRobert,et al.  An Extension of the String-to-String Correction Problem , 1975 .

[33]  P. Subramanian.  Active Vision: The Psychology of Looking and Seeing , 2006 .

[34]  Robert A. Wagner,et al.  An Extension of the String-to-String Correction Problem , 1975, JACM.

[35]  R. Pieters,et al.  Visual Attention to Repeated Print Advertising: A Test of Scanpath Theory , 1999 .