A vector-based, multidimensional scanpath similarity measure

A great need exists in many fields of eye-tracking research for a robust and general method for scanpath comparisons. Current measures either quantize scanpaths in space (string editing measures like the Levenshtein distance) or in time (measures based on attention maps). This paper proposes a new pairwise scanpath similarity measure. Unlike previous measures that either use AOI sequences or forgo temporal order, the new measure defines scanpaths as a series of geometric vectors and compares temporally aligned scanpaths across several dimensions: shape, fixation position, length, direction, and fixation duration. This approach offers more multifaceted insights to how similar two scanpaths are. Eight fictitious scanpath pairs are tested to elucidate the strengths of the new measure, both in itself and compared to two of the currently most popular measures - the Levenshtein distance and attention map correlation.

[1]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[2]  Douglas DeCarlo,et al.  Robust clustering of eye movement recordings for quantification of visual interest , 2004, ETRA.

[3]  Heinz Hügli,et al.  Empirical Validation of the Saliency-based Model of Visual Attention , 2003 .

[4]  Michael E. Holmes,et al.  Clutter or content?: how on-screen enhancements affect how TV viewers scan and what they learn , 2006, ETRA.

[5]  Joystone Gbadamosi.  Visual imagery und Mikro-Sakkaden bei Hemianopsie-Patienten , 1999 .

[6]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[7]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[8]  Clarke Wilson,et al.  ClustalG: Software for analysis of activities and sequential events , 1999 .

[9]  Wolfgang H. Zangemeister,et al.  Foveal versus parafoveal scanpaths of visual imagery in virtual hemianopic subjects , 2007, Comput. Biol. Medicine.

[10]  Michael L. Mack,et al.  VISUAL SALIENCY DOES NOT ACCOUNT FOR EYE MOVEMENTS DURING VISUAL SEARCH IN REAL-WORLD SCENES , 2007 .

[11]  R. Groner,et al.  Looking at Faces: Local and Global Aspects of Scanpaths , 1984 .

[12]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[13]  Brian Lukoff,et al.  Testing for statistically significant differences between groups of scan patterns , 2008, ETRA.

[14]  Christof Koch,et al.  Decoding What People See from Where They Look: Predicting Visual Stimuli from Scanpaths , 2009, WAPCV.

[15]  Geoffrey M. Underwood,et al.  Knowledge-Based Patterns of Remembering: Eye Movement Scanpaths Reflect Domain Experience , 2008, USAB.

[16]  Andreas Holzinger,et al.  HCI and Usability for Education and Work, 4th Symposium of the WG HCI&UE of the OCG Austrian Computer Society, USAB 2008, LNCS 5298 , 2008 .

[17]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[18]  L. Itti.  Author address: , 1999 .

[19]  Michael E. Holmes,et al.  Visual attention to repeated internet images: testing the scanpath theory on the world wide web , 2002, ETRA.

[20]  Stephanie Wilson,et al.  Identifying web usability problems from eye-tracking data , 2007 .

[21]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[22]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[23]  Paolo Napoletano,et al.  An architectural model for combining spatial-based and object-based information for attentive video analysis , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[24]  Guang-Zhong Yang,et al.  Analysis of visual search patterns with EMD metric in normalized anatomical space , 2006, IEEE Transactions on Medical Imaging.

[25]  Alan C. Bovik,et al.  Point-of-gaze analysis reveals visual search strategies , 2004, IS&T/SPIE Electronic Imaging.

[26]  Alan C. Bovik,et al.  GAFFE: A Gaze-Attentive Fixation Finding Engine , 2008, IEEE Transactions on Image Processing.