Space-variant spatio-temporal filtering of video for gaze visualization and perceptual learning

We introduce an algorithm for space-variant filtering of video based on a spatio-temporal Laplacian pyramid and use this algorithm to render videos in order to visualize prerecorded eye movements. Spatio-temporal contrast and colour saturation are reduced as a function of distance to the nearest gaze point of regard, i.e. non-fixated, distracting regions are filtered out, whereas fixated image regions remain unchanged. Results of an experiment in which the eye movements of an expert on instructional videos are visualized with this algorithm, so that the gaze of novices is guided to relevant image locations, show that this visualization technique facilitates the novices' perceptual learning.

[1]  Thomas Martinetz,et al.  Eye movement modelling and gaze guidance , 2008 .

[2]  E. B. Delabarre.  A method of recording eye-movements. , 1898 .

[3]  Chris Lankford,et al.  Gazetracker: software designed to facilitate eye movement analysis , 2000, ETRA.

[4]  Oleg Spakov,et al.  KiEV: a tool for visualization of reading and writing processes in translation of text , 2008, ETRA '08.

[5]  T. Gog,et al.  How to Convey Perceptual Skills by Displaying Experts’ Gaze Data , 2009 .

[6]  Darius Miniotas,et al.  Visualization of eye gaze data using heat maps , 2007 .

[7]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[8]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[9]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[10]  Anand K. Gramopadhye,et al.  On spatiochromatic visual sensitivity and peripheral color LOD management , 2009, TAP.

[11]  Katharina Scheiter,et al.  Attention guidance during example study via the model's eye movements , 2009, Comput. Hum. Behav..

[12]  Cedric Nishan Canagarajah,et al.  Gaze-contingent display using texture mapping and OpenGL: system and applications , 2004, ETRA.

[13]  Thomas Martinetz,et al.  Guiding the mind's eye: improving communication and vision by external control of the scanpath , 2006, Electronic Imaging.

[14]  Thomas Martinetz,et al.  Visibility of temporal blur on a gaze-contingent display , 2005, APGV '05.

[15]  E. Barth,et al.  Efficient visual coding and the predictability of eye movements on natural movies. , 2009, Spatial vision.

[16]  Jean Underwood,et al.  Visual attention while driving: sequences of eye fixations made by experienced and novice drivers , 2003, Ergonomics.

[17]  Andrew T. Duchowski,et al.  iComp: a tool for scanpath visualization and comparison , 2006, APGV.

[18]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[19]  Frederick A. Miles,et al.  Linking eye movements and perception , 2003 .

[20]  C. Trepagnier,et al.  Gaze data visualization tools: opportunities and challenges , 2004, Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004..

[21]  J. Rieser,et al.  Attention and communication: Eye-movement-based research paradigms , 1996 .

[22]  Martin Vetterli,et al.  Interpolative multiresolution coding of advance television with compatible subchannels , 1991, IEEE Trans. Circuits Syst. Video Technol..

[23]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[24]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[25]  Thomas Martinetz,et al.  Gaze-contingent temporal filtering of video , 2006, ETRA '06.

[26]  Wilson S. Geisler,et al.  Real-time simulation of arbitrary visual fields , 2002, ETRA.