Scanpaths of motion sequences : where people look when watching movies

Magnification around the most important point of a movie scene (center of interest COI) might be an effective aid for people with vision impairments that cause resolution loss. This requires that a COI exist for most video frames. Operationally, we defined the COI by recording the eye movements of normallysighted subjects as they watched movies. More than half of the time most of the subjects looked within an area that was less than 12% of the movie scene. Male and older subjects were more likely to look in the same direction than female and younger subjects. THE SCHEPENS EYE RESEARCH INSTITUTE An Affiliate of Harvard Medical School Robert B. Goldstein, Ph.D. Senior Computer Analyst The Schepens Eye Research Institute, 20 Staniford Street, Boston, Massachusetts 02114 E.Mail: bobg@vision.eri.harvard.edu Phone: (617) 912-2512 FAX: (617) 912-0112 July 28, 2005 Blaire V. Mossman Managing Editor P.O. Box 13177 Scottsdale, AZ 85267 Dear Dr. Mossman, The accompanying documents are the submission of our paper to be considered for publication in the special issue of Computers in Biology and Medicine that will be devoted to the recent “Fourth Starkfest Conference on Vision and Movement in Men and Machines” held May 26-27, 2005 at the University of California, Berkley. The Chairs of the conference were Dr. Claudio Privetera of the University of California, Berkeley and Dr. John Semmlow of the Rutgers State University of New Jersey. Much of the material in this paper was presented at that conference, though since then we have improved our data processing and revised some of our analyses. Paper Title: “Scanpaths of motion sequences: Where people look when watching movies” Corresponding Author: Dr. Robert B. Goldstein The Schepens Eye Research Institute 20 Staniford Street Boston, MA, 02114 USA. E-mail: bobg@vision.eri.harvard.edu Phone number: 617 912 2512 Fax number: 617 912 0112 Yours truly, Robert B. Goldstein, Ph.D. Senior Computer Analyst, Schepens Eye Research Institute Harvard Medical School Accompanying Letter Scanpaths of motion sequences: where people look when watching movies 1 Scanpaths of motion sequences: Where people look when watching movies Robert B. Goldstein, Russell L. Woods, and Eli Peli, The Schepens Eye Research Institute, Harvard Medical School, Boston, MA, USA Abstract— Magnification around the most important point of a movie scene (center of interest COI) might be an effective aid for people with vision impairments that cause resolution loss. This requires that a COI exist for most video frames. Operationally, we defined the COI by recording the eye movements of normally-sighted subjects as they watched movies. More than half of the time most of the subjects looked within an area that was less than 12% of the movie scene. Male and older subjects were more likely to look in the same direction than female and younger subjects. Magnification around the most important point of a movie scene (center of interest COI) might be an effective aid for people with vision impairments that cause resolution loss. This requires that a COI exist for most video frames. Operationally, we defined the COI by recording the eye movements of normally-sighted subjects as they watched movies. More than half of the time most of the subjects looked within an area that was less than 12% of the movie scene. Male and older subjects were more likely to look in the same direction than female and younger subjects. Key Words— Eye Movements, Magnification, Scanpath, Video, Visual Aids, Low Vision, Television. Corresponding author: Dr. Robert B. Goldstein The Schepens Eye Research Institute 20 Staniford Street Boston, MA, 02114 USA. E-mail: bobg@eri.harvard.edu Phone number: 617 912 2512 Fax number: 617 912 0112 Supported in part by NIH Grants EY05975 and EY12890. Manuscript Scanpaths of motion sequences: where people look when watching movies 2

[1]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[2]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[3]  L. Stark Abnormal patterns of normal eye movements in schizophrenia. , 1983, Schizophrenia bulletin.

[4]  Gordon E. Legge,et al.  Psychophysics of reading—II. Low vision , 1985, Vision Research.

[5]  T. Wickens Multiway Contingency Tables Analysis for the Social Sciences , 1989 .

[6]  Wa James Tam,et al.  Static and dynamic spatial resolution in image coding: an investigation of eye movements , 1991, Electronic Imaging.

[7]  Gary S. Rubin,et al.  Reading without saccadic eye movements , 1992, Vision Research.

[8]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[9]  Wa James Tam,et al.  Processing image sequences based on eye movements , 1994, Electronic Imaging.

[10]  Joseph H. Goldberg,et al.  Eye-gaze-contingent control of the computer interface: Methodology and example for zoom detection , 1995 .

[11]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[12]  Christophe De Vleeschouwer,et al.  Automatic detection of interest areas of an image or of a sequence of images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[13]  V. Tosi,et al.  Scanning eye movements made when viewing film: preliminary observations. , 1997, The International journal of neuroscience.

[14]  E Peli,et al.  Benefits of Rapid Serial Visual Presentation (RSVP) Over Scrolled Text Vary with Letter Size , 1998, Optometry and vision science : official publication of the American Academy of Optometry.

[15]  Wilson S. Geisler A Foveated Imaging System to Reduce Transmission Bandwidth of Video Images from Remote Camera Systems 6 , 1999 .

[16]  Heidrun Schumann,et al.  Demand-driven image transmission with levels of detail and regions of interest , 1999, Comput. Graph..

[17]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[18]  Kazuo Sekiya,et al.  6.4:Image Scaling at Rational Ratios for High-Resolution LCD Monitors(Attendance report of SID 2000 Symposium) , 2000 .

[19]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. M. Rohaly,et al.  Automatic detection of regions of interest in complex video sequences , 2001, IS&T/SPIE Electronic Imaging.

[21]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[22]  E Peli,et al.  Vision Multiplexing: an Engineering Approach to Vision Rehabilitation Device Development , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[23]  Lester C. Loschky,et al.  Saliency of peripheral targets in gaze-contingent multiresolutional displays , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  Tim Halverson,et al.  Cleaning up systematic error in eye-tracking data by using required fixation locations , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[25]  George T Timberlake,et al.  Retinal Location of the Preferred Retinal Locus Relative to the Fovea in Scanning Laser Ophthalmoscope Images , 2005, Optometry and vision science : official publication of the American Academy of Optometry.