Understanding the benefits of gaze enhanced visual search

In certain applications such as radiology and imagery analysis, it is important to minimize errors. In this paper we evaluate a structured inspection method that uses eye tracking information as a feedback mechanism to the image inspector. Our two-phase method starts with a free viewing phase during which gaze data is collected. During the next phase, we either segment the image, mask previously seen areas of the image, or combine the two techniques, and repeat the search. We compare the different methods proposed for the second search phase by evaluating the inspection method using true positive and false negative rates, and subjective workload. Results show that gaze-blocked configurations reduced the subjective workload, and that gaze-blocking without segmentation showed the largest increase in true positive identifications and the largest decrease in false negative identifications of previously unseen objects.

[1]  Pietro Perona,et al.  Homo economicus in visual search. , 2009, Journal of vision.

[2]  Arthur F Kramer,et al.  Visual Skills in Airport-Security Screening , 2004, Psychological science.

[3]  Anand K. Gramopadhye,et al.  Use of eye movements as feedforward training for a synthetic aircraft inspection task , 2005, CHI.

[4]  S. Mitroff,et al.  Rare Targets Are Rarely Missed in Correctable Search , 2007, Psychological science.

[5]  P. Goddard,et al.  Error in radiology. , 2001, The British journal of radiology.

[6]  Naomi M. Kenner,et al.  Low target prevalence is a stubborn source of errors in visual search tasks. , 2007, Journal of experimental psychology. General.

[7]  Butler,et al.  RE-THINKING CHECKED-BAGGAGE SCREENING , 2002 .

[8]  Douglas DeCarlo,et al.  Robust clustering of eye movement recordings for quantification of visual interest , 2004, ETRA.

[9]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[10]  C. Nodine,et al.  Using eye movements to study visual search and to improve tumor detection. , 1987, Radiographics : a review publication of the Radiological Society of North America, Inc.

[11]  T. Donovan,et al.  Detection or decision errors? Missed lung cancer from the posteroanterior chest radiograph. , 2004, The British journal of radiology.

[12]  M. Pomplun,et al.  Investigating the visual span in comparative search: the effects of task difficulty and divided attention , 2001, Cognition.

[13]  S. Somers,et al.  Double-contrast barium enema studies: effect of multiple reading on perception error. , 1990, Radiology.

[14]  I. Gilchrist,et al.  Evidence for a systematic component within scan paths in visual search , 2006 .

[15]  P. Hancock,et al.  Human Mental Workload , 1988 .

[16]  Colin G Drury,et al.  Change of search time and non-search time in X-ray baggage screening due to training , 2009, Ergonomics.

[17]  Kailash C. Kapur,et al.  Designing airport checked-baggage-screening strategies considering system capability and reliability , 2009, Reliab. Eng. Syst. Saf..

[18]  John R. Anderson,et al.  Partitioning Visual Displays Aids Task-Directed Visual Search , 2004, Hum. Factors.

[19]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[20]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[21]  R. Karsh,et al.  Cognitive strategies for visual search. , 1986, Acta psychologica.

[22]  Ravin Balakrishnan,et al.  Improving visual search with image segmentation , 2009, CHI.

[23]  P Vock,et al.  [Frequent errors in the interpretation of chest x-ray films]. , 1987, Schweizerische medizinische Wochenschrift.

[24]  O. Eden,et al.  Inter-Observer Variation in Interpretation of Chest X-Rays , 1990, Scottish medical journal.