Simple summation rule for optimal fixation selection in visual search

When searching for a known target in a natural texture, practiced humans achieve near-optimal performance compared to a Bayesian ideal searcher constrained with the human map of target detectability across the visual field [Najemnik, J., & Geisler, W. S. (2005). Optimal eye movement strategies in visual search. Nature, 434, 387-391]. To do so, humans must be good at choosing where to fixate during the search [Najemnik, J., & Geisler, W.S. (2008). Eye movement statistics in humans are consistent with an optimal strategy. Journal of Vision, 8(3), 1-14. 4]; however, it seems unlikely that a biological nervous system would implement the computations for the Bayesian ideal fixation selection because of their complexity. Here we derive and test a simple heuristic for optimal fixation selection that appears to be a much better candidate for implementation within a biological nervous system. Specifically, we show that the near-optimal fixation location is the maximum of the current posterior probability distribution for target location after the distribution is filtered by (convolved with) the square of the retinotopic target detectability map. We term the model that uses this strategy the entropy limit minimization (ELM) searcher. We show that when constrained with human-like retinotopic map of target detectability and human search error rates, the ELM searcher performs as well as the Bayesian ideal searcher, and produces fixation statistics similar to human.

[1]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[2]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[3]  B. C. Motter,et al.  The zone of focal attention during active visual search , 1998, Vision Research.

[4]  M. Eckstein The Lower Visual Search Efficiency for Conjunctions Is Due to Noise and not Serial Attentional Processing , 1998 .

[5]  Neri Merhav,et al.  Relations between entropy and error probability , 1994, IEEE Trans. Inf. Theory.

[6]  M. Posner,et al.  Components of visual orienting , 1984 .

[7]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[8]  S S Saunders,et al.  Discrimination performance of single neurons: rate and temporal-pattern information. , 1991, Journal of neurophysiology.

[9]  B. C. Motter,et al.  The guidance of eye movements during active visual search , 1998, Vision Research.

[10]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[11]  Hooge PII: S0042-6989(98)00213-2 , 1998 .

[12]  Deniz Erdogmus,et al.  Insights on the relationship between probability of misclassification and information transfer through classifiers , 2002, Int. J. Comput. Syst. Signals.

[13]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[14]  Miguel P Eckstein,et al.  Saccadic and perceptual performance in visual search tasks. I. Contrast detection and discrimination. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[16]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[17]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[18]  Marc Pomplun,et al.  Guidance of eye movements during conjunctive visual search: the distractor-ratio effect. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[19]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[20]  C. Curcio,et al.  Topography of ganglion cells in human retina , 1990, The Journal of comparative neurology.

[21]  John K. Tsotsos,et al.  Neurobiology of Attention , 2005 .

[22]  R. Walker,et al.  A model of saccade generation based on parallel processing and competitive inhibition , 1999, Behavioral and Brain Sciences.

[23]  Antonio Torralba,et al.  Contextual Influences on Saliency , 2004 .

[24]  Miguel P Eckstein,et al.  The time course of visual information accrual guiding eye movement decisions. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  G. Zelinsky Using Eye Saccades to Assess the Selectivity of Search Movements , 1996, Vision Research.

[26]  Raymond Klein,et al.  Inhibitory tagging system facilitates visual search , 1988, Nature.

[27]  J. Wolfe Visual search in continuous, naturalistic stimuli , 1994, Vision Research.

[28]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[29]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[30]  Dennis R. Proffitt,et al.  Within striking distance: Task efficacy influences perceived size and distance , 2010 .

[31]  Michael W. Levine,et al.  More ups and downs of visual processing , 2010 .

[32]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[33]  Alan C Bovik,et al.  Contrast statistics for foveated visual systems: fixation selection by minimizing contrast entropy. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  Mary M Hayhoe,et al.  Spatial memory and saccadic targeting in a natural task. , 2005, Journal of vision.

[35]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[36]  W. Geisler,et al.  Separation of low-level and high-level factors in complex tasks: visual search. , 1995, Psychological review.

[37]  B. Dosher,et al.  Characterizing human perceptual inefficiencies with equivalent internal noise. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[39]  M. Eckstein,et al.  Quantifying the Performance Limits of Human Saccadic Targeting during Visual Search , 2001, Perception.

[40]  Paola Sebastiani,et al.  Bayesian Experimental Design and Shannon Information , 1997 .

[41]  Jeffrey S. Perry,et al.  Visual search: the role of peripheral information measured using gaze-contingent displays. , 2006, Journal of vision.

[42]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[43]  C. Scialfa,et al.  Response times and eye movements in feature and conjunction search as a function of target eccentricity , 1998, Perception & psychophysics.

[44]  John W. Fisher,et al.  Maximum Mutual Information Principle for Dynamic Sensor Query Problems , 2003, IPSN.

[45]  D. Fitzpatrick,et al.  Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns , 1995, Neuron.

[46]  Donald Geman,et al.  An Active Testing Model for Tracking Roads in Satellite Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Eli Brenner,et al.  Flexibility in intercepting moving objects. , 2007, Journal of vision.

[48]  M. Carrasco,et al.  The eccentricity effect: Target eccentricity affects performance on conjunction searches , 1995, Perception & psychophysics.

[49]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[50]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[51]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[52]  P. Calabresi,et al.  Saccade preparation inhibits reorienting to recently attended locations. , 1989, Journal of experimental psychology. Human perception and performance.

[53]  D G Pelli,et al.  Why use noise? , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[54]  Eyal M. Reingold,et al.  Area activation: a computational model of saccadic selectivity in visual search , 2003, Cogn. Sci..

[55]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[56]  Gregory J. Zelinsky,et al.  CHAPTER 65 – Specifying the Components of Attention in a Visual Search Task , 2005 .

[57]  A. Treisman Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[58]  M. Carrasco,et al.  Characterizing visual performance fields: effects of transient covert attention, spatial frequency, eccentricity, task and set size. , 2001, Spatial vision.

[59]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.