Turning visual search time on its head

Our everyday visual experience frequently involves searching for objects in clutter. Why are some searches easy and others hard? It is generally believed that the time taken to find a target increases as it becomes similar to its surrounding distractors. Here, I show that while this is qualitatively true, the exact relationship is in fact not linear. In a simple search experiment, when subjects searched for a bar differing in orientation from its distractors, search time was inversely proportional to the angular difference in orientation. Thus, rather than taking search reaction time (RT) to be a measure of target-distractor similarity, we can literally turn search time on its head (i.e. take its reciprocal 1/RT) to obtain a measure of search dissimilarity that varies linearly over a large range of target-distractor differences. I show that this dissimilarity measure has the properties of a distance metric, and report two interesting insights come from this measure: First, for a large number of searches, search asymmetries are relatively rare and when they do occur, differ by a fixed distance. Second, search distances can be used to elucidate object representations that underlie search - for example, these representations are roughly invariant to three-dimensional view. Finally, search distance has a straightforward interpretation in the context of accumulator models of search, where it is proportional to the discriminative signal that is integrated to produce a response. This is consistent with recent studies that have linked this distance to neuronal discriminability in visual cortex. Thus, while search time remains the more direct measure of visual search, its reciprocal also has the potential for interesting and novel insights.

[1]  Carl R Olson,et al.  Global Image Dissimilarity in Macaque Inferotemporal Cortex Predicts Human Visual Search Efficiency , 2010, The Journal of Neuroscience.

[2]  P. Verghese Visual Search and Attention A Signal Detection Theory Approach , 2001, Neuron.

[3]  J. Wolfe,et al.  The role of categorization in visual search for orientation. , 1992, Journal of experimental psychology. Human perception and performance.

[4]  C. Olson,et al.  Low-frequency oscillations arising from competitive interactions between visual stimuli in macaque inferotemporal cortex. , 2005, Journal of neurophysiology.

[5]  Geneviève Desmarais,et al.  Understanding the structural determinants of object confusion in memory: An assessment of psychophysical approaches to estimating visual similarity , 2005, Perception & psychophysics.

[6]  J. Wolfe Asymmetries in visual search: An introduction , 2001, Perception & psychophysics.

[7]  A. Nagy,et al.  Asymmetries in Simple Feature Searches for Color , 1996, Vision Research.

[8]  Gregory J Zelinsky,et al.  Cutting through the clutter: searching for targets in evolving complex scenes. , 2011, Journal of vision.

[9]  C G Gross,et al.  Inferior temporal lesions do not impair discrimination of rotated patterns in monkeys. , 1978, Journal of comparative and physiological psychology.

[10]  Richard P. Heitz,et al.  Neurally constrained modeling of perceptual decision making. , 2010, Psychological review.

[11]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[12]  S Edelman,et al.  Representation is representation of similarities , 1996, Behavioral and Brain Sciences.

[13]  Michael Grünau,et al.  Visual search asymmetry for viewing direction , 1994, Perception & psychophysics.

[14]  Brian P. Dyre,et al.  Perceptual similarity of shapes generated from Fourier descriptors. , 1996, Journal of experimental psychology. Human perception and performance.

[15]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[16]  A. Tversky Features of Similarity , 1977 .

[17]  A. Nagy,et al.  Critical color differences determined with a visual search task. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[18]  W. Cowan,et al.  Distractor Heterogeneity versus Linear Separability in Colour Visual Search , 1996 .

[19]  R. Rosenholtz Search asymmetries? What search asymmetries? , 2001, Perception & psychophysics.

[20]  Gregory J. Zelinsky,et al.  Effects of part-based similarity on visual search: The Frankenbear experiment , 2012, Vision Research.

[21]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[22]  J. Wolfe,et al.  Which end is up? Two representations of orientation in visual search , 1999, Vision Research.

[23]  D S Blough,et al.  Quantitative relations between visual search speed and target-distractor similarity , 1988, Perception & psychophysics.

[24]  Benjamin T. Vincent,et al.  Search asymmetries: Parallel processing of uncertain sensory information , 2011, Vision Research.

[25]  Richard P. Heitz,et al.  Neural mechanisms of saccade target selection: gated accumulator model of the visual–motor cascade , 2011, The European journal of neuroscience.

[26]  Ronald A. Rensink,et al.  Influence of scene-based properties on visual search. , 1990, Science.

[27]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[28]  Luiz A. Costa,et al.  Determining the similarity of deformable shapes , 1995, Vision Research.

[29]  N. Logothetis,et al.  Psychophysical and physiological evidence for viewer-centered object representations in the primate. , 1995, Cerebral cortex.

[30]  Gregory J. Zelinsky,et al.  Visual search is guided to categorically-defined targets , 2009, Vision Research.

[31]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[32]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[33]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[34]  S. Dubé,et al.  Local and global factors of similarity in visual search , 1994, Perception & psychophysics.