Guided Search 4.0: Current Progress With a Model of Visual Search

performance, specifically of search tasks in which an observer looks for a target object among some number of distracting items. Classically, models have described two mechanisms of search: serial and parallel (Egeth, 1966). In serial search, attention is directed to one item at a time, allowing each item to be classified as a target or a distractor in turn (Sternberg, 1966). Parallel models propose that all (or many) items are processed at the same time. A decision about target presence is based on the output of this processing (Neisser, 1963). GS evolved out of the two-stage architecture of models like Treisman’s feature integration theory (FIT; Treisman & Gelade, 1980). FIT proposed a parallel, preattentive first stage and a serial second stage controlled by visual selective attention. Search tasks could be divided into those performed by the first stage in parallel and those requiring serial processing. Much of the data comes from experiments measuring reaction time (RT) as a function of set size. The RT is the time required to respond that a target is present or absent. Treisman proposed that there was a limited set of attributes (e.g. color, size, motion) that could be processed in parallel, across the whole visual field (Treisman, 1985, 1986; Treisman & Gormican, 1988). These produced RTs that were essentially independent of the set size. Thus, slopes of RT set size functions were near zero. In FIT, targets defined by two or more attributes required the serial deployment of attention. The critical difference between preattentive search tasks and serial tasks was that the serial tasks required a serial “binding” step (Treisman, 1996; von der Malsburg, 1981). One piece of brain might analyze the color of an object. Another might analyze its orientation. Binding is the act of linking those bits of information into a single representation of an object—an object file (Kahneman, Treisman, & Gibbs, 1992). Tasks requiring serial deployment of attention from one item to the next produce RT set size functions with slopes markedly greater than zero (typically, about 20–30 ms/item for target-present trials and a bit more than twice that for target-absent). 8

[1]  Michael S. Ambinder,et al.  Change blindness , 1997, Trends in Cognitive Sciences.

[2]  H. Nothdurft The role of features in preattentive vision: Comparison of orientation, motion and color cues , 1993, Vision Research.

[3]  David L. Sheinberg,et al.  Why Some Search Tasks Take Longer Than Others: Using Eye Movements to Redefine Reaction Times , 1995 .

[4]  G W Humphreys,et al.  Visual search for targets defined by combinations of color, shape, and size: An examination of the task constraints on feature and conjunction searches , 1987, Perception & psychophysics.

[5]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[6]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[7]  J. Townsend,et al.  The serial-parallel dilemma: A case study in a linkage of theory and method , 2004, Psychonomic bulletin & review.

[8]  Thomas Lafayette Thornton Attentional limitation and multiple-target visual search , 2002 .

[9]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[10]  R. Rosenholtz Search asymmetries? What search asymmetries? , 2001, Perception & psychophysics.

[11]  M. Carrasco,et al.  Signal detection theory applied to three visual search tasks--identification, yes/no detection and localization. , 2004, Spatial vision.

[12]  G. Zelinsky Using Eye Saccades to Assess the Selectivity of Search Movements , 1996, Vision Research.

[13]  G. Zelinsky,et al.  Eye movements during parallel-serial visual search. , 1997 .

[14]  Ken Nakayama,et al.  Serial and parallel processing of visual feature conjunctions , 1986, Nature.

[15]  Á. Kristjánsson,et al.  In Search of Remembrance: Evidence for Memory in Visual Search , 2000, Psychological science.

[16]  J. Duncan,et al.  Effects of similarity, difficulty, and nontarget presentation on the time course of visual attention , 1997, Perception & psychophysics.

[17]  D. Ariely Seeing Sets: Representation by Statistical Properties , 2001, Psychological science.

[18]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[19]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[20]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[21]  M. Carrasco,et al.  The eccentricity effect: Target eccentricity affects performance on conjunction searches , 1995, Perception & psychophysics.

[22]  H. Nothdurft Feature analysis and the role of similarity in preattentive vision , 1992, Perception & psychophysics.

[23]  J. Wolfe,et al.  Why are there eccentricity effects in visual search? Visual and attentional hypotheses , 1998, Perception & psychophysics.

[24]  G. Moraglia,et al.  Display organization and the detection of horizontal line segments , 1989, Perception & psychophysics.

[25]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[26]  Ruth Rosenholtz,et al.  Visual search for orientation among heterogeneous distractors: experimental results and implications for signal-detection theory models of search. , 2001, Journal of experimental psychology. Human perception and performance.

[27]  Anne Treisman,et al.  Features and objects in visual processing , 1986 .

[28]  David C Burr,et al.  Feature-based integration of orientation signals in visual search , 2000, Vision Research.

[29]  H. Egeth,et al.  Are attentional dwell times inconsistent with serial visual search? , 1996, Psychonomic bulletin & review.

[30]  P. Verghese Visual Search and Attention: Review A Signal Detection Theory Approach , 2001 .

[31]  W. Cowan,et al.  Visual search for colour targets that are or are not linearly separable from distractors , 1996, Vision Research.

[32]  Marc Pomplun,et al.  Guidance of eye movements during conjunctive visual search: the distractor-ratio effect. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[33]  M. Carrasco,et al.  The contribution of covert attention to the set-size and eccentricity effects in visual search. , 1998, Journal of experimental psychology. Human perception and performance.

[34]  Stefano Cappa,et al.  The integration of parallel and serial processing mechanisms in visual search: evidence from eye movement recording , 2001, The European journal of neuroscience.

[35]  Ronald A. Rensink,et al.  Preemption effects in visual search: evidence for low-level grouping. , 1995, Psychological review.

[36]  M. Carrasco,et al.  The temporal dynamics of visual search: evidence for parallel processing in feature and conjunction searches. , 1999, Journal of experimental psychology. Human perception and performance.

[37]  Songmei Han,et al.  Parallel processing in visual search asymmetry. , 2004, Journal of experimental psychology. Human perception and performance.

[38]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[39]  D. Foster,et al.  Asymmetries in oriented-line detection indicate two orthogonal filters in early vision , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[40]  B. C. Motter,et al.  The guidance of eye movements during active visual search , 1998, Vision Research.

[41]  John Palmer,et al.  Imperfect, Unlimited-Capacity, Parallel Search Yields Large Set-Size Effects , 1995 .

[42]  U. Neisser Decision-time without reaction-time: Experiments in visual scanning. , 1963 .

[43]  H. Pashler,et al.  Repetition priming in visual search: Episodic retrieval, not feature priming , 2004, Memory & cognition.

[44]  H. C. Nothdurft,et al.  Texture segmentation and pop-out from orientation contrast , 1991, Vision Research.

[45]  K. Shapiro The Attentional Blink: The Brain's “Eyeblink” , 1994 .

[46]  M Ahissar,et al.  Task difficulty and visual hierarchy: Counter-streams in sensory processing and perceptual learning , 1997 .

[47]  J Driver,et al.  A selective review of selective attention research from the past century. , 2001, British journal of psychology.

[48]  N. Moray Attention: selective processes in vision and hearing , 1970 .

[49]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[50]  DeLiang Wang,et al.  Object selection based on oscillatory correlation , 1999, Neural Networks.

[51]  J. Wolfe Moving towards solutions to some enduring controversies in visual search , 2003, Trends in Cognitive Sciences.

[52]  E. Vogel,et al.  Word meanings can be accessed but not reported during the attentional blink , 1996, Nature.

[53]  M. Manosevitz High-Speed Scanning in Human Memory , .

[54]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[55]  R Klein,et al.  Search performance without eye movements , 1989, Perception & psychophysics.

[56]  J. Townsend Serial vs. Parallel Processing: Sometimes They Look like Tweedledum and Tweedledee but they can (and Should) be Distinguished , 1990 .

[57]  R. Rosenholtz Visual search for orientation among heterogeneous distractors: experimental results and implications for signal-detection theory models of search. , 2001, Journal of experimental psychology. Human perception and performance.

[58]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[59]  J. Wolfe,et al.  Changing your mind: on the contributions of top-down and bottom-up guidance in visual search for feature singletons. , 2003, Journal of experimental psychology. Human perception and performance.

[60]  Randall S. Birnkrant,et al.  Visual search for transparency and opacity: attentional guidance by cue combination? , 2005, Journal of vision.

[61]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[62]  B. Green,et al.  Color coding in a visual search task. , 1956, Journal of experimental psychology.

[63]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[64]  James T. Enns,et al.  Preemption effects in visual search: evidence for low-level grouping. , 1995 .

[65]  D. Somers,et al.  Multiple Spotlights of Attentional Selection in Human Visual Cortex , 2004, Neuron.

[66]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[67]  Jan Theeuwes,et al.  A new estimation of the duration of attentional dwell time , 2004, Psychonomic bulletin & review.

[68]  Ronald A. Rensink,et al.  Early completion of occluded objects , 1998, Vision Research.

[69]  Jeremy M. Wolfe,et al.  26.5 brief comms NEW , 2005 .

[70]  A. Treisman,et al.  Conjunction search revisited. , 1990, Journal of experimental psychology. Human perception and performance.

[71]  Todd S. Horowitz,et al.  Visual Search: The role of memory for rejected distractors , 2005 .

[72]  J. Wolfe,et al.  The role of categorization in visual search for orientation. , 1992, Journal of experimental psychology. Human perception and performance.

[73]  B. Murdock,et al.  Two tests of the conveyor-belt model for item recognition. , 1977 .

[74]  Allen Allport,et al.  Visual attention , 1989 .

[75]  S. Smith,et al.  Color coding and visual search. , 1962, Journal of experimental psychology.

[76]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[77]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[78]  A. Treisman,et al.  Representation of statistical properties , 2003, Vision Research.

[79]  J. Palmer Attention in Visual Search: Distinguishing Four Causes of a Set-Size Effect , 1995 .

[80]  Jeremy M Wolfe,et al.  Why don't we see changes? The role of attentional bottlenecks and limited visual memory , 2006, Visual cognition.

[81]  J. Wolfe Asymmetries in visual search: An introduction , 2001, Perception & psychophysics.

[82]  D. Melcher,et al.  Implicit Attentional Selection of Bound Visual Features , 2005, Neuron.

[83]  Jeremy M. Wolfe,et al.  Getting beyond the serial/parallel debate in visual search: a hybrid approach , 2001 .

[84]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[85]  H. Egeth,et al.  Searching for conjunctively defined targets. , 1984, Journal of experimental psychology. Human perception and performance.

[86]  B. Julesz A brief outline of the texton theory of human vision , 1984, Trends in Neurosciences.

[87]  Jeremy M Wolfe,et al.  Modeling the role of parallel processing in visual search , 1990, Cognitive Psychology.

[88]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[89]  R. Rauschenberger Attentional capture by auto- and allo-cues , 2003, Psychonomic bulletin & review.

[90]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[91]  Jeremy M Wolfe,et al.  Do Intersections Serve as Basic Features in Visual Search? , 2003, Perception.

[92]  Bela Julesz,et al.  A theory of preattentive texture discrimination based on first-order statistics of textons , 2004, Biological Cybernetics.

[93]  Jeremy M. Wolfe,et al.  Just Say No: How Are Visual Searches Terminated When There Is No Target Present? , 1996, Cognitive Psychology.

[94]  D. Foster,et al.  Horizontal—vertical filters in early vision predict anomalous line-orientation identification frequencies , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[95]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[96]  David L. Sheinberg,et al.  Eye movements during parallel-serial visual search. , 1997, Journal of experimental psychology. Human perception and performance.

[97]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[98]  J. Wolfe,et al.  Limitations on the Parallel Guidance of Visual Search : Color x Color and Orientation x Orientation Conjuctions , 2004 .

[99]  A. Treisman,et al.  Search asymmetry: a diagnostic for preattentive processing of separable features. , 1985, Journal of experimental psychology. General.

[100]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[101]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[102]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[103]  C. L. M. The Psychology of Attention , 1890, Nature.

[104]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[105]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[106]  N. P. Bichot,et al.  Saccade target selection in macaque during feature and conjunction visual search , 1999, Visual Neuroscience.

[107]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[108]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[109]  Dominique Lamy,et al.  Attentional capture in singleton-detection and feature-search modes. , 2003, Journal of experimental psychology. Human perception and performance.

[110]  J. Theeuwes Stimulus-driven capture and attentional set: selective search for color and visual abrupt onsets. , 1994, Journal of experimental psychology. Human perception and performance.

[111]  J. Wolfe,et al.  Attention is fast but volition is slow , 2000, Nature.

[112]  A. Hillstrom Repetition effects in visual search , 2000, Perception & psychophysics.

[113]  Steven Todd,et al.  Attentional misguidance in visual search , 1994, Perception & psychophysics.

[114]  Todd S. Horowitz,et al.  Visual search has no memory , 1998, Nature.

[115]  James T. Townsend,et al.  A note on the identifiability of parallel and serial processes , 1971 .

[116]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[117]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[118]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[119]  J. Duncan,et al.  The Slow Time-Course of Visual Attention , 1996, Cognitive Psychology.

[120]  J. Palmer Set-size effects in visual search: The effect of attention is independent of the stimulus for simple tasks , 1994, Vision Research.

[121]  Ronald A. Rensink,et al.  Competition for consciousness among visual events: the psychophysics of reentrant visual processes. , 2000, Journal of experimental psychology. General.

[122]  Roger Ratcliff,et al.  Statistical mimicking of reaction time data: Single-process models, parameter variability, and mixtures , 1995, Psychonomic bulletin & review.

[123]  John E. Hummel,et al.  Two Roles for Attention in Shape Perception: A Structural Description Model of Visual Scrutiny , 1998 .

[124]  Kimron Shapiro,et al.  Direct measurement of attentional dwell time in human vision , 1994, Nature.

[125]  M. Pickering,et al.  Eye guidance in reading and scene perception , 1998 .

[126]  C G Drury,et al.  A Variable-Memory Model of Visual Search , 1984, Human factors.

[127]  J. Findlay,et al.  Eye guidance and visual search , 1998 .

[128]  A F Sanders,et al.  Perceptual processing modes in the functional visual field. , 1985, Acta psychologica.

[129]  A. Treisman,et al.  Conjunction search revisited , 1990 .

[130]  R. Klein,et al.  On the manifestations of memory in visual search. , 2000, Spatial vision.

[131]  Preeti Verghese,et al.  Comparing integration rules in visual search. , 2002, Journal of vision.

[132]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[133]  T. Zandt Analysis of Response Time Distributions , 2002 .

[134]  J. Wolfe,et al.  Preattentive Object Files: Shapeless Bundles of Basic Features , 1997, Vision Research.

[135]  Robert Desimone,et al.  Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4 , 2005, Science.

[136]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[137]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[138]  H. Egeth Parallel versus serial processes in multidimensional stimulus discrimination , 1966 .

[139]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[140]  H. Mitsudo Information regarding Structure and Lightness Based on Phenomenal Transparency Influences the Efficiency of Visual Search , 2003, Perception.

[141]  David E. Irwin,et al.  Visual Search has Memory , 2001, Psychological science.