Getting beyond the serial/parallel debate in visual search: a hybrid approach

The question of whether visual search involves at least one item-by-item serial processing stage or whether instead it is an entirely parallel process has been debated for decades, Recently, estimates of 'attentional dwell-time', which is the time required to reallocate atcention from one item to another, have been brought to bear on this question. Herc. we review this and other classes of evidence that favor serial or parallel models of visual search, and conclude thnt hybrid models that are neither strictly serial nor strictly parallel are better candidates for describing human visunl search. \Ve end the chapter with a sketch of one such model, and some of its possibilities. If you look for a 2 among the 5s in Fig. 9.1, it will take you longer to find the 2 in lB than in lA and even longer to confirm that there is no 2 present in IC. How should we understand the dependence of response time (RT) in this sort of task on the number of items (set size)? The answer to this question has been phrased in essentiaJly dichotomous terms for a generation. It could be that each item is processed one after the other in series (cf. e.g. Treisman and Gelade 1980; Wolfe et al. 1989; Wolfe 1994). It could be that information is accumulated from multiple items at the same time in parallel (Grossberg et al. 1994; Humphreys and Muller 1993; Palmer and rvicLean 1995). Which is it? Is attention deployed to one item at a time in visual search or is it distributed across many or all items? These sound like dramatically different alternatives. Why then has it proved so difficult for proponents of serial models or proponents of parallel models to gain the upper hand in this debate? One explanation has been that, for all their apparent differences, serial and parallel models can be made to predict similar experimental outcomes (e.g. Townsend 1971, 1976, 1990). We will argue for a somewhat different position. There is a class of plausible models

[1]  N. Moray Attention: selective processes in vision and hearing , 1970 .

[2]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[3]  D. Meyer,et al.  Analyses of multinomial mixture distributions: new tests for stochastic models of cognition and action. , 1991, Psychological bulletin.

[4]  J. Townsend,et al.  Search reaction time for single targets in multiletter stimuli with brief visual displays , 1973, Memory & cognition.

[5]  W. D. Ross,et al.  A Neural Theory of Attentive Visual Search : Interactions of Boundary , Surface , Spatial , and Object Representations By : Stephen Grossberg , 2004 .

[6]  R. Klein,et al.  Categories of cognitive inhibition with reference to attention. , 1994 .

[7]  J. Townsend Serial vs. Parallel Processing: Sometimes They Look like Tweedledum and Tweedledee but they can (and Should) be Distinguished , 1990 .

[8]  H. Egeth,et al.  Searching for conjunctively defined targets. , 1984, Journal of experimental psychology. Human perception and performance.

[9]  Howard E. Egeth,et al.  Parallel processing of multielement displays , 1972 .

[10]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[11]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[12]  M. Posner,et al.  Inhibition of return : Neural basis and function , 1985 .

[13]  William Prinzmetal,et al.  Visual Feature Integration in a World of Objects , 1995 .

[14]  J. Duncan The locus of interference in the perception of simultaneous stimuli. , 1980, Psychological review.

[15]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[16]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[17]  Ronald A. Rensink,et al.  Competition for consciousness among visual events: the psychophysics of reentrant visual processes. , 2000, Journal of experimental psychology. General.

[18]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[19]  R. Ivry,et al.  Effect of feature similarity on illusory conjunctions , 1991, Perception & psychophysics.

[20]  S. Tipper,et al.  Inhibition of return to successively cued spatial locations: commentary on Pratt and Abrams (1995). , 1996, Journal of experimental psychology. Human perception and performance.

[21]  J. Wolfe,et al.  Preattentive Object Files: Shapeless Bundles of Basic Features , 1997, Vision Research.

[22]  R. Shiffrin,et al.  Visual processing capacity and attentional control. , 1972, Journal of experimental psychology.

[23]  James L. McClelland,et al.  Conjunctive search for one and two identical targets. , 1989, Journal of experimental psychology. Human perception and performance.

[24]  H. Egeth,et al.  Are attentional dwell times inconsistent with serial visual search? , 1996, Psychonomic bulletin & review.

[25]  H. Egeth,et al.  Further evidence for a time-independent shift of the focus of attention , 1991, Perception & psychophysics.

[26]  S. Yantis,et al.  Detecting conjunctions of color and form in parallel , 1990, Perception & psychophysics.

[27]  D. Broadbent,et al.  From detection to identification: Response to multiple targets in rapid serial visual presentation , 1987, Perception & psychophysics.

[28]  Raymond Klein,et al.  Inhibitory tagging system facilitates visual search , 1988, Nature.

[29]  H. Egeth,et al.  How does feature-based attention affect visual processing? , 1998, Journal of experimental psychology. Human perception and performance.

[30]  R. Atkinson,et al.  Processing time as influenced by the number of elements in a visual display , 1969 .

[31]  J. Miller A queue-series model for reaction time, with discrete-stage and continuous-flow models as special cases. , 1993, Psychological review.

[32]  R. Klein,et al.  Inhibition of Return is a Foraging Facilitator in Visual Search , 1999 .

[33]  A. Newell You can't play 20 questions with nature and win : projective comments on the papers of this symposium , 1973 .

[34]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[35]  Alan J. Courtney,et al.  Assessing search performance with a simulation model , 1998 .

[36]  M. Eckstein The Lower Visual Search Efficiency for Conjunctions Is Due to Noise and not Serial Attentional Processing , 1998 .

[37]  J Miller,et al.  Discreteness and continuity in models of human information processing. , 1990, Acta psychologica.

[38]  J. Wolfe,et al.  Inhibitory tagging in visual search: A failure to replicate , 1990, Perception & psychophysics.

[39]  V. Lollo,et al.  Beyond the attentional blink: visual masking by object substitution. , 1998, Journal of experimental psychology. Human perception and performance.

[40]  H Pashler,et al.  Attentional limits in memory retrieval. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[41]  Karen M. Arnell,et al.  Attention to visual pattern information produces the attentional blink in rapid serial visual presentation. , 1994, Journal of experimental psychology. Human perception and performance.

[42]  Marilyn L. Shaw,et al.  Visual search in multicharacter arrays with and without gaps , 1979 .

[43]  J. Townsend Serial and within-stage independent parallel model equivalence on the minimum completion time ☆ , 1976 .

[44]  J. Palmer Attention in Visual Search: Distinguishing Four Causes of a Set-Size Effect , 1995 .

[45]  Jeremy M. Wolfe,et al.  Just Say No: How Are Visual Searches Terminated When There Is No Target Present? , 1996, Cognitive Psychology.

[46]  C. Eriksen,et al.  Rate of information processing in visual perception: some results and methodological considerations. , 1969, Journal of experimental psychology.

[47]  J. Wolfe,et al.  What Can 1 Million Trials Tell Us About Visual Search? , 1998 .

[48]  J E Hoffman,et al.  A two-stage model of visual search , 1979, Perception & psychophysics.

[49]  S. Sternberg Memory Scanning: New Findings and Current Controversies , 1975 .

[50]  G. Humphreys,et al.  Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. , 1997, Psychological review.

[51]  H. Pashler,et al.  Detecting conjunctions of color and form: Reassessing the serial search hypothesis , 1987, Perception & psychophysics.

[52]  Donald L. Fisher,et al.  Central capacity limits in consistent mapping, visual search tasks: Four channels or more? , 1984, Cognitive Psychology.

[53]  A. Treisman,et al.  Conjunction search revisited. , 1990, Journal of experimental psychology. Human perception and performance.

[54]  J. Duncan,et al.  Attention and reading: Wholes and parts in shape recognition: A tutorial review. , 1987 .

[55]  M. Posner,et al.  Components of visual orienting , 1984 .

[56]  G. Sperling,et al.  Attention gating in short-term visual memory. , 1986, Psychological review.

[57]  A H van der Heijden,et al.  Some evidence for a limited capacity parallel selfterminating process in simple visual search tasks. , 1975, Acta psychologica.

[58]  H. Pashler,et al.  Visual attention and stimulus identification. , 1985, Journal of experimental psychology. Human perception and performance.

[59]  Jeff Miller,et al.  Discrete and continuous models of human information processing: theoretical distinctions and empirical results. , 1988, Acta psychologica.

[60]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[61]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[62]  J. Duncan,et al.  The Slow Time-Course of Visual Attention , 1996, Cognitive Psychology.

[63]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[64]  D. Meyer,et al.  Temporal properties of human information processing: Tests of discrete versus continuous models , 1985, Cognitive Psychology.

[65]  H. Egeth,et al.  Perception without attention: evidence of grouping under conditions of inattention. , 1997, Journal of experimental psychology. Human perception and performance.

[66]  Jan Theeuwes,et al.  Visual marking of old objects , 1998 .

[67]  G. Sperling,et al.  Dynamics of automatic and controlled visual attention. , 1987, Science.

[68]  Kimron Shapiro,et al.  Direct measurement of attentional dwell time in human vision , 1994, Nature.

[69]  C G Drury,et al.  A Variable-Memory Model of Visual Search , 1984, Human factors.

[70]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[71]  H. J. Muller,et al.  SEarch via Recursive Rejection (SERR): A Connectionist Model of Visual Search , 1993, Cognitive Psychology.

[72]  M. Posner,et al.  Selective attention and cognitive control , 1987, Trends in Neurosciences.

[73]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.