How Attention can Alter Appearances

It has long been known that attention can change how things appear (e.g., Treisman, 2006). Traditional models of attention that focus on modulation of neuronal gain control, feature binding, or object tracking cannot easily account for the fact that attention can be voluntarily allocated in a way that markedly alters perceived features, including color, size, transparency, 3D shape/layout, orientation, and motion. Before delving into theory, we think it best that readers experience for themselves the problem that we feel calls for an explanation. To that end, we begin by presenting a broad range of examples where attention can change how a single input is experienced. Our goal is to present a theory of attention that can account for all of the effects summarized in the figures, as well as some new ones involving perceived colors in cases of overlapping transparent surfaces. Here, we suggest that attention alters perceived appearances (i.e., features or qualia) by defining the domain of automatic operations in the preconscious buffer—a window of time just prior to conscious experience. Gestalt psychologists (e.g., Koffka, 1935) noted that percepts can be grouped in various ways, and that this can lead to changes in subjective appearance. In addition, which grouping is experienced is to some extent under endogenous or volitional control. For example, one can see an “X” in Figure 12.1A or a “square” or any number of other groupings, depending on how one attends to the component ellipses. Since attention can be shifted endogenously, the groupings one experiences as a result of a change in the specification of figure-versus-ground relationships can also change endogenously. In Rubin’s well-known (1915/1958) face/vase example, a version of which is shown in Figure 12.1B, one can see either a vase or two profiles facing one another. Other examples in the literature suggest that attention does more than simply flip figure and ground. Attentional “flipping” can induce changes in

[1]  David E. Irwin,et al.  What’s in an object file? Evidence from priming studies , 1996, Perception & psychophysics.

[2]  M K Albert,et al.  The Role of Surface Attraction in Perceiving Volumetric Shape , 2000, Perception.

[3]  B. Scholl,et al.  Perceiving Causality after the Fact: Postdiction in the Temporal Dynamics of Causal Perception , 2006, Perception.

[4]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[5]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[6]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[7]  David C. Burr,et al.  Seeing biological motion , 1998, Nature.

[8]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[9]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[10]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[11]  Takeo Watanabe,et al.  The role of parsing in high level motion processing , 1998 .

[12]  Sheba Heptulla Chatterjee,et al.  Configural processing in the perception of apparent biological motion. , 1996, Journal of experimental psychology. Human perception and performance.

[13]  L. Schauble,et al.  Beyond Modularity: A Developmental Perspective on Cognitive Science. , 1994 .

[14]  Zijiang J. He,et al.  Apparent motion determined by surface layout not by disparity or three-dimensional distance , 1994, Nature.

[15]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[16]  J. Freyd,et al.  Timing and Apparent Motion Path Choice With Human Body Photographs , 1993 .

[17]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[18]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[19]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[20]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[21]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[22]  D. Purves,et al.  Why we see what we do : an empirical theory of vision , 2003 .

[23]  Su-Ling Yeh,et al.  Object-based attention occurs regardless of object awareness , 2012, Psychonomic bulletin & review.

[24]  Y. Tsal,et al.  Object features, object locations, and object files: which does selective attention activate and when? , 2000 .

[25]  A. Treisman Perceiving and re-perceiving objects. , 1992, The American psychologist.

[26]  Gideon P Caplovitz,et al.  Contour discontinuities subserve two types of form analysis that underlie motion processing. , 2006, Progress in brain research.

[27]  A. Treisman Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[28]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[29]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[30]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[31]  M. Landy,et al.  Bayesian Modelling of Visual Perception , 2002 .

[32]  H. Helmholtz Handbuch der physiologischen Optik , 2015 .

[33]  S. Treue Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[34]  M. Carrasco,et al.  Covert attention affects the psychometric function of contrast sensitivity , 2002, Vision Research.

[35]  David E. Irwin,et al.  The role of physical and conceptual properties in preserving object continuity. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[36]  J. Fodor The Mind Doesn't Work That Way : The Scope and Limits of Computational Psychology , 2000 .

[37]  Alan N. Gove,et al.  Brightness perception, illusory contours, and corticogeniculate feedback , 1995, Visual Neuroscience.

[38]  Ronald A. Rensink,et al.  Early completion of occluded objects , 1998, Vision Research.

[39]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[40]  P U Tse,et al.  Illusory Volumes from Conformation , 1998, Perception.

[41]  A. Gilchrist Perceived lightness depends on perceived spatial arrangement. , 1977, Science.

[42]  J. Freyd,et al.  Apparent Motion of the Human Body , 1990 .

[43]  P U Tse,et al.  Amodal Completion in the Absence of Image Tangent Discontinuities , 1998, Perception.

[44]  Michelle R. Greene,et al.  Visual search in scenes involves selective and nonselective pathways , 2011, Trends in Cognitive Sciences.

[45]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[46]  P.-J. Hsieh,et al.  Feature mixing rather than feature replacement during perceptual filling-in , 2009, Vision Research.

[47]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[48]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[49]  Lars Muckli,et al.  Deciding what to see: The role of intention and attention in the perception of apparent motion , 2008, Vision Research.

[50]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[51]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[52]  P. Cavanagh,et al.  Surface decomposition accompanying the perception of transparency. , 1993, Spatial vision.

[53]  Jonathan Winawer,et al.  Image segmentation and lightness perception , 2005, Nature.

[54]  S. Treue,et al.  Attentional Modulation Strength in Cortical Area MT Depends on Stimulus Contrast , 2002, Neuron.

[55]  P. Tse,et al.  Chinese and Americans see opposite apparent motions in a Chinese character , 2000, Cognition.

[56]  A. Treisman How the deployment of attention determines what we see , 2006, Visual cognition.

[57]  Peter Ulric Tse,et al.  The duration of 3-D form analysis in transformational apparent motion , 2002, Perception & psychophysics.

[58]  Peter B. Delahunt,et al.  Bayesian model of human color constancy. , 2006, Journal of vision.

[59]  Fang Fang,et al.  A gender- and sexual orientation-dependent spatial attentional effect of invisible images , 2006, Proceedings of the National Academy of Sciences.

[60]  D. Kersten,et al.  Illusions, perception and Bayes , 2002, Nature Neuroscience.

[61]  R. Desimone,et al.  Interacting Roles of Attention and Visual Salience in V4 , 2003, Neuron.

[62]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[63]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[64]  B. Julesz,et al.  Figure-ground perception and random geometry , 1966 .

[65]  Semir Zeki,et al.  Feature binding in the feedback layers of area V2. , 2009, Cerebral cortex.

[66]  P. Tse A contour propagation approach to surface filling-in and volume formation. , 2001, Psychological review.

[67]  Po-Jang Hsieh,et al.  “Brain‐reading” of perceived colors reveals a feature mixing mechanism underlying perceptual filling‐in in cortical area V1 , 2010, Human brain mapping.

[68]  Ronald A. Rensink,et al.  Preattentive recovery of three-dimensional orientation from line drawings. , 1991, Psychological review.

[69]  Andreas K. Engel,et al.  Temporal Binding, Binocular Rivalry, and Consciousness , 1999, Consciousness and Cognition.

[70]  William Prinzmetal,et al.  The Phenomenology of Attention , 1997, Consciousness and Cognition.

[71]  P. Tse Voluntary attention modulates the brightness of overlapping transparent surfaces , 2005, Vision Research.

[72]  W. Hill My wife and my mother-in-law. They are both in this picture--find them / drawn by W.E. Hill. , 1915 .

[73]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[74]  Y. Saalmann,et al.  Gain control in the visual thalamus during perception and cognition , 2009, Current Opinion in Neurobiology.

[75]  Susan Carey,et al.  Infants' knowledge of objects: beyond object files and object tracking , 2001, Cognition.

[76]  David Whitney,et al.  Voluntary attention modulates motion-induced mislocalization. , 2011, Journal of vision.

[77]  P. Quinlan Visual feature integration theory: past, present, and future. , 2003, Psychological bulletin.

[78]  Marc Green,et al.  What determines correspondence strength in apparent motion? , 1986, Vision Research.

[79]  J. Wolfe Moving towards solutions to some enduring controversies in visual search , 2003, Trends in Cognitive Sciences.

[80]  Peter U Tse,et al.  The Bar — Cross — Ellipse Illusion: Alternating Percepts of Rigid and Nonrigid Motion Based on Contour Ownership and Trackable Feature Assignment , 2006, Perception.

[81]  Manish Singh,et al.  Toward a perceptual theory of transparency. , 2002, Psychological review.

[82]  C. Koch The quest for consciousness : a neurobiological approach , 2004 .

[83]  David L. Sheinberg,et al.  Fixational eye movements are not affected by abrupt onsets that capture attention , 2002, Vision Research.

[84]  Y. Tsal,et al.  Attention Reduces Perceived Brightness Contrast , 1994, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[85]  Ann E. Elsner,et al.  Position uncertainty and the perception of apparent movement , 1977 .

[86]  Peter U. Tse,et al.  Neural correlates of transformational apparent motion , 2006, NeuroImage.

[87]  G. Orban,et al.  Human Functional Magnetic Resonance Imaging Reveals Separation and Integration of Shape and Motion Cues in Biological Motion Processing , 2009, The Journal of Neuroscience.

[88]  Peter Ulric Tse,et al.  Volume Completion , 1999, Cognitive Psychology.

[89]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[90]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[91]  Z. Pylyshyn,et al.  What is a visual object? Evidence from target merging in multiple object tracking , 2001, Cognition.

[92]  A. Baddeley,et al.  Is the binding of visual features in working memory resource-demanding? , 2006, Journal of experimental psychology. General.

[93]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[94]  M. Carrasco,et al.  Spatial covert attention increases contrast sensitivity across the CSF: support for signal enhancement , 2000, Vision Research.

[95]  Zijiang J. He,et al.  Surfaces versus features in visual search , 1992, Nature.

[96]  Steven J Luck,et al.  Rapid Development of Feature Binding in Visual Short-Term Memory , 2006, Psychological science.

[97]  Werner X. Schneider,et al.  Visual-spatial working memory, attention, and scene representation: A neuro-cognitive theory , 1999, Psychological research.

[98]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[99]  Daniel Kersten,et al.  Bayesian models of object perception , 2003, Current Opinion in Neurobiology.

[100]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[101]  V S Ramachandran,et al.  Low Spatial Frequencies Dominate Apparent Motion , 1983, Perception.

[102]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[103]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[104]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[105]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[106]  P U Tse,et al.  Complete mergeability and amodal completion. , 1999, Acta psychologica.

[107]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[108]  Frans A. J. Verstraten,et al.  The Scope and Limits of Top-Down Attention in Unconscious Visual Processing , 2006, Current Biology.

[109]  R Ivry,et al.  A formal theory of feature binding in object perception. , 1996, Psychological review.

[110]  E. Adelson Perceptual organization and the judgment of brightness. , 1993, Science.

[111]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[112]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Voluntary Attention Enhances Contrast Appearance , 2022 .

[113]  Ronald A. Rensink,et al.  Preemption effects in visual search: evidence for low-level grouping. , 1995, Psychological review.

[114]  P. Tse,et al.  Illusory color mixing upon perceptual fading and filling-in does not result in ‘forbidden colors’ , 2006, Vision Research.