Attention in Stereo Vision: Implications for Computational Models of Attention

The stereo correspondence problem is a topic that has been the subject of considerable research effort. What has not yet been considered is an analogue of stereo correspondence in the domain of attention. In this chapter we bring this problem to light revealing important implications for computational models of attention and in particular how these implications constrain the problem of computational modeling of attention. A model is described which addresses attention in the stereo domain, and it is revealed that a variety of behaviors observed in binocular rivalry experiments are consistent with the model’s behavior. Finally, we consider how constraints imposed by stereo vision may suggest analogous constraints in other nonstereo feature domains with significant consequence to computational models of attention.

[1]  Stephen R. Arnott,et al.  Attention switching in depth using random-dot autostereograms: Attention gradient asymmetries , 2000, Perception & psychophysics.

[2]  Izumi Ohzawa,et al.  Mechanisms of stereoscopic vision: the disparity energy model , 1998, Current Opinion in Neurobiology.

[3]  Leonard Uhr,et al.  Layered "Recognition Cone" Networks That Preprocess, Classify, and Describe , 1972, IEEE Transactions on Computers.

[4]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[5]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[6]  Arthur F. Kramer,et al.  Limits of focused attention in three-dimensional space , 1993, Perception & psychophysics.

[7]  Peter J. Burt,et al.  Attention mechanisms for vision in a dynamic world , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[8]  D C Van Essen,et al.  Shifter circuits: a computational strategy for dynamic aspects of visual processing. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[9]  C M Moore,et al.  Role of perceptual organization while attending in depth , 2000, Perception & psychophysics.

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  K. Matsuoka The dynamic model of binocular rivalry , 2004, Biological Cybernetics.

[12]  Ken Nakayama,et al.  Serial and parallel processing of visual feature conjunctions , 1986, Nature.

[13]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[14]  E. Mingolla,et al.  Dynamics of Attention in Depth: Evidence from Multi-Element Tracking , 2002, Perception.

[15]  J. Theeuwes,et al.  Spatial cuing in a stereoscopic display: Evidence for a “depth-aware” attentional focus , 1997 .

[16]  N. Kanwisher,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Recognition As Soon as You Know It Is There, You Know What It Is , 2022 .

[17]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[18]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[19]  P. A. Sandon Simulating Visual Attention , 1990, Journal of Cognitive Neuroscience.

[20]  R. Blake A Neural Theory of Binocular Rivalry , 1989 .

[21]  N. Logothetis,et al.  What is rivalling during binocular rivalry , 1996 .

[22]  N. Logothetis,et al.  Global competition dictates local suppression in pattern rivalry. , 2005, Journal of vision.

[23]  H. Wilson,et al.  Dynamics of travelling waves in visual perception , 2001, Nature.

[24]  John K. Tsotsos A ‘complexity level’ analysis of immediate vision , 2004, International Journal of Computer Vision.

[25]  John H. R. Maunsell,et al.  No binocular rivalry in the LGN of alert macaque monkeys , 1996, Vision Research.

[26]  Zijiang J. He,et al.  Binocular Rivalry and Visual Awareness: The Role of Attention , 1999, Perception.

[27]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[28]  C. Folk,et al.  Spatial cuing in a stereoscopic display: Evidence for a “depth-blind” attentional spotlight , 1996, Psychonomic bulletin & review.

[29]  Silvia M. Mueller,et al.  An in-depth look at visual attention , 1994 .

[30]  J. Theeuwes,et al.  Attentional control within 3-D space. , 1998, Journal of experimental psychology. Human perception and performance.

[31]  Ning Qian,et al.  A Coarse-to-Fine Disparity Energy Model with Both Phase-Shift and Position-Shift Receptive Field Mechanisms , 2004, Neural Computation.

[32]  T. Kumada,et al.  Attending to a location in three-dimensional space modulates early ERPs. , 2003, Brain research. Cognitive brain research.

[33]  Michael C. Mozer,et al.  The perception of multiple objects , 1991 .

[34]  H. Barlow Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[35]  T. Mueller A physiological model of binocular rivalry , 1990, Visual Neuroscience.

[36]  Ryota Kanai,et al.  Perceptual Alternation Induced by Visual Transients , 2005, Perception.

[37]  P. Carmeliet,et al.  Object-based attention determines dominance in binocular rivalry , 2022 .

[38]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[39]  John K. Tsotsos The Selective Tuning Model for Visual Attention , 2002 .

[40]  Jan Theeuwes,et al.  Inhibition of return spreads across 3-D space , 2003, Psychonomic bulletin & review.

[41]  F. Tong,et al.  Can attention selectively bias bistable perception? Differences between binocular rivalry and ambiguous figures. , 2004, Journal of vision.

[42]  S. Luck,et al.  Attention to Features Precedes Attention to Locations in Visual Search: Evidence from Electromagnetic Brain Responses in Humans , 2004, The Journal of Neuroscience.

[43]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[44]  C. Folk,et al.  Shifting Visual Attention in Stereographic Displays: A Time Course Analysis , 1994, Human factors.