Junctions and cost functions in motion interpretation.

Form, motion, occlusion, and perceptual organization are intimately related. We sought to assess the role of junctions in their interaction. We used stimuli based on a cross moving within an occluding aperture. The two bars of the cross appear to cohere or move separately depending on the context; in accord with prior literature, motion interpretation depends in part on whether the bar endpoints appear to be occluded. To test the importance of junctions in motion interpretation, we explored the effect of changing the junctions generated at the occlusion points in our stimuli, from T-junctions to L-junctions. In some cases, this change had a large effect on perceived motion; in others, it made little difference, suggesting junctions are not the critical variable. Further experiments suggested that what matters is not junctions per se, but whether illusory contours are introduced when the junction category is changed. Our results are consistent with an optimization-based computation that seeks to minimize the presence of illusory contours in the perceptual representation. Although it may be possible to explain our results with interactions between junctions, parsimony favors an explanation in terms of a cost-function operating on layered surface interpretations, with no explicit reference to junctions.

[1]  T. Albright,et al.  Luminance contrast affects motion coherency in plaid patterns by acting as a depth-from-occlusion cue , 1998, Vision Research.

[2]  K Nakayama,et al.  Experiencing and perceiving visual surfaces. , 1992, Science.

[3]  E. Leeuwenberg.  Quantitative specification of information in sequential patterns. , 1969, Psychological review.

[4]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[5]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[6]  Adolfo Guzman,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968 .

[7]  M. K. Albert.  Surface perception and the generic view principle , 2001, Trends in Cognitive Sciences.

[8]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[9]  P Bressan,et al.  The Role of Depth Stratification in the Solution of the Aperture Problem , 1993, Perception.

[10]  J. Hochberg,et al.  A quantitative approach to figural "goodness". , 1953, Journal of experimental psychology.

[11]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[12]  Thomas O. Binford,et al.  The Recovery of Three-Dimensional Structure from Image Curves , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  J. Koenderink,et al.  The singularities of the visual mapping , 1976, Biological Cybernetics.

[14]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[15]  D. Mumford.  Perception as Bayesian Inference: Pattern theory: A unifying perspective , 1996 .

[16]  D. Mumford.  Pattern theory: a unifying perspective , 1996 .

[17]  Ennio Mingolla,et al.  Monocular occlusion cues alter the influence of terminator motion in the barber pole phenomenon , 1998, Vision Research.

[18]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[19]  F. Restle.  Coding theory of the perception of motion configurations. , 1979, Psychological review.

[20]  B L Anderson,et al.  Reciprocal interactions between occlusion and motion computations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[21]  S. Wuerger,et al.  Perception of Moving Lines: Interactions Between Local Perpendicular Signals and 2D Motion Signals , 1997, Vision Research.

[22]  M. B. Clowes,et al.  On Seeing Things , 1971, Artif. Intell..

[23]  William T. Freeman,et al.  The generic viewpoint assumption in a framework for visual perception , 1994, Nature.

[24]  T. Sejnowski,et al.  A selection model for motion processing in area MT of primates , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  B L Anderson,et al.  Stereoscopic occlusion and the aperture problem for motion: a new solution 1 A preliminary version of some of the experiments reported in this paper were presented at the 1994 ARVO conference, Sarasota, Florida. 1 , 1999, Vision Research.

[26]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[27]  Jaakko Hintikka,et al.  On the Logic of Perception , 1969 .

[28]  Maggie Shiffrar,et al.  The influence of terminators on motion integration across space , 1992, Vision Research.

[29]  Christopher C. Pack,et al.  The role of terminators and occlusion cues in motion integration and segmentation: a neural network model , 1999, Vision Research.

[30]  P. Cz..  Handbuch der physiologischen Optik , 1896 .

[31]  T. Troscianko,et al.  AI and the eye , 1990 .

[32]  Stephen Grossberg,et al.  Neural dynamics of motion integration and segmentation within and across apertures , 2001, Vision Research.

[33]  Michael S. Landy,et al.  Theories for the Visual Perception of Local Velocity and Coherent Motion , 1991 .

[34]  H. Wallach.  On the visually perceived direction of motion ' ' by Hans Wallach : 60 years later , 1997 .

[35]  Eric Saund.  Perceptual Organization of Occluding Contours of Opaque Surfaces , 1999, Comput. Vis. Image Underst..

[36]  Jan J. Koenderink,et al.  Inferring three-dimensional shapes from two-dimensional silhouettes , 1987 .

[37]  John C. Trueswell,et al.  Surface segmentation mechanisms and motion perception , 1993, Vision Research.

[38]  M. Shiffrar,et al.  Increased Motion Linking Across Edges with Decreased Luminance Contrast, Edge Width and Duration , 1996, Vision Research.

[39]  A. M. Rohaly,et al.  The effects of contrast on perceived depth and depth discrimination , 1999, Vision Research.

[40]  Eric Castet,et al.  The extrinsic/intrinsic classification of two-dimensional motion signals with barber-pole stimuli , 1999, Vision Research.

[41]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[42]  Maggie Shiffrar,et al.  Motion integration across differing image features , 1995, Vision Research.

[43]  P. Bressan,et al.  Occlusion and the perception of coherent motion , 1991, Vision Research.

[44]  Thomas D. Albright,et al.  The interpretation of visual motion: Evidence for surface segmentation mechanisms , 1996, Vision Research.

[45]  N Rubin,et al.  The Role of Junctions in Surface Completion and Contour Matching , 2001, Perception.

[46]  E. Adelson.  Lightness Perception and Lightness Illusions , 1999 .

[47]  B. Spehar,et al.  Induced Effects of Backgrounds and Foregrounds in Three-Dimensional Configurations: The Role of T-Junctions , 1997, Perception.

[48]  Takeo Watanabe,et al.  PII: S0042-6989(97)00101-6 , 2003 .

[49]  M. Gazzaniga.  The new cognitive neurosciences, 2nd ed. , 2000 .

[50]  Ellen C. Hildreth,et al.  Measurement of Visual Motion , 1984 .

[51]  E H Adelson,et al.  Beyond Junctions: Nonlocal form Constraints on Motion Interpretation , 2001, Perception.

[52]  S. Blackburn,et al.  Contrast as a depth cue , 1994, Vision Research.

[53]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.