Discovering hierarchical motion structure

Scenes filled with moving objects are often hierarchically organized: the motion of a migrating goose is nested within the flight pattern of its flock, the motion of a car is nested within the traffic pattern of other cars on the road, the motion of body parts are nested in the motion of the body. Humans perceive hierarchical structure even in stimuli with two or three moving dots. An influential theory of hierarchical motion perception holds that the visual system performs a "vector analysis" of moving objects, decomposing them into common and relative motions. However, this theory does not specify how to resolve ambiguity when a scene admits more than one vector analysis. We describe a Bayesian theory of vector analysis and show that it can account for classic results from dot motion experiments, as well as new experimental data. Our theory takes a step towards understanding how moving scenes are parsed into objects.

[1]  E. Adelson,et al.  Slow and Smooth: A Bayesian theory for the combination of local motion signals in human vision , 1998 .

[2]  J. Pitman.  Combinatorial Stochastic Processes , 2006 .

[3]  Joseph L. Austerweil,et al.  Structure and Flexibility in Bayesian Models of Cognition , 2015 .

[4]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[5]  J Hochberg,et al.  Perceptual analysis of moving patterns. , 1976, Science.

[6]  K. Nakayama,et al.  A Velocity Analogue of Brightness Contrast , 1973, Perception.

[7]  J. Cutting,et al.  Perception of wheel-generated motions. , 1979, Journal of experimental psychology. Human perception and performance.

[8]  D. Aldous.  Exchangeability and related topics , 1985 .

[9]  Sunil Arya,et al.  Space-time tradeoffs for approximate nearest neighbor searching , 2009, JACM.

[10]  K H Shum,et al.  A quantitative study of perceptual vector analysis , 1983, Perception & psychophysics.

[11]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  Brian J Scholl,et al.  Dynamic Object Individuation in Rhesus Macaques , 2004, Psychological science.

[14]  E. Spelke,et al.  Perception of partly occluded objects in infancy , 1983, Cognitive Psychology.

[15]  Terrence J. Sejnowski,et al.  Filter selection model for motion segmentation and velocity integration , 1994 .

[16]  Jonathan I. Flombaum,et al.  A temporal same-object advantage in the tunnel effect: facilitated change detection for persisting objects. , 2006, Journal of experimental psychology. Human perception and performance.

[17]  Walter C. Gogel,et al.  Relative Motion and the Adjacency Principle , 1974 .

[18]  K. Duncker,et al.  Über induzierte Bewegung , 1929 .

[19]  D. Navarro.  On the interaction between exemplar-based concepts and a response scaling process , 2007 .

[20]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[21]  H Wallach,et al.  Vector analysis and process combination in motion perception. , 1985, Journal of experimental psychology. Human perception and performance.

[22]  Alex R. Wade,et al.  fMRI measurements of color in macaque and human. , 2008, Journal of vision.

[23]  Frank Jäkel,et al.  Bayesian vector analysis and the perception of hierarchical motion , 2013, CogSci.

[24]  S. Carey,et al.  Infants' ability to use object kind information for object individuation , 1999, Cognition.

[25]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[26]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[27]  S. Carey,et al.  Infants’ Metaphysics: The Case of Numerical Identity , 1996, Cognitive Psychology.

[28]  I Rock,et al.  A belongingness principle of motion perception. , 1997, Journal of experimental psychology. Human perception and performance.

[29]  O. Braddick.  Segmentation versus integration in visual motion processing , 1993, Trends in Neurosciences.

[30]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[31]  William Curran,et al.  Directional performance in motion transparency , 2002, Vision Research.

[32]  F. Restle.  Coding theory of the perception of motion configurations. , 1979, Psychological review.

[33]  J. Townsend,et al.  The Oxford Handbook of Computational and Mathematical Psychology , 2015 .

[34]  Yair Weiss,et al.  Smoothness in layers: Motion segmentation using nonparametric mixture estimation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[36]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[37]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[38]  G. Alvarez,et al.  Space and time, not surface features, guide object persistence , 2007, Psychonomic bulletin & review.

[39]  M. Wertheimer.  Laws of organization in perceptual forms. , 1938 .

[40]  Luke A. Burke,et al.  On the Tunnel Effect , 1952 .

[41]  Edward H. Adelson,et al.  Layered representation for motion analysis , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Yves Burnod,et al.  Bayesian inference in populations of cortical neurons: a model of motion integration and segmentation in area MT , 1999, Biological Cybernetics.

[43]  K. Verfaillie,et al.  Bistability and Biasing Effects in the Perception of Ambiguous Point-Light Walkers , 2004, Perception.

[44]  Frans A. J. Verstraten,et al.  Motion transparency: making models of motion perception transparent , 1999, Trends in Cognitive Sciences.

[45]  J. Hochberg,et al.  A quantitative approach to figural "goodness". , 1953, Journal of experimental psychology.

[46]  Stephen Grossberg,et al.  How Do Object Reference Frames and Motion Vector Decomposition Emerge in Laminar Cortical Circuits? , 2011 .

[47]  Y. Niv,et al.  Learning latent structure: carving nature at its joints , 2010, Current Opinion in Neurobiology.

[48]  Thomas L. Griffiths,et al.  The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies , 2007, JACM.

[49]  S. Gunnar O. Johansson,et al.  Configurations in event perception : an experimental study , 1951 .

[50]  M. Wertheimer.  Untersuchungen zur Lehre von der Gestalt. II , 1923 .