Human visual motion perception shows hallmarks of Bayesian structural inference

Motion relations in visual scenes carry an abundance of behaviorally relevant information, but little is known about the computations underlying the identification of visual motion structure by humans. We addressed this gap in two psychophysics experiments and found that participants identified hierarchically organized motion relations in close correspondence with Bayesian structural inference. We demonstrate that, for our tasks, a choice model based on the Bayesian ideal observer can accurately match many facets of human structural inference, including task performance, perceptual error patterns, single-trial responses, participant-specific differences, and subjective decision confidence, particularly when motion scenes are ambiguous. Our work can guide future neuroscience experiments to reveal the neural mechanisms underlying higher-level visual motion perception.

[1]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.

[2]  Haluk Öğmen,et al.  A computational model for reference-frame synthesis with applications to motion perception , 2016, Vision Research.

[3]  Hrag Pailian,et al.  Hierarchical structure is employed by humans during visual motion perception , 2019, Proceedings of the National Academy of Sciences.

[4]  Samuel J. Gershman,et al.  Discovering hierarchical motion structure , 2016, Vision Research.

[5]  Karl J. Friston,et al.  Bayesian model selection for group studies — Revisited , 2014, NeuroImage.

[6]  S. Gunnar O. Johansson,et al.  Configurations in event perception : an experimental study , 1951 .

[7]  T. L. Lewis,et al.  Putting order into the development of sensitivity to global motion , 2004, Vision Research.

[8]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[9]  Ádám Kepecs,et al.  A mathematical framework for statistical decision confidence , 2015, bioRxiv.

[10]  Heinrich H Bülthoff,et al.  Bayesian motion estimation accounts for a surprising bias in 3D vision , 2008, Proceedings of the National Academy of Sciences.

[11]  Benjamin M. Chin,et al.  Predicting the Partition of Behavioral Variability in Speed Perception with Naturalistic Stimuli , 2019, The Journal of Neuroscience.

[12]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[13]  Christopher C. Pack,et al.  Hierarchical processing of complex motion along the primate dorsal visual pathway , 2012, Proceedings of the National Academy of Sciences.

[14]  I Rock,et al.  A belongingness principle of motion perception. , 1997, Journal of experimental psychology. Human perception and performance.

[15]  Seth B. Agyei,et al.  Longitudinal study of perception of structured optic flow and random visual motion in infants using high-density EEG. , 2015, Developmental science.

[16]  F. Restle Coding theory of the perception of motion configurations. , 1979, Psychological review.

[17]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[18]  Wei Ji Ma,et al.  Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis , 2019, bioRxiv.

[19]  M. Pettet,et al.  Development of cortical responses to optic flow , 2007, Visual Neuroscience.

[20]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[21]  Antony B. Morland,et al.  Perceptual distortions of speed at low luminance: Evidence inconsistent with a Bayesian account of speed encoding , 2007, Vision Research.

[22]  F. Petzschner,et al.  A Bayesian perspective on magnitude estimation , 2015, Trends in Cognitive Sciences.

[23]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[24]  Alexandre Pouget,et al.  Relation between Belief and Performance in Perceptual Decision Making , 2014, PloS one.

[25]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[26]  Joshua I. Sanders,et al.  Signatures of a Statistical Computation in the Human Sense of Confidence , 2016, Neuron.

[27]  Eero P. Simoncelli,et al.  Optimal inference explains the perceptual coherence of visual motion stimuli. , 2011, Journal of vision.

[28]  Walter C. Gogel,et al.  Relative Motion and the Adjacency Principle , 1974 .

[29]  Jan Drugowitsch,et al.  Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality , 2016, Neuron.

[30]  D. Cross,et al.  Sequential dependencies and regression in psychophysical judgments , 1973 .

[31]  Elizabeth S. Spelke,et al.  Principles of Object Perception , 1990, Cogn. Sci..

[32]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[34]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[35]  David Ascher,et al.  A Bayesian model for the measurement of visual velocity , 2000, Vision Research.

[36]  Valentin Wyart,et al.  Choice variability and suboptimality in uncertain environments , 2016, Current Opinion in Behavioral Sciences.

[37]  Stefan Treue,et al.  Neurons in Primate Visual Cortex Alternate between Responses to Multiple Stimuli in Their Receptive Field , 2016, Front. Comput. Neurosci..

[38]  Stephen Grossberg,et al.  How Do Object Reference Frames and Motion Vector Decomposition Emerge in Laminar Cortical Circuits? , 2011 .

[39]  Pascal Mamassian,et al.  Visual Confidence. , 2016, Annual review of vision science.

[40]  K H Shum,et al.  A quantitative study of perceptual vector analysis , 1983, Perception & psychophysics.

[41]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[42]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[44]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.