Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception

The precision of multisensory perception improves when cues arising from the same cause are integrated, such as visual and vestibular heading cues for an observer moving through a stationary environment. In order to determine how the cues should be processed, the brain must infer the causal relationship underlying the multisensory cues. In heading perception, however, it is unclear whether observers follow the Bayesian strategy, a simpler non-Bayesian heuristic, or even perform causal inference at all. We developed an efficient and robust computational framework to perform Bayesian model comparison of causal inference strategies, which incorporates a number of alternative assumptions about the observers. With this framework, we investigated whether human observers’ performance in an explicit cause attribution and an implicit heading discrimination task can be modeled as a causal inference process. In the explicit causal inference task, all subjects accounted for cue disparity when reporting judgments of common cause, although not necessarily all in a Bayesian fashion. By contrast, but in agreement with previous findings, data from the heading discrimination task only could not rule out that several of the same observers were adopting a forced-fusion strategy, whereby cues are integrated regardless of disparity. Only when we combined evidence from both tasks we were able to rule out forced-fusion in the heading discrimination task. Crucially, findings were robust across a number of variants of models and analyses. Our results demonstrate that our proposed computational framework allows researchers to ask complex questions within a rigorous Bayesian framework that accounts for parameter and model uncertainty.

[1]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[2]  Luigi Acerbi,et al.  The Role of Sensory Uncertainty in Simple Perceptual Organization , 2018, bioRxiv.

[3]  Dora E Angelaki,et al.  Multisensory Integration of Visual and Vestibular Signals Improves Heading Discrimination in the Presence of a Moving Object , 2015, The Journal of Neuroscience.

[4]  Ladan Shams,et al.  Bayesian priors are encoded independently from likelihoods in human multisensory perception. , 2009, Journal of vision.

[5]  Dora E Angelaki,et al.  Multisensory self-motion compensation during object trajectory judgments. , 2015, Cerebral cortex.

[6]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[7]  Ulrik R. Beierholm,et al.  Probability Matching as a Computational Strategy Used in Perception , 2010, PLoS Comput. Biol..

[8]  Heinrich H Bülthoff,et al.  Causal Inference in Multisensory Heading Estimation , 2017, PloS one.

[9]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[10]  U. Noppeney,et al.  Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception , 2015, PLoS biology.

[11]  Yong Gu,et al.  Decoding of MSTd Population Activity Accounts for Variations in the Precision of Heading Perception , 2010, Neuron.

[12]  Karl J. Friston,et al.  Bayesian model selection for group studies (vol 46, pg 1005, 2009) , 2009 .

[13]  Allen Caldwell,et al.  Target Density Normalization for Markov Chain Monte Carlo Algorithms , 2014, 1410.7149.

[14]  O. Schwartz,et al.  Specificity and timescales of cortical adaptation as inferences about natural movie statistics , 2016, Journal of vision.

[15]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[16]  M. Nardini,et al.  Fusion of visual cues is not mandatory in children , 2010, Proceedings of the National Academy of Sciences.

[17]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[18]  Adeel Razi,et al.  Bayesian model reduction and empirical Bayes for group (DCM) studies , 2016, NeuroImage.

[19]  S. S. Stevens On the psychophysical law. , 1957, Psychological review.

[20]  K. D. de Winkel,et al.  What’s Up: an assessment of Causal Inference in the Perception of Verticality , 2017, bioRxiv.

[21]  Jennifer L. Campos,et al.  Imagined Self-Motion Differs from Perceived Self-Motion: Evidence from a Novel Continuous Pointing Method , 2009, PloS one.

[22]  David R. Wozny,et al.  Human trimodal perception follows optimal statistical inference. , 2008, Journal of vision.

[23]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018, PLoS Comput. Biol..

[24]  John J. Foxe,et al.  The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. , 2013, Cerebral cortex.

[25]  Lionel Rigoux,et al.  VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data , 2014, PLoS Comput. Biol..

[26]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[27]  Wei Ji Ma,et al.  A detailed comparison of optimality and simplicity in perceptual decision making. , 2016, Psychological review.

[28]  Radford M. Neal Slice Sampling , 2003, The Annals of Statistics.

[29]  F. Petzschner,et al.  Iterative Bayesian Estimation as an Explanation for Range and Regression Effects: A Study on Human Path Integration , 2011, The Journal of Neuroscience.

[30]  Walter R. Gilks,et al.  Adaptive Direction Sampling , 1994 .

[31]  A. Tolias,et al.  Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization , 2013, Proceedings of the National Academy of Sciences.

[32]  Paul R. MacNeilage,et al.  Systematic Biases in Human Heading Estimation , 2013, PloS one.

[33]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[34]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[35]  Heinrich H. Bülthoff,et al.  Forced Fusion in Multisensory Heading Estimation , 2015, PloS one.

[36]  Michael J Brammer,et al.  Crossmodal identification , 1998, Trends in Cognitive Sciences.

[37]  William H. Press,et al.  Numerical recipes , 1990 .

[38]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[39]  A. Gelman,et al.  Pareto Smoothed Importance Sampling , 2015, 1507.02646.

[40]  Heinrich H. Bülthoff,et al.  The role of stereo vision in visual-vestibular integration. , 2011, Seeing and perceiving.

[41]  Aki Vehtari,et al.  Comparison of Bayesian predictive methods for model selection , 2015, Stat. Comput..

[42]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.

[43]  Dora E Angelaki,et al.  Estimating distance during self-motion: a role for visual-vestibular interactions. , 2011, Journal of vision.

[44]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[45]  Olaf Blanke,et al.  Self-motion leads to mandatory cue fusion across sensory modalities. , 2012, Journal of neurophysiology.

[46]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[47]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[48]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[49]  M. Ernst,et al.  Optimal integration of shape information from vision and touch , 2007, Experimental Brain Research.

[50]  Barry B. Lee,et al.  Temporal frequency and chromatic processing in humans: an fMRI study of the cortical visual areas. , 2011, Journal of vision.

[51]  Aki Vehtari,et al.  Understanding predictive information criteria for Bayesian models , 2013, Statistics and Computing.

[52]  Uta Noppeney,et al.  Sensory reliability shapes perceptual inference via two mechanisms. , 2015, Journal of vision.

[53]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[54]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[55]  Yuhong Yang,et al.  Information Theory, Inference, and Learning Algorithms , 2005 .

[56]  Daniel Foreman-Mackey,et al.  emcee: The MCMC Hammer , 2012, 1202.3665.

[57]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[58]  G. Rhodes,et al.  How is facial expression coded? , 2015, Journal of vision.

[59]  Ulrik R. Beierholm,et al.  Causal inference in perception , 2010, Trends in Cognitive Sciences.

[60]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[61]  Karl J. Friston,et al.  Bayesian model selection for group studies — Revisited , 2014, NeuroImage.

[62]  M. Lengyel,et al.  Mind Reading by Machine Learning: A Doubly Bayesian Method for Inferring Mental Representations , 2010 .

[63]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[64]  Gregory L Murphy,et al.  Implicit and explicit processes in category-based induction: is induction best when we don't think? , 2014, Journal of experimental psychology. General.

[65]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[66]  L. Shams,et al.  The Brain’s Tendency to Bind Audiovisual Signals Is Stable but Not General , 2016, Psychological science.

[67]  Xue-Xin Wei,et al.  A Bayesian observer model constrained by efficient coding can explain 'anti-Bayesian' percepts , 2015, Nature Neuroscience.

[68]  Christopher R Fetsch,et al.  Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception , 2009, The Journal of Neuroscience.

[69]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[70]  J. Weesie,et al.  Integration of visual and inertial cues in perceived heading of self-motion. , 2010, Journal of vision.

[71]  P. J. Werkhoven,et al.  Integration of visual and inertial cues in the perception of angular self-motion , 2013, Experimental Brain Research.

[72]  Ralph-Axel Müller,et al.  Sensory Symptoms and Processing of Nonverbal Auditory and Visual Stimuli in Children with Autism Spectrum Disorder , 2016, Journal of autism and developmental disorders.

[73]  David R. Wozny,et al.  Computational Characterization of Visually Induced Auditory Spatial Adaptation , 2011, Front. Integr. Neurosci..

[74]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[75]  Luigi Acerbi,et al.  Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing , 2012, PLoS Comput. Biol..

[76]  Luigi Acerbi,et al.  A Framework for Testing Identifiability of Bayesian Models of Perception , 2014, NIPS.

[77]  C. Robert,et al.  Computational methods for Bayesian model choice , 2009, 0907.5123.

[78]  M. Wallace,et al.  Unifying multisensory signals across time and space , 2004, Experimental Brain Research.

[79]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[80]  Kazuyuki Aihara,et al.  Auditory Time-Interval Perception as Causal Inference on Sound Sources , 2012, Front. Psychology.

[81]  Richard N. Aslin,et al.  Learning and inference using complex generative models in a spatial localization task , 2016, Journal of vision.

[82]  Eero P. Simoncelli,et al.  Efficient Sensory Encoding and Bayesian Inference with Heterogeneous Neural Populations , 2014, Neural Computation.

[83]  L. Wasserman,et al.  Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio , 1995 .

[84]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[85]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[86]  P. Grassberger Entropy Estimates from Insufficient Samplings , 2003, physics/0307138.

[87]  O. Blanke,et al.  Learning to integrate contradictory multisensory self-motion cue pairings. , 2015, Journal of vision.

[88]  Wei Ji Ma,et al.  Optimal inference of sameness , 2012, Proceedings of the National Academy of Sciences.

[89]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[90]  Benjamin T. Crane,et al.  Direction Specific Biases in Human Visual and Vestibular Heading Perception , 2012, PloS one.

[91]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[92]  Wei Ji Ma,et al.  Causal inference of asynchronous audiovisual speech , 2013, Front. Psychol..

[93]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[94]  A. Pouget,et al.  Behavior and neural basis of near-optimal visual search , 2011, Nature Neuroscience.

[95]  Sethu Vijayakumar,et al.  Multisensory Oddity Detection as Bayesian Inference , 2009, PloS one.

[96]  A. Gelman,et al.  The garden of forking paths : Why multiple comparisons can be a problem , even when there is no “ fishing expedition ” or “ p-hacking ” and the research hypothesis was posited ahead of time ∗ , 2019 .

[97]  M. Landy,et al.  The expected utility of movement , 2009 .

[98]  Donald E. Knuth Two notes on notation , 1992 .

[99]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[100]  F. Scharnowski,et al.  Long-lasting modulation of feature integration by transcranial magnetic stimulation. , 2009, Journal of vision.

[101]  Kazuyuki Aihara,et al.  Bayesian Inference Explains Perception of Unity and Ventriloquism Aftereffect: Identification of Common Sources of Audiovisual Stimuli , 2007, Neural Computation.

[102]  David R. Wozny,et al.  A simple and efficient method to enhance audiovisual binding tendencies , 2017, PeerJ.

[103]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[104]  Hans Colonius,et al.  Formal models and quantitative measures of multisensory integration: a selective overview , 2020, The European journal of neuroscience.

[105]  W. Ma Organizing probabilistic models of perception , 2012, Trends in Cognitive Sciences.

[106]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[107]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[108]  S. Walker Invited comment on the paper "Slice Sampling" by Radford Neal , 2003 .

[109]  Jennifer L. Campos,et al.  Bayesian integration of visual and vestibular signals for heading. , 2009, Journal of vision.

[110]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[111]  Ladan Shams,et al.  Biases in Visual, Auditory, and Audiovisual Perception of Space , 2015, PLoS Comput. Biol..

[112]  Gregory C. DeAngelis,et al.  Vestibular Facilitation of Optic Flow Parsing , 2010, PloS one.

[113]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[114]  G. DeAngelis,et al.  Multisensory integration: psychophysics, neurophysiology, and computation , 2009, Current Opinion in Neurobiology.