Continuous Evolution of Statistical Estimators for Optimal Decision-Making

In many everyday situations, humans must make precise decisions in the presence of uncertain sensory information. For example, when asked to combine information from multiple sources we often assign greater weight to the more reliable information. It has been proposed that statistical-optimality often observed in human perception and decision-making requires that humans have access to the uncertainty of both their senses and their decisions. However, the mechanisms underlying the processes of uncertainty estimation remain largely unexplored. In this paper we introduce a novel visual tracking experiment that requires subjects to continuously report their evolving perception of the mean and uncertainty of noisy visual cues over time. We show that subjects accumulate sensory information over the course of a trial to form a continuous estimate of the mean, hindered only by natural kinematic constraints (sensorimotor latency etc.). Furthermore, subjects have access to a measure of their continuous objective uncertainty, rapidly acquired from sensory information available within a trial, but limited by natural kinematic constraints and a conservative margin for error. Our results provide the first direct evidence of the continuous mean and uncertainty estimation mechanisms in humans that may underlie optimal decision making.

[1]  T. Coleman,et al.  On the Convergence of Reflective Newton Methods for Large-scale Nonlinear Minimization Subject to Bounds , 1992 .

[2]  P. Juslin,et al.  Realism of confidence in sensory discrimination: The underconfidence phenomenon , 1993, Perception & psychophysics.

[3]  Thomas F. Coleman,et al.  On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds , 1994, Math. Program..

[4]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[5]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[6]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[7]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[8]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[9]  R. Zemel,et al.  Information processing with population codes , 2000, Nature Reviews Neuroscience.

[10]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[11]  R. Jacobs What determines visual cue reliability? , 2002, Trends in Cognitive Sciences.

[12]  S. Gepshtein,et al.  Viewing Geometry Determines How Vision and Haptics Combine in Size Perception , 2003, Current Biology.

[13]  Michael S Landy,et al.  Statistical decision theory and the selection of rapid, goal-directed movements. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[15]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[16]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[17]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[18]  D. Whitaker,et al.  Sensory uncertainty governs the extent of audio-visual interaction , 2004, Vision Research.

[19]  M. Wallace,et al.  Unifying multisensory signals across time and space , 2004, Experimental Brain Research.

[20]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[21]  Johan Wagemans,et al.  Texture and haptic cues in slant discrimination: reliability-based cue weighting without statistically optimal cue combination. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  L. Maloney,et al.  Explicit estimation of visual uncertainty in human motion processing , 2005, Vision Research.

[23]  S. Gepshtein,et al.  The combination of vision and touch depends on spatial proximity. , 2005, Journal of vision.

[24]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[25]  M. Ernst,et al.  Optimal integration of shape information from vision and touch , 2007, Experimental Brain Research.

[26]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[27]  Marc O Ernst,et al.  Visual-haptic cue weighting is independent of modality-specific attention. , 2008, Journal of vision.

[28]  A. Faisal,et al.  Near Optimal Combination of Sensory and Motor Uncertainty in Time During a Naturalistic Perception-Action Task , 2008, Journal of neurophysiology.

[29]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[30]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[31]  Pascal Mamassian,et al.  Evaluation of Objective Uncertainty in the Visual System , 2009, PLoS Comput. Biol..

[32]  D. Burr,et al.  Auditory dominance over vision in the perception of interval duration , 2009, Experimental Brain Research.

[33]  Simon Barthelmé,et al.  Flexible mechanisms underlie the evaluation of visual confidence , 2010, Proceedings of the National Academy of Sciences.

[34]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[35]  Eli Brenner,et al.  Grasping and hitting moving objects , 2011, Experimental Brain Research.

[36]  Eli Brenner,et al.  Continuous visual control of interception. , 2011, Human movement science.

[37]  Ian Saunders Closed-loop prosthetic hand : understanding sensorimotor and multisensory integration under uncertainty. , 2012 .