Combining Priors and Noisy Visual Cues in a Rapid Pointing Task

Statistical decision theory suggests that choosing an ideal action requires taking several factors into account: (1) prior knowledge of the probability of various world states, (2) sensory information concerning the world state, (3) the probability of outcomes given a choice of action, and (4) the loss or gain associated with those outcomes. In previous work, we found that, in many circumstances, humans act like ideal decision makers in planning a reaching movement. They select a movement aim point that maximizes expected gain, thus taking into account outcome uncertainty (motor noise) and the consequences of their actions. Here, we ask whether humans can optimally combine prior knowledge and uncertain sensory information in planning a reach. Subjects rapidly pointed at unseen targets, indicated with dots drawn from a distribution centered on the invisible target location. Target location had a prior distribution, the form of which was known to the subject. We varied the number of dots and hence target spatial uncertainty. An analysis of the sources of uncertainty impacting performance in this task indicated that the optimal strategy was to aim between the mean of the prior (the screen center) and the mean stimulus location (centroid of the dot cloud). With increased target location uncertainty, the aim point should have moved closer to the prior. Subjects used near-optimal strategies, combining stimulus uncertainty and prior information appropriately. Observer behavior was well modeled as having three additional sources of inefficiency originating in the motor system, calculation of centroid location, and calculation of aim points.

[1]  G Aschersleben,et al.  Synchronizing actions with events: The role of sensory information , 1995, Perception & psychophysics.

[2]  D Kersten,et al.  Moving Cast Shadows Induce Apparent Motion in Depth , 1997, Perception.

[3]  Robert A Jacobs,et al.  Bayesian integration of visual and auditory signals for spatial localization. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Les R. T. Williams,et al.  Coincidence Timing of a Tennis Stroke: Effects of Age, Skill Level, Gender, Stimulus Velocity, and Attention Demand , 2002, Research quarterly for exercise and sport.

[5]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[6]  D. Meyer,et al.  Models for the speed and accuracy of aimed movements. , 1982, Psychological review.

[7]  M. Landy,et al.  Statistical decision theory and trade-offs in the control of motor response. , 2003, Spatial vision.

[8]  Wendy J Adams,et al.  Bayesian modeling of cue interaction: bistability in stereoscopic slant perception. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[10]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[11]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[12]  Michael S. Landy,et al.  Bayesian modeling of visual perception , 2002 .

[13]  Stephen M. Rao,et al.  The evolution of brain activation during temporal processing , 2001, Nature Neuroscience.

[14]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[15]  Pascal Mamassian,et al.  Observer biases in the 3D interpretation of line drawings , 1998, Vision Research.

[16]  Laurence T. Maloney,et al.  Statistical Decision Theory and Biological Vision , 2005 .

[17]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[18]  Alexander Thiele,et al.  Effects on orientation perception of manipulating the spatio–temporal prior probability of stimuli , 2004, Vision Research.

[19]  J. Tresilian,et al.  Perceptual and cognitive processes in time-to-contact estimation: Analysis of prediction-motion and relative judgment tasks , 1995, Perception & psychophysics.

[20]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[21]  R. Johansson,et al.  Cortical activity in precision- versus power-grip tasks: an fMRI study. , 2000, Journal of neurophysiology.

[22]  David C. Knill,et al.  Object classification for human and ideal observers , 1995, Vision Research.

[23]  David Whitaker,et al.  Isolation of stimulus characteristics contributing to Weber's law for position , 2002, Vision Research.

[24]  Daniel Kersten,et al.  Bayesian models of object perception , 2003, Current Opinion in Neurobiology.

[25]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Dennis M. Levi,et al.  “Weber's law” for position: Unconfounding the role of separation and eccentricity , 1988, Vision Research.

[27]  W. R. Buckland,et al.  Contributions to Probability and Statistics , 1960 .

[28]  Mingzhou Ding,et al.  Statistical Analysis of Timing Errors , 2002, Brain and Cognition.

[29]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[30]  T. Lee Top-down influence in early visual processing: a Bayesian perspective , 2002, Physiology & Behavior.

[31]  Daniel M Wolpert,et al.  Bayesian integration in force estimation. , 2004, Journal of neurophysiology.

[32]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[33]  M S Landy,et al.  Ideal cue combination for localizing texture-defined edges. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[35]  R A Scheidt,et al.  Impedance control and internal model formation when reaching in a randomly varying dynamical environment. , 2001, Journal of neurophysiology.

[36]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.

[37]  Alan M. Wing,et al.  Modeling variability and dependence in timing , 1996 .

[38]  Dennis M. Levi,et al.  The role of separation and eccentricity in encoding position , 1990, Vision Research.

[39]  K. Torre,et al.  Time intervals production in tapping and oscillatory motion. , 2004, Human movement science.

[40]  David J. Fleet,et al.  Probabilistic Models of the Brain : Perception and Neural Function , 2001 .

[41]  Dennis M. Levi,et al.  Spatial-interval discrimination in two-dimensions , 1991, Vision Research.

[42]  S. Gepshtein,et al.  Viewing Geometry Determines How Vision and Haptics Combine in Size Perception , 2003, Current Biology.

[43]  Hugh R. Wilson,et al.  Responses of spatial mechanisms can explain hyperacuity , 1986, Vision Research.

[44]  A. Kristofferson,et al.  The timing of interresponse intervals , 1973 .

[45]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[46]  S. Dakin Information limit on the spatial integration of local orientation signals. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[47]  R. Ivry,et al.  The neural representation of time , 2004, Current Opinion in Neurobiology.

[48]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[49]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989 .

[50]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[51]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[52]  S. Klein,et al.  Hyperacuity thresholds of 1 sec: theoretical predictions and empirical validation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[53]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[54]  C. Sherrington OBSERVATIONS ON THE SENSUAL RÔLE OF THE PROPRIOCEPTIVE NERVE-SUPPLY OF THE EXTRINSIC OCULAR MUSCLES , 1918 .

[55]  W. Meck,et al.  Dissecting the Brain's Internal Clock: How Frontal–Striatal Circuitry Keeps Time and Shifts Attention , 2002, Brain and Cognition.

[56]  D. Todd,et al.  The Sun , 1870, Nature.

[57]  H. Zelaznik,et al.  Disrupted Timing of Discontinuous But Not Continuous Movements by Cerebellar Lesions , 2003, Science.

[58]  David Badcock,et al.  Localization of element clusters by the human visual system , 1994, Vision Research.

[59]  Michael S Landy,et al.  Statistical decision theory and the selection of rapid, goal-directed movements. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[60]  D G Pelli,et al.  Why use noise? , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[61]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[62]  M. Landy,et al.  Optimal Compensation for Changes in Task-Relevant Movement Variability , 2005, The Journal of Neuroscience.

[63]  Gerald S. Rogers,et al.  Mathematical Statistics: A Decision Theoretic Approach , 1967 .

[64]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[65]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[66]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[67]  Pascal Mamassian,et al.  Interaction of visual prior constraints , 2001, Vision Research.

[68]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[69]  H. Ripoll,et al.  Effect of expertise on coincident-timing accuracy in a fast ball game. , 1997, Journal of sports sciences.

[70]  Daniel M Wolpert,et al.  Role of uncertainty in sensorimotor control. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[71]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[72]  S. Kitazawa,et al.  Reversal of subjective temporal order due to arm crossing , 2001, Nature Neuroscience.

[73]  Yanqing Chen,et al.  Long Memory Processes ( 1 / f α Type) in Human Coordination , 1997 .

[74]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.