Optimal Neural Codes for Control and Estimation

Agents acting in the natural world aim at selecting appropriate actions based on noisy and partial sensory observations. Many behaviors leading to decision making and action selection in a closed loop setting are naturally phrased within a control theoretic framework. Within the framework of optimal Control Theory, one is usually given a cost function which is minimized by selecting a control law based on the observations. While in standard control settings the sensors are assumed fixed, biological systems often gain from the extra flexibility of optimizing the sensors themselves. However, this sensory adaptation is geared towards control rather than perception, as is often assumed. In this work we show that sensory adaptation for control differs from sensory adaptation for perception, even for simple control setups. This implies, consistently with recent experimental results, that when studying sensory adaptation, it is essential to account for the task being performed.

[1]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[2]  Ron Meir,et al.  Error-Based Analysis of Optimal Tuning Functions Explains Phenomena Observed in Sensory Neurons , 2010, Front. Comput. Neurosci..

[3]  T. Milner,et al.  Functionally Specific Changes in Resting-State Sensorimotor Networks after Motor Learning , 2011, The Journal of Neuroscience.

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[6]  Alexey S. Matveev,et al.  Control and estimation under information constraints: Toward a unified theory of control, computation and communications , 2010 .

[7]  Emanuel Todorov,et al.  General duality between optimal control and estimation , 2008, 2008 47th IEEE Conference on Decision and Control.

[8]  Peter W Battaglia,et al.  Humans Trade Off Viewing Time and Movement Duration to Improve Visuomotor Accuracy in a Fast Reaching Task , 2007, The Journal of Neuroscience.

[9]  K. Åström Introduction to Stochastic Control Theory , 1970 .

[10]  Alex K. Susemihl,et al.  Dynamic state estimation based on Poisson spike trains—towards a theory of optimal encoding , 2012, 1209.5559.

[11]  Yaakov Bar-Shalom,et al.  An actively adaptive control for linear systems with random parameters via the dual control approach , 1972, CDC 1972.

[12]  Reza Shadmehr,et al.  On-Line Processing of Uncertain Information in Visuomotor Control , 2008, The Journal of Neuroscience.

[13]  Neri Merhav Optimum Estimation via Gradients of Partition Functions and Information Measures: A Statistical-Mechanical Perspective , 2011, IEEE Transactions on Information Theory.

[14]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[15]  C. Gilbert,et al.  Top-down influences on visual processing , 2013, Nature Reviews Neuroscience.

[16]  Andrew A G Mattar,et al.  Motor learning and its sensory effects: time course of perceptual change and its presence with gradual introduction of load. , 2013, Journal of neurophysiology.

[17]  R. Bucy Nonlinear filtering theory , 1965 .

[18]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[19]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[20]  Kenji Nakagawa,et al.  On the practical implication of mutual information for statistical decisionmaking , 1991, IEEE Trans. Inf. Theory.

[21]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .