Sensorimotor optimization in higher dimensions.

Most studies of neural control have looked at constrained tasks, with only a few degrees of freedom, but real sensorimotor systems are high dimensional--e.g. gaze-control systems that coordinate the head and two eyes have to work with 12 degrees of freedom in all. These extra degrees of freedom matter, because they bring with them new issues and questions, which make it hard to translate low-dimensional findings into theories of real neural control. Here I show that it is possible to predict high-dimensional behavior if we apply the optimization principles introduced by 19th-century neuroscientists like Helmholtz, Listing, and Wundt. Using three examples--the vestibulo-ocular reflex, saccadic eye movements, and depth vision--I show how simple optimization theories can predict complex, unexpected behaviors and reveal fundamental features of sensorimotor control, e.g. that neural circuits perform noncommutative algebra; that in rapid gaze shifts the eye controllers deliver commands with three degrees of freedom, not two; and that the eyes roll about their lines of sight in a way that may simplify stereopsis.

[1]  D Tweed,et al.  Optimizing gaze control in three dimensions. , 1998, Science.

[2]  Scott B. Stevenson,et al.  Human stereo matching is not restricted to epipolar lines , 1997, Vision Research.

[3]  Douglas Tweed.  Microcosms of the Brain: What Sensorimotor Systems Reveal about the Mind , 2003 .

[4]  B. Julesz.  Binocular depth perception of computer-generated patterns , 1960 .

[5]  Z. Kapoula,et al.  Listing’s plane rotation with convergence: role of disparity, accommodation, and depth perception , 1999, Experimental Brain Research.

[6]  J D Crawford,et al.  Neural control of rotational kinematics within realistic vestibuloocular coordinate systems. , 1998, Journal of neurophysiology.

[7]  L. Optican,et al.  Commutative saccadic generator is sufficient to control a 3-D ocular plant with pulleys. , 1998, Journal of neurophysiology.

[8]  T Vilis,et al.  Eye-head coordination during large gaze shifts. , 1995, Journal of neurophysiology.

[9]  Michael Fetter,et al.  Three-Dimensional Kinematics of Eye, Head and Limb Movements , 1997 .

[10]  J. Michael McCarthy,et al.  Introduction to theoretical kinematics , 1990 .

[11]  T Vilis,et al.  Axes of eye rotation and Listing's law during rotations of the head. , 1991, Journal of neurophysiology.

[12]  Douglas B. Tweed,et al.  Non-commutativity in the brain , 1999, Nature.

[13]  K. Hepp.  On Listing's law , 1990 .

[14]  J. Porrill,et al.  Stereopsis, vertical disparity and relief transformations , 1995, Vision Research.

[15]  A. V. D. Berg,et al.  Binocular eye orientation during fixations: Listing's law extended to include eye vergence , 1993, Vision Research.

[16]  M. J. Allen.  The dependence of cyclophoria on convergence, elevation and the system of axes. , 1954, American journal of optometry and archives of American Academy of Optometry.

[17]  A. Fuchs,et al.  Progress in oculomotor research : proceedings of the International Conference on Oculomotor Research held July 28-31, 1980 at the Schloss Reisenburg near Ulm, West Germany , 1981 .

[18]  T. Vilis,et al.  Rotation of Listing's plane during vergence , 1992, Vision Research.

[19]  J. A. Gisbergen,et al.  A three-dimensional analysis of vergence movements at various levels of elevation , 1994, Experimental Brain Research.

[20]  William Rowan Sir Hamilton.  Lectures on quaternions : containing a systematic statement of a new mathematical method : ... with numerous illustrative diagrams, and with some geometrical and physical applications , 1969 .

[21]  David Hestenes.  Invariant body kinematics: II. Reaching and neurogeometry , 1994, Neural Networks.

[22]  C. Schnabolk,et al.  Modeling three-dimensional velocity-to-position transformation in oculomotor control. , 1994, Journal of neurophysiology.

[23]  D. Tweed,et al.  Testing models of the oculomotor velocity-to-position transformation. , 1994, Journal of neurophysiology.

[24]  T. Vilis,et al.  Geometric relations of eye position and velocity vectors during saccades , 1990, Vision Research.

[25]  D. Tweed,et al.  Three-dimensional model of the human eye-head saccadic system. , 1997, Journal of neurophysiology.

[26]  H Misslisch,et al.  Torsional dynamics and cross-coupling in the human vestibulo-ocular reflex during active head rotation. , 2000, Journal of vestibular research : equilibrium & orientation.

[27]  D. Zee,et al.  Rotation of Listing's plane with convergence: independence from eye position. , 2000, Investigative ophthalmology & visual science.

[28]  Dora E Angelaki,et al.  Three-Dimensional Kinematics at the Level of the Oculomotor Plant , 2006, The Journal of Neuroscience.

[29]  G. Westheimer,et al.  Kinematics of the eye. , 1957, Journal of the Optical Society of America.

[30]  K Hepp,et al.  Two- rather than three-dimensional representation of saccades in monkey superior colliculus. , 1991, Science.

[31]  D. Straumann,et al.  Transient torsion during and after saccades , 1995, Vision Research.

[32]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[33]  A. V. van den Berg,et al.  Binocular eye orientation during fixations: Listing's law extended to include eye vergence. , 1993, Vision research.

[34]  A. J. Van Opstal,et al.  Three-dimensional analysis of strongly curved saccades elicited by double-step stimuli , 2004, Experimental Brain Research.

[35]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[36]  D. Guitton,et al.  Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. , 1987, Journal of neurophysiology.

[37]  D Tweed,et al.  Implications of rotational kinematics for the oculomotor system in three dimensions. , 1987, Journal of neurophysiology.

[38]  J. Douglas Crawford,et al.  The motor side of depth vision , 2001, Nature.

[39]  David Hestenes,et al.  Invariant body kinematics: I. Saccadic and compensatory eye movements , 1994, Neural Networks.

[40]  T Raphan,et al.  Modeling control of eye orientation in three dimensions. I. Role of muscle pulleys in determining saccadic trajectory. , 1998, Journal of neurophysiology.

[41]  D. Robinson,et al.  The vestibulo‐ocular reflex during human saccadic eye movements. , 1986, The Journal of physiology.

[42]  K. N. Ogle.  Researches in binocular vision. , 1950 .