Interactions within and between the spatial senses.

This paper reviews five types of interaction between sources of spatial information within and between sense organs; 1) nested, 2) opponent, 3) comparison, 4) covariation, and 5) multicue interactions. Efference copy is treated as a type of sensory input. Examples of each type of interaction are provided, with an emphasis on visual-vestibular interactions. In the first type of interaction, inputs from nested sensory systems are summed like vectors. For instance, the 3-D vector sum of inputs from the joints and muscle spindles of the arm allows one to judge the position of the hand. In the second type, inputs from opponent systems are combined to form a signed difference signal with respect to a norm. For instance, the push-pull linkage between the vestibular organs on the two sides of the head provides the signal for head rotation. The third type involves comparisons based on the detection of differences between stimuli presented to different regions of the same sense organ or to distinct sense organs. The fourth type involves the extraction of products or ratios between stimuli used in the detection of invariant high-level features. For instance, the linear size of an object can be derived from the constant product of the distance of the object and the size of its image. Similar systems are used to scale the response to one stimulus feature with respect to a second feature. For instance, vestibular inputs evoking eye nystagmus are scaled by viewing distance. Judgments based on all of the above mechanisms are relational, meaning that they require information from several sources. The fifth type involves multicue systems in which alternative cues are available for the same judgment. The cues are sometimes combined as a weighted mean. For instance, the direction of an object is derived from the mean position of the images in the two eyes, or a judgment of the rotation of the body may be based on combined inputs from the vestibular system and from visual motion. For distinct types of cue, averaging is less common than cue dominance, dissociation, or cue reinterpretation.

[1]  H. Wallach,et al.  Modification of stereoscopic depth-perception. , 1963, The American journal of psychology.

[2]  L A JEFFRESS,et al.  A place theory of sound localization. , 1948, Journal of comparative and physiological psychology.

[3]  Barry B. Lee,et al.  Horizontal Cells of the Primate Retina: Cone Specificity Without Spectral Opponency , 1996, Science.

[4]  M. Landy,et al.  A perturbation analysis of depth perception from combinations of texture and motion cues , 1993, Vision Research.

[5]  P. Dodwell,et al.  The Mickey Mouse theory of perception. , 1986 .

[6]  R H Schor,et al.  Response of vestibular neurons to head rotations in vertical planes. III. Response of vestibulocollic neurons to vestibular and neck stimulation. , 1990, Journal of neurophysiology.

[7]  C. Galletti,et al.  Gaze-dependent visual neurons in area V3A of monkey prestriate cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Carl Auerbach,et al.  A common auditory-visual space” Evidence for its reality , 1974 .

[9]  J F Soechting,et al.  A coordinate system for the synthesis of visual and kinesthetic information , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  S Saida,et al.  How is motion disparity integrated with binocular disparity in depth perception? , 1996, Perception & psychophysics.

[11]  A. Benson.  Interactions Between Semicircular Canals and Gravireceptors , 1970 .

[12]  F. A. Miles.  Binocular Vision and Stereopsis by Ian P. Howard and Brian J. Rogers, Oxford University Press, 1995. £90.00 (736 pages) ISBN 0 19 508476 4. , 1996, Trends in Neurosciences.

[13]  G. Barnes,et al.  Cervical and vestibular afferent control of oculomotor response in man. , 1979, Acta oto-laryngologica.

[14]  D. Regan,et al.  Evidence for a neural mechanism that encodes angles , 1996, Vision Research.

[15]  R Held,et al.  Adaptation to displaced vision: a change in the central control of sensorimotor coordination. , 1971, Journal of Experimental Psychology.

[16]  J. H. Kim,et al.  Observations on types of response to combinations of neck, vestibular, and muscle stretch signals. , 1969, Journal of neurophysiology.

[17]  F E Guedry,et al.  Antisomatogyral illusion. , 1977, Aviation, space, and environmental medicine.

[18]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[19]  J R Lackner,et al.  The guidance of saccadic eye movements to perceptually mislocalized visual an non-visual targets. , 1981, Aviation, space, and environmental medicine.

[20]  B. Craske,et al.  Modifying an underlying component of perceived arm length: adaptation of tactile location induced by spatial discordance. , 1984, Journal of experimental psychology. Human perception and performance.

[21]  A. Georgopoulos.  Higher order motor control. , 1991, Annual review of neuroscience.

[22]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[23]  Tadasu Oyama,et al.  Perceived size and perceived distance in stereoscopic vision and an analysis of their causal relations , 1974 .

[24]  J. Dichgans,et al.  Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control , 1978 .

[25]  H Shimazu,et al.  Inhibition of central vestibular neurons from the contralateral labyrinth and its mediating pathway. , 1966, Journal of neurophysiology.

[26]  B J Rogers,et al.  The Appearance of Surfaces Specified by Motion Parallax and Binocular Disparity , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[27]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[28]  D L Sparks,et al.  Spatial localization of saccade targets. II. Activity of superior colliculus neurons preceding compensatory saccades. , 1983, Journal of neurophysiology.

[29]  R. Blake,et al.  The interplay between stereopsis and structure from motion , 1991, Perception & psychophysics.

[30]  John C. Trueswell,et al.  Surface segmentation mechanisms and motion perception , 1993, Vision Research.

[31]  M. Turvey,et al.  The inertia tensor as a basis for the perception of limb orientation. , 1995, Journal of experimental psychology. Human perception and performance.

[32]  D. Robinson,et al.  Voluntary, non-visual control of the human vestibulo-ocular reflex. , 1976, Acta oto-laryngologica.

[33]  Ian P Howard,et al.  The Contribution of Motion, the Visual Frame, and Visual Polarity to Sensations of Body Tilt , 1994, Perception.

[34]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[35]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[36]  M J Steinbach,et al.  Spatial localization after strabismus surgery: evidence for inflow. , 1981, Science.

[37]  H. Galiana.  A new approach to understanding adaptive visual-vestibular interactions in the central nervous system. , 1986, Journal of neurophysiology.

[38]  John Baily.  Arm-body adaptation with passive arm movements , 1972 .

[39]  J. I.  The Design of Experiments , 1936, Nature.

[40]  C. F. Stromeyer,et al.  Form-Color Aftereffects in Human Vision , 1978 .

[41]  D. Snodderly,et al.  Organization of striate cortex of alert, trained monkeys (Macaca fascicularis): ongoing activity, stimulus selectivity, and widths of receptive field activating regions. , 1995, Journal of neurophysiology.

[42]  W Bles,et al.  Circular vection and human posture I. Does the proprioceptive system play a role? , 1977, Agressologie: revue internationale de physio-biologie et de pharmacologie appliquees aux effets de l'agression.

[43]  O. Pompeiano,et al.  Convergence and interaction of neck and macular vestibular inputs on vestibulospinal neurons. , 1981, Journal of neurophysiology.

[44]  Barbara G. Wickelgren,et al.  Superior Colliculus: Some Receptive Field Properties of Bimodally Responsive Cells , 1971, Science.

[45]  D H Warren,et al.  Spatial Localization under Conflict Conditions: Is There a Single Explanation? , 1979, Perception.

[46]  I. Howard,et al.  Relative shear disparities and the perception of surface inclination , 1994, Vision Research.

[47]  R. Fitzpatrick,et al.  Proprioceptive, visual and vestibular thresholds for the perception of sway during standing in humans. , 1994, The Journal of physiology.

[48]  J. Goldberg,et al.  Physiology of peripheral neurons innervating semicircular canals of the squirrel monkey. 3. Variations among units in their discharge properties. , 1971, Journal of neurophysiology.

[49]  A GRAYBIEL,et al.  VISUAL ILLUSIONS OF MOVEMENT. , 1965, Brain : a journal of neurology.

[50]  Barbara Anne Dosher,et al.  Depth from motion , 1995 .

[51]  Irvin Rock,et al.  Adaptation to contradictory information from vision and touch , 1965 .

[52]  I P Howard,et al.  Recognition and Knowledge of the Water-Level Principle , 1978, Perception.

[53]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[54]  J. Wersäll,et al.  A Functional Interpretation of the Electron-Microscopic Structure of the Sensory Hairs in the Cristæ of the Elasmobranch Raja clavata in Terms of Directional Sensitivity , 1959, Nature.

[55]  R. Held,et al.  Visually Guided Reaching in Infant Monkeys after Restricted Rearing , 1967, Science.

[56]  Hans Wallach,et al.  Familiar size and linear perspective as distance cues in stereoscopic depth constancy , 1980 .

[57]  J F Soechting,et al.  Moving in three-dimensional space: frames of reference, vectors, and coordinate systems. , 1992, Annual review of neuroscience.

[58]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[59]  G E Loeb,et al.  The computation of position sense from spindles in mono- and multiarticular muscles , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  E. Vaadia,et al.  Unit study of monkey frontal cortex: active localization of auditory and of visual stimuli. , 1986, Journal of neurophysiology.

[61]  J. Groen,et al.  The problems of the spinning top applied to the semi-circular canals. , 1961, Confinia Neurologica.

[62]  Peter Werkhoven,et al.  Cross-modal slant and curvature matching of stereo- and motion-induced surfaces , 1995, Perception & psychophysics.

[63]  B. Rogers,et al.  Similarities between motion parallax and stereopsis in human depth perception , 1982, Vision Research.

[64]  G. Stampacchia,et al.  Convergence and interaction of neck and macular vestibular inputs on reticulospinal neurons , 1984, Neuroscience.

[65]  Peter Gregor,et al.  Binocular single vision achieved by fusion and suppression , 1977 .

[66]  H. Pick,et al.  Adaptation to Chromatic Aberration by the Human Visual System , 1963, Science.

[67]  P. Bertelson,et al.  Cross-modal bias and perceptual fusion with auditory-visual spatial discordance , 1981, Perception & psychophysics.

[68]  G. Barnes,et al.  Vestibular control of oculomotor and postural mechanisms , 1980 .

[69]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[70]  P. Matthews.  Proprioceptors and their contribution to somatosensory mapping: complex messages require complex processing. , 1988, Canadian journal of physiology and pharmacology.

[71]  R. Andersen,et al.  The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. , 1988, Canadian journal of physiology and pharmacology.

[72]  J. D. Watson,et al.  Effects of externally imposed elastic loads on the ability to estimate position and force , 1984, Behavioural Brain Research.

[73]  D. Regan,et al.  Cyclopean motion perception produced by Oscillations of size, disparity and location , 1996, Vision Research.

[74]  H. B. Barlow,et al.  Visual illusion from running , 1996, Nature.

[75]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[76]  W Freedman,et al.  Cervico-ocular reflex in the normal adult. , 1980, Acta oto-laryngologica.

[77]  W. M. King,et al.  Changes in vestibulo-ocular reflex (VOR) anticipate changes in vergence angle in monkey , 1992, Vision Research.

[78]  D L Sparks,et al.  Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals. , 1987, Journal of neurophysiology.

[79]  I P Howard,et al.  Muscular and joint-receptor components in postural persistence. , 1974, Journal of experimental psychology.

[80]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of curved lines. , 1933 .

[81]  E Bizzi,et al.  The role of vestibular and neck afferents during eye-head coordination in the monkey. , 1974, Brain research.

[82]  O. Grüsser,et al.  Vestibular neurones in the parieto‐insular cortex of monkeys (Macaca fascicularis): visual and neck receptor responses. , 1990, The Journal of physiology.

[83]  S M Ebenholtz,et al.  Does perceptual adaptation to telestereoscopically enhanced depth depend on the recalibration of binocular disparity? , 1986, Perception & psychophysics.

[84]  W. Rymer,et al.  Joint position sense: the effects of muscle contraction. , 1980, Brain : a journal of neurology.

[85]  Josée Rivest,et al.  Localizing contours defined by more than one attribute , 1996, Vision Research.

[86]  D Tweed,et al.  Implications of rotational kinematics for the oculomotor system in three dimensions. , 1987, Journal of neurophysiology.

[87]  B. Stein,et al.  Spatial determinants of multisensory integration in cat superior colliculus neurons. , 1996, Journal of neurophysiology.

[88]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[89]  D'arcy W. Thompson,et al.  On Growth and Form , 1917, Nature.

[90]  D. Robinson,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. , 1981, Journal of neurophysiology.

[91]  W. V. Bergeijk,et al.  Variation on a Theme of Békésy: A Model of Binaural Interaction , 1962 .

[92]  J. Cutting,et al.  Minimodularity and the perception of layout. , 1988, Journal of experimental psychology. General.

[93]  M. Kawato,et al.  Internal representations of the motor apparatus: implications from generalization in visuomotor learning. , 1995, Journal of experimental psychology. Human perception and performance.

[94]  Gerard G. Harris,et al.  Binaural Interactions of Impulsive Stimuli and Pure Tones , 1959 .

[95]  J F Soechting,et al.  Sensorimotor transformations underlying the organization of arm movements in three-dimensional space. , 1988, Canadian journal of physiology and pharmacology.

[96]  J. T. Enright,et al.  The non-visual impact of eye orientation on eye—hand coordination , 1995, Vision Research.

[97]  R. C. Oldfield.  THE PERCEPTION OF CAUSALITY , 1963 .

[98]  B. Craske,et al.  Adaptive Changes of opposite Sign in the Oculomotor Systems of the Two Eyes , 1974, The Quarterly journal of experimental psychology.

[99]  F. Thorn,et al.  Compensatory eye movements during active head rotation for near targets: effects of imagination, rapid head oscillation and vergence , 1987, Vision Research.

[100]  G. Barnes,et al.  Vision during angular oscillation: the dynamic interaction of visual and vestibular mechanisms. , 1978, Aviation, space, and environmental medicine.

[101]  E. Fluur,et al.  Vestibular compensation after labyrinthine destruction. , 1960, Acta oto-laryngologica.

[102]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[103]  G WESTHEIMER,et al.  Factors influencing accommodation responses of the human eye. , 1959, Journal of the Optical Society of America.

[104]  A. Hein,et al.  Neck muscle vibration modifies the representation of visual motion and direction in man. , 1988, Brain : a journal of neurology.

[105]  Y Trotter,et al.  Role of extraocular muscle proprioception in the development of depth perception in cats. , 1987, Journal of neurophysiology.

[106]  FRANK MORRELL,et al.  Visual System's View of Acoustic Space , 1972, Nature.

[107]  Dennis M. Levi,et al.  Angle judgment: Is the whole the sum of its parts? , 1996, Vision Research.

[108]  V. Mountcastle,et al.  Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. , 1975, Journal of neurophysiology.

[109]  Karlen Lyons-Ruth,et al.  Bimodal Perception in Infancy: Response to Auditory-Visual Incongruity. , 1977 .

[110]  J. D. Hood,et al.  The cervico-ocular reflex in normal subjects and patients with absent vestibular function , 1986, Brain Research.

[111]  T Vilis,et al.  A reexamination of the gain of the vestibuloocular reflex. , 1986, Journal of neurophysiology.

[112]  F A Miles,et al.  Long-term adaptive changes in primate vestibuloocular reflex. I. Behavioral observations. , 1980, Journal of neurophysiology.

[113]  I P Howard,et al.  Perceptual learning and adaptation. , 1971, British medical bulletin.

[114]  P T de Jong,et al.  Ataxia and nystagmus induced by injection of local anesthetics in the neck , 1977, Annals of neurology.

[115]  D. Massaro.  Ambiguity in perception and experimentation. , 1988, Journal of experimental psychology. General.

[116]  H. Mittelstaedt.  The subjective vertical as a function of visual and extraretinal cues. , 1986, Acta psychologica.

[117]  W. Levelt,et al.  BINOCULAR BRIGHTNESS AVERAGING AND CONTOUR INFORMATION. , 1965, British journal of psychology.

[118]  B Craske,et al.  Perception of impossible limb positions induced by tendon vibration. , 1977, Science.

[119]  Gordon E. Legge,et al.  The binocular computation of visual direction , 1996, Vision Research.

[120]  J. Hyvärinen,et al.  Function of the parietal associative area 7 as revealed from cellular discharges in alert monkeys. , 1974, Brain : a journal of neurology.

[121]  E. Holst.  Relations between the central Nervous System and the peripheral organs , 1954 .

[122]  R. Andersen,et al.  Head position signals used by parietal neurons to encode locations of visual stimuli , 1995, Nature.

[123]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[124]  C. R. Fox,et al.  Visually perceived eye level and perceived elevation of objects: Linearly additive influences from visual field pitch and from gravity , 1989, Vision Research.

[125]  Esther P. Gardner,et al.  Multiple-joint neurons in somatosensory cortex of awake monkeys , 1981, Brain Research.

[126]  W. R. Garner.  The Processing of Information and Structure , 1974 .

[127]  H. Pick,et al.  Intersensory Perception and Sensory Integration , 1981 .

[128]  L. Nashner,et al.  Influence of head position and proprioceptive cues on short latency postural reflexes evoked by galvanic stimulation of the human labyrinth. , 1974, Brain research.

[129]  C. Prablanc,et al.  Vectorial coding of movement: vision, proprioception, or both? , 1995, Journal of neurophysiology.

[130]  D. Regan,et al.  Dissociation of discrimination thresholds for time to contact and for rate of angular expansion , 1993, Vision Research.

[131]  C. L. Morgan.  Constancy of egocentric visual direction , 1978, Perception & psychophysics.

[132]  Alan Hein,et al.  Contribution of Eye Movement to the Representation of Space , 1983 .

[133]  B W Peterson,et al.  Cervicocollic reflex: its dynamic properties and interaction with vestibular reflexes. , 1985, Journal of neurophysiology.

[134]  R. Tomlinson,et al.  Analysis of human vestibulo-ocular reflex during active head movements. , 1980, Acta oto-laryngologica.

[135]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[136]  R. Held,et al.  Adaptation of Disarranged Hand-Eye Coordination Contingent upon Re-Afferent Stimulation , 1958 .

[137]  Ian P. Howard,et al.  Human visual orientation , 1982 .

[138]  Ian P. Howard,et al.  An Investigation of a Satiation Process in the Reversible Perspective of Revolving Skeletal Shapes , 1961 .

[139]  A Gonshor,et al.  Proceedings: Changes of human vestibulo-ocular response induced by vision-reversal during head rotation. , 1973, Journal of Physiology.

[140]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[141]  J R Flanagan,et al.  Trajectory adaptation to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. , 1995, Journal of neurophysiology.

[142]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[143]  C. S. Harris.  Perceptual adaptation to inverted, reversed, and displaced vision. , 1965, Psychological review.

[144]  E P Gardner,et al.  Somatosensory cortical mechanisms of feature detection in tactile and kinesthetic discrimination. , 1988, Canadian journal of physiology and pharmacology.

[145]  S. S. Stevens.  Cross-modality validation of subjective scales for loudness, vibration, and electric shock. , 1959, Journal of experimental psychology.

[146]  J E Zacher,et al.  Post-rotatory nystagmus and turning sensations after active and passive turning. , 1998, Journal of vestibular research : equilibrium & orientation.

[147]  Kenneth N. Ogle,et al.  INDUCED SIZE EFFECT: I. A NEW PHENOMENON IN BINOCULAR SPACE PERCEPTION ASSOCIATED WITH THE RELATIVE SIZES OF THE IMAGES OF THE TWO EYES , 1938 .