Modeling Human Control of Self-Motion Direction With Optic Flow and Vestibular Motion

In this paper, we investigate the effects of visual and motion stimuli on the manual control of one's direction of self-motion. In a flight simulator, subjects conducted an active target-following disturbance-rejection task, using a compensatory display. Simulating a vehicular control task, the direction of vehicular motion was shown on the outside visual display in two ways: an explicit presentation using a symbol and an implicit presentation, namely, through the focus of radial outflow that emerges from optic flow. In addition, the effects of the relative strength of congruent vestibular motion cues were investigated. The dynamic properties of human visual and vestibular motion perception paths were modeled using a control-theoretical approach. As expected, improved tracking performance was found for the configurations that explicitly showed the direction of self-motion. The human visual time delay increased with approximately 150 ms for the optic flow conditions, relative to explicit presentations. Vestibular motion, providing higher order information on the direction of self-motion, allowed subjects to partially compensate for this visual perception delay, improving performance. Parameter estimates of the operator control model show that, with vestibular motion, the visual feedback becomes stronger, indicating that operators are more confident to act on optic flow information when congruent vestibular motion cues are present.

[1]  Max Mulder,et al.  Modeling Human Multichannel Perception and Control Using Linear Time-Invariant Models , 2008 .

[2]  B. Dyre,et al.  Active Control vs. Passive Perception of Heading: Evidence for Different Perceptual Mechanisms , 1996 .

[3]  Jing Chen,et al.  Influence of optic-flow information beyond the velocity field on the active control of heading. , 2011, Journal of vision.

[4]  R. Warren.  The perception of egomotion. , 1976, Journal of experimental psychology. Human perception and performance.

[5]  J M Loomis,et al.  Visual Control of Steering without Course Information , 1996, Perception.

[6]  Max Mulder,et al.  Identification of Human Operator Control Behaviour in Multiple-Loop Tracking Tasks , 1998 .

[7]  Duane T. McRuer,et al.  A Review of Quasi-Linear Pilot Models , 1967 .

[8]  Tarak Gandhi,et al.  Vehicle Surround Capture: Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps , 2006, IEEE Transactions on Intelligent Transportation Systems.

[9]  Laurence R. Harris,et al.  Vestibular cues and virtual environments: choosing the magnitude of the vestibular cue , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[10]  Arthur J. Grunwald,et al.  Effectiveness of Basic Display Augmentation in Vehicular Control by Visual Field Cues , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  A. V. van den Berg,et al.  Visual search of heading direction , 1999, Experimental Brain Research.

[12]  Max Mulder,et al.  Using the SIMONA Research Simulator for Human-machine Interaction Research , 2003 .

[13]  Michael A. Goodrich,et al.  Model-based human-centered task automation: a case study in ACC system design , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[14]  A. M. Junker,et al.  Roll tracking effects of G-vector tilt and various types of motion washout , 1978 .

[15]  A. K. Caglayan,et al.  A model for visual flow-field cueing and self-motion estimation , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  M. M. van Paassen,et al.  Modelling Human Visual Perception and Control of the Direction of Self-Motion , 2005 .

[17]  Arthur J. Grunwald,et al.  Vehicular Control by Visual Field Cues-analytical Model and Experimental Validation , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  R. Hetherington.  The Perception of the Visual World , 1952 .

[19]  D H Owen,et al.  The utility of motion parallax information for the perception and control of heading. , 1999, Journal of experimental psychology. Human perception and performance.

[20]  J. Koenderink.  Optic flow , 1986, Vision Research.

[21]  J. V. D. Vaart,et al.  Modelling of perception and action in compensatory manual control tasks , 1992 .

[22]  Richard M Wilkie,et al.  The role of visual and nonvisual information in the control of locomotion. , 2005, Journal of experimental psychology. Human perception and performance.

[23]  Brian P. Dyre,et al.  Image velocity magnitudes and perception of heading. , 1997, Journal of experimental psychology. Human perception and performance.

[24]  Max Mulder,et al.  Measuring the Performance of the SIMONA Research Simulator's Motion System , 2005 .

[25]  M. M. van Paassen,et al.  Perception of Visual and Motion Cues During Control of Self-Motion in Optic Flow Environments , 2006 .

[26]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[27]  James B. Robertson,et al.  Experimental Evaluation of a Perspective Tunnel Display for Three-Dimensional Helicopter Approaches , 1981 .

[28]  A. V. van den Berg,et al.  Judgements of Heading , 1996, Vision Research.

[29]  R Hosman,et al.  Pilot's perception in the control of aircraft motions. , 1998, Control engineering practice.

[30]  J E Cutting,et al.  Heading and path information from retinal flow in naturalistic environments , 1997, Perception & psychophysics.

[31]  F R Alex,et al.  Experiments and a model for pilot dynamics with visual and motion inputs. NASA CR-1325. , 1969, NASA contractor report. NASA CR. United States. National Aeronautics and Space Administration.

[32]  Michael F. Land.  Does Steering a Car Involve Perception of the Velocity Flow Field , 2001 .

[33]  Max Mulder,et al.  Multimodal Pilot Control Behavior in Combined Target-Following Disturbance-Rejection Tasks , 2009 .

[34]  L. Harris,et al.  Visual and non-visual cues in the perception of linear self motion , 2000, Experimental Brain Research.

[35]  Duane T. McRuer,et al.  A Neuromuscular Actuation System Model , 1968 .

[36]  S. Kohn,et al.  Visual Field Information in Low-Altitude Visual Flight by Line-of-Sight Slaved Helmet-Mounted Displays , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[37]  D A Gordon,et al.  PERCEPTUAL BASIS OF VEHICLE GUIDANCE , 1966 .

[38]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[39]  Max Mulder,et al.  Measuring Time Delays in Simulator Displays , 2007 .

[40]  Ronald A. Hess.  Pursuit Tracking and Higher Levels of Skill Development in the Human Pilot , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  J. Goldberg,et al.  Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. III. Response dynamics. , 1976, Journal of neurophysiology.

[42]  Vasilis Z. Marmarelis,et al.  Modeling of task-dependent characteristics of human operator dynamics pursuit manual tracking , 1988, IEEE Trans. Syst. Man Cybern..

[43]  Ajit Singh,et al.  Optic flow computation : a unified perspective , 1991 .

[44]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[45]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[46]  Fred H. Previc,et al.  Spatial Disorientation in Aviation , 2004 .

[47]  Maarten Steinbuch,et al.  Frequency domain identification of dynamic friction model parameters , 2002, IEEE Trans. Control. Syst. Technol..

[48]  R.J.A.W. Hosman,et al.  Pilot's Perception and Control of Aircraft Motions , 1998 .

[49]  Jing Chen,et al.  Relative contributions of optic flow, bearing, and splay angle information to lane keeping. , 2010, Journal of Vision.

[50]  Michael A. Goodrich.  Model-based human-centered task automation : a case study in ACC design , 2003 .

[51]  Jennifer L. Campos,et al.  Bayesian integration of visual and vestibular signals for heading. , 2009, Journal of vision.

[52]  Laurence R. Harris,et al.  Vestibular cues and virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[53]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[54]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.