Methods for Multiloop Identification of Visual and Neuromuscular Pilot Responses

In this paper, identification methods are proposed to estimate the neuromuscular and visual responses of a multiloop pilot model. A conventional and widely used technique for simultaneous identification of the neuromuscular and visual systems makes use of cross-spectral density estimates. This paper shows that this technique requires a specific noninterference hypothesis, often implicitly assumed, that may be difficult to meet during actual experimental designs. A mathematical justification of the necessity of the noninterference hypothesis is given. Furthermore, two methods are proposed that do not have the same limitations. The first method is based on autoregressive models with exogenous inputs, whereas the second one combines cross-spectral estimators with interpolation in the frequency domain. The two identification methods are validated by offline simulations and contrasted to the classic method. The results reveal that the classic method fails when the noninterference hypothesis is not fulfilled; on the contrary, the two proposed techniques give reliable estimates. Finally, the three identification methods are applied to experimental data from a closed-loop control task with pilots. The two proposed techniques give comparable estimates, different from those obtained by the classic method. The differences match those found with the simulations. Thus, the two identification methods provide a good alternative to the classic method and make it possible to simultaneously estimate human's neuromuscular and visual responses in cases where the classic method fails.

[1]  Frans C. T. van der Helm,et al.  Quantifying Proprioceptive Reflexes During Position Control of the Human Arm , 2008, IEEE Transactions on Biomedical Engineering.

[2]  Ronald A. Hess Pursuit Tracking and Higher Levels of Skill Development in the Human Pilot , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  J. Schoukens,et al.  Parametric identification of transfer functions in the frequency domain-a survey , 1994, IEEE Trans. Autom. Control..

[4]  Duane T. McRuer HUMAN PILOT DYNAMICS IN COMPENSATORY SYSTEMS , 1965 .

[5]  M. M. Paassen,et al.  Modeling Human Multimodal Perception and Control Using Genetic Maximum Likelihood Estimation , 2009 .

[6]  David A. Abbink,et al.  Direct and Indirect Haptic Aiding for Curve Negotiation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[7]  Matteo Corno,et al.  Road-Departure Prevention in an Emergency Obstacle Avoidance Situation , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  M. M. Van Paassen Biophysics in aircraft control: a model of the neuromuscular system of the pilot's arm , 1994 .

[9]  Frans C. T. van der Helm,et al.  Identification of intrinsic and reflexive components of human arm dynamics during postural control , 2002, Journal of Neuroscience Methods.

[10]  Mark Mulder,et al.  Measuring the Contribution of the Neuromuscular System during a Pitch Control Task , 2009 .

[11]  Frans C. T. van der Helm,et al.  Design of Perturbation Signals for the Estimation of Proprioceptive Reflexes , 2008, IEEE Transactions on Biomedical Engineering.

[12]  Ronald A. Hess Modeling the effects of display quality upon human pilot dynamics and perceived vehicle handling qualities , 1995, IEEE Trans. Syst. Man Cybern..

[13]  J. E. Veitengruber,et al.  Aircraft Alerting Systems Criteria Study. Volume II. Human Factors Guidelines for Aircraft Alerting Systems , 1977 .

[14]  Septimiu E. Salcudean,et al.  Application of force feedback to heavy duty hydraulic machines , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[15]  Joost Venrooij,et al.  A Method to Measure the Relationship Between Biodynamic Feedthrough and Neuromuscular Admittance , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Mark Mulder,et al.  Exploring the Dimensions of Haptic Feedback Support in Manual Control , 2009, J. Comput. Inf. Sci. Eng..

[17]  B. Hannaford,et al.  Force controlled and teleoperated endoscopic grasper for minimally invasive surgery-experimental performance evaluation , 1999, IEEE Transactions on Biomedical Engineering.

[18]  Frans C. T. van der Helm,et al.  A Framework for Biodynamic Feedthrough Analysis—Part I: Theoretical Foundations , 2014, IEEE Transactions on Cybernetics.

[19]  Max Mulder,et al.  Modeling Human Multichannel Perception and Control Using Linear Time-Invariant Models , 2008 .

[20]  D H Weir,et al.  Theory of manual vehicular control. , 1969, Ergonomics.

[21]  R. H. Cook An automatic stall prevention control for supersonic fighter aircraft , 1965 .

[22]  David A. Abbink,et al.  Reduced power method: how to evoke low-bandwidth behaviour while estimating fullbandwidth. , 2007 .

[23]  Frans C. T. van der Helm,et al.  Measuring Neuromuscular Control Dynamics During Car Following With Continuous Haptic Feedback , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Frans C. T. van der Helm,et al.  A New View on Biodynamic Feedthrough Analysis: Unifying the Effects on Forces and Positions , 2013, IEEE Transactions on Cybernetics.

[25]  Kenneth H. Goodrich,et al.  Haptic-Multimodal Flight Control System Update , 2011 .

[26]  David A. Abbink,et al.  Task Instruction: the largest Influence on Human Operator Motion Control Dynamics , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[27]  Max Mulder,et al.  Identification of Human Operator Control Behaviour in Multiple-Loop Tracking Tasks , 1998 .

[28]  T. Sattel,et al.  Combining haptic human-machine interaction with predictive path planning for lane-keeping and collision avoidance systems , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[29]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[30]  Heinrich H. Bülthoff,et al.  A comparison of Direct and Indirect Haptic Aiding for Remotely Piloted Vehicles , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[31]  Septimiu E. Salcudean,et al.  Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation , 2002, IEEE Trans. Robotics Autom..

[32]  René van Paassen,et al.  Haptic interface in UAV tele-operation using force-stiffness feedback , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[33]  M. M. van Paassen,et al.  Identification of the Feedback Component of the Neuromuscular System in a Pitch Control Task , 2010 .

[34]  M. M. van Paassen,et al.  Design and Evaluation of a Haptic Flight Director , 2006 .

[35]  René van Paassen,et al.  Design of a Haptic Gas Pedal for Active Car-Following Support , 2011, IEEE Transactions on Intelligent Transportation Systems.

[36]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[37]  David A. Abbink,et al.  Neuromuscular analysis of haptic gas pedal feedback during car following , 2006 .

[38]  Joost Venrooij,et al.  Multi-loop Pilot Behaviour Identication in Response to Simultaneous Visual and Haptic Stimuli , 2012 .

[39]  Rik Pintelon,et al.  System Identification: A Frequency Domain Approach , 2012 .

[40]  Duane T. McRuer,et al.  A Review of Quasi-Linear Pilot Models , 1967 .