Human control strategy: abstraction, verification, and replication

In this article, we describe and develop methodologies for modeling and transferring human control strategy. This research has potential application in a variety of areas such as the intelligent vehicle highway system, human-machine interfacing, real-time training, space telerobotics, and agile manufacturing. We specifically address the following issues: (1) how to efficiently model human control strategy through learning cascade neural networks, (2) how to select state inputs in order to generate reliable models, (3) how to validate the computed models through an independent, hidden Markov model-based procedure, and (4) how to effectively transfer human control strategy. We have implemented this approach experimentally in the real-time control of a human driving simulator, and are working to transfer these methodologies for the control of an autonomous vehicle and a mobile robot. In providing a framework for abstracting computational models of human skill, we expect to facilitate analysis of human control, the development of human-like intelligent machines, improved human-robot coordination, and the transfer of skill from one human to another.

[1]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[2]  A. Kundu,et al.  Transient sonar signal classification using hidden Markov models and neural nets , 1994 .

[3]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[4]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[5]  Vera Kurková,et al.  Kolmogorov's theorem and multilayer neural networks , 1992, Neural Networks.

[6]  Yangsheng Xu,et al.  Gesture interface: modeling and learning , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  L. R. Rabiner,et al.  Some properties of continuous hidden Markov model representations , 1985, AT&T Technical Journal.

[8]  Marco Saerens,et al.  Classification of temporal trajectories by continuous-time recurrent nets , 1994, Neural Networks.

[9]  Sharad Singhal,et al.  Training Multilayer Perceptrons with the Extende Kalman Algorithm , 1988, NIPS.

[10]  Mingui Sun,et al.  Measurement of signal similarity using the maxima of the wavelet transform , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  S. Chatterjee,et al.  Similarity measures for image databases , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[12]  E. Fix,et al.  Modeling human performance with neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[13]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[14]  Sukhan Lee,et al.  Skill learning from observations , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[15]  Daphna Weinshall,et al.  Distance Metric Between 3D Models and 2D Images for Recognition and Classification , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  A. Guez,et al.  A trainable neuromorphic controller , 1988 .

[17]  Haim J. Wolfson,et al.  On shape similarity , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[18]  Scott E. Fahlman,et al.  An empirical study of learning speed in back-propagation networks , 1988 .

[19]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[20]  Duc Truong Pham,et al.  Adaptive control of dynamic systems using neural networks , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[21]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[22]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[23]  L. R. Rabiner,et al.  Recognition of isolated digits using hidden Markov models with continuous mixture densities , 1985, AT&T Technical Journal.

[24]  Jie Yang,et al.  Towards human-robot coordination: skill modeling and transferring via hidden Markov model , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[25]  Sheng Liu,et al.  Transfer of human skills to neural net robot controllers , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[26]  Kan Chen,et al.  An overview of intelligent vehicle-highway systems (IVHS) activities in North America , 1990, Proceedings of the 5th Jerusalem Conference on Information Technology, 1990. 'Next Decade in Information Technology'.

[27]  Martial Hebert,et al.  On 3D shape similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[29]  Jenq-Neng Hwang,et al.  A Comparison of Projection Pursuit and Neural Network Regression Modeling , 1991, NIPS.

[30]  Wayne L. Shebilske,et al.  Video Games, Training, and Investigating Complex Skills , 1992 .

[31]  Michael C. Nechyba,et al.  Towards Human Control Strategy Learning: Neural Network Approach With Variable Activation Functions. , 1995 .

[32]  Michael Werman,et al.  Similarity and Affine Invariant Distances Between 2D Point Sets , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Kumpati S. Narendra,et al.  Adaptive identification and control of dynamical systems using neural networks , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[34]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/Torque Information in Telemanipulation , 1991, Int. J. Robotics Res..

[35]  H. Hatwal,et al.  Some Inverse Solutions to an Automobile Path-Tracking Problem with Input Control of Steering and Brakes , 1986 .

[36]  W.C. Collier,et al.  Smart cars, smart highways , 1994, IEEE Spectrum.

[37]  Yangsheng Xu,et al.  Neural network approach to control system identification with variable activation functions , 1994, Proceedings of 1994 9th IEEE International Symposium on Intelligent Control.

[38]  Pierre Baldi,et al.  Smooth On-Line Learning Algorithms for Hidden Markov Models , 1994, Neural Computation.

[39]  Chuen-Chien Lee,et al.  Fuzzy logic in control systems: fuzzy logic controller. II , 1990, IEEE Trans. Syst. Man Cybern..

[40]  R D Ervin,et al.  WORLDWIDE IVHS ACTIVITIES: A COMPARATIVE OVERVIEW , 1992 .

[41]  M. Boninsegna,et al.  Similarity measures in computer vision , 1994, Pattern Recognit. Lett..

[42]  Daniel Gopher,et al.  The Transfer of Skill from a Computer Game Trainer to Actual Flight , 1992 .

[43]  Yangsheng Xu,et al.  Stochastic similarity for validating human control strategy models , 1998, IEEE Trans. Robotics Autom..

[44]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[45]  Lee A. Feldkamp,et al.  Decoupled extended Kalman filter training of feedforward layered networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[46]  John B. Moore,et al.  On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure , 1993, IEEE Trans. Signal Process..

[47]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[48]  Yangsheng Xu,et al.  Human skill transfer: neural networks as learners and teachers , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[49]  Yangsheng Xu,et al.  On the fidelity of human skill models , 1996, Proceedings of IEEE International Conference on Robotics and Automation.