Human operators and automatic adaptive controllers: A comparative study on a particular control task

Many schemes have been put forward for general-purpose learning machines capable of performing a variety of tasks, but little work has been done on direct comparison of the performance of these with the most adaptable of all controllers, the human operator. A suitable environment for such a comparison is described here, and experiments with several different adaptive controllers are reported. The most successful of the automatic adaptive controllers consists of a series of stochastic estimators, the outputs from which determine the probability that the controller will take a certain action for each region of the environment's statespace. The results show that human operators can achieve good control by estimating derivative information from a continuous display of the state of the environment, but are badly affected by random external disturbances. Even the best automatic controller considered can use only coarsely quantized input information, and so has poorer control, but it is relatively immune to external disturbances.

[1]  King-Sun Fu,et al.  Two-Dimensional Adaptive Model of a Human Controller Using Pattern Recognition Techniques , 1971, IEEE Trans. Syst. Man Cybern..

[2]  John H. Andreae,et al.  STELLA: A scheme for a learning machine , 1963 .

[3]  Kumpati S. Narendra,et al.  Use of Stochastic Automata for Parameter Self-Optimization with Multimodal Performance Criteria , 1969, IEEE Trans. Syst. Sci. Cybern..

[4]  R. Bellman A PROBLEM IN THE SEQUENTIAL DESIGN OF EXPERIMENTS , 1954 .

[5]  M. Norman On the linear model with two absorbing barriers , 1968 .

[6]  Ian H. Witten,et al.  Comments on "Use of Stochastic Automata for Parameter Self-Optimization with Multimodal Performance Criteria" , 1972, IEEE Trans. Syst. Man Cybern..

[7]  J. Sklansky,et al.  Learning systems for automatic control , 1966 .

[8]  Albert E. Preyss,et al.  Stochastic Modeling of Human Learning Behavior , 1968 .

[9]  Shunsuke Sato,et al.  Rea-Time Display System of Response Characteristics of Manual Tracking Systems , 1970 .

[10]  Brian R. Gaines,et al.  Stochastic Computing Systems , 1969 .

[11]  King-Sun Fu,et al.  Learning control systems--Review and outlook , 1970 .

[12]  John H. Andreae,et al.  A learning machine with monologue , 1969 .

[13]  Thomas M. Cover,et al.  The two-armed-bandit problem with time-invariant finite memory , 1970, IEEE Trans. Inf. Theory.

[14]  Noboru Sugie,et al.  A Model of Predictive Control in Visual Target Tracking , 1971, IEEE Trans. Syst. Man Cybern..

[15]  I. A. M. Hall,et al.  Study of the Human Pilot as a Servo-Element , 1963, The Journal of the Royal Aeronautical Society.

[16]  Duane T. McRuer,et al.  A Review of Quasi-Linear Pilot Models , 1967 .

[17]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.