Transfer of control skill by machine learning

Abstract Controlling complex dynamic systems requires skills that operators often cannot completely describe, but can demonstrate. This paper is concerned with the problem of transferring human control skill to an automatic controller. The process of reconstructing a skill from an operator's behavioural traces by means of machine learning (ML) techniques is called “behavioural cloning”. The paper gives a review of ML techniques applied to behavioural cloning, a number of representative experiments, and an assessment of the results. Some recent work is discussed, including a way of combining skill from several operators.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Claude Sammut,et al.  Learning to Fly , 1992, ML.

[3]  J. Ross Quinlan,et al.  Combining Instance-Based and Model-Based Learning , 1993, ICML.

[4]  Ivan Bratko,et al.  Reconstructing Human Skill with Machine Learning , 1994, ECAI.

[5]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[6]  Tanja Urbancic,et al.  Genetic algorithms in controller design and tuning , 1993, IEEE Trans. Syst. Man Cybern..

[7]  R. D. Parslow,et al.  Computer Graphics:Techniques and Applications , 1969 .

[8]  Saso Dzeroski,et al.  Inductive Logic Programming: Techniques and Applications , 1993 .

[9]  Stephen Muggleton,et al.  Machine intelligence and inductive learning , 1994 .

[10]  A. Makarovic A qualitative way of solving the pole balancing problem , 1991 .

[11]  Donald Michie,et al.  Cognitive models from subcognitive skills , 1990 .

[12]  Aram Karalic,et al.  Employing Linear Regression in Regression Tree Leaves , 1992, ECAI.

[13]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Donald Michie,et al.  Knowledge, Learning and Machine Intelligence , 1993 .

[15]  Rui Camacho,et al.  Building symbolic representations of intuitive real-time skills from performance data , 1994, Machine Intelligence 13.

[16]  Ivan Bratko,et al.  Behavioural Cloning: Phenomena, Results and Problems , 1995 .

[17]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..