When are tasks "difficult" for learning controllers?

Some control task, formerly believed to be difficult and used to demonstrate neural network unsupervised learning, can be accomplished with very simple controllers. There seems to be no learning method that discovers these controllers. This failure could be attributed to the learning algorithm or to starting with overly complex controller structures. We suggest using the probability that randomly selected controller is successful as measure of learning difficulty. To limit the size of the space of possible controllers we use Fliess' classification of control problems into flat and non-flat. We illustrate the procedure on easy and difficult variants of the pendulum control task.<<ETX>>

[1]  Shlomo Geva,et al.  Valet Parking Neural Network , 1992, IEEE International Workshop on Emerging Technologies and Factory Automation,.

[2]  B. Widrow,et al.  The truck backer-upper: an example of self-learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[3]  M. Fliess,et al.  Sur les systèmes non linéaires différentiellement plats , 1992 .

[4]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Richard S. Sutton,et al.  The Truck Backer-Upper: An Example of Self-Learning in Neural Networks , 1995 .

[6]  J. Sitte,et al.  A cartpole experiment benchmark for trainable controllers , 1993, IEEE Control Systems.

[7]  Vijay K. Samalam,et al.  Exhaustive Learning , 1990, Neural Computation.

[8]  Philippe Martin,et al.  Flatness and motion planning : the car with n trailers. , 1992 .