We present a memory-based local modeling approach to robot learning using a nonparametric regression technique, locally weighted regression. The model of the task to be performed is represented by infinitely many local linear models, the (hyper-) tangent planes at every query point. This is in contrast to other methods using finite set of linear models to accomplish a piecewise linear model. Architectural parameters of our approach, such as distance metrics, are a function of the current query point instead of being global. Statistical tests are presented for when a local model is good enough such that it can be reliably used to build a local controller. These statistical measures also direct the exploration of the robot. We explicitly deal with the case where prediction accuracy requirements exist during exploration: by gradually shifting a center of exploration and controlling the speed of the shift with local prediction accuracy, a goal-directed exploration of state space takes place along the fringes of the current data support until the task goal is achieved. We illustrate this approach by describing how it has been used to enable a robot to learn a juggling task.<<ETX>>
[1]
G. Wahba,et al.
A completely automatic french curve: fitting spline functions by cross validation
,
1975
.
[2]
W. Cleveland.
Robust Locally Weighted Regression and Smoothing Scatterplots
,
1979
.
[3]
Michael F. Shlesinger,et al.
Dynamic patterns in complex systems
,
1988
.
[4]
David J. Reinkensmeyer,et al.
Task-level robot learning
,
1988,
Proceedings. 1988 IEEE International Conference on Robotics and Automation.
[5]
Richard S. Sutton,et al.
Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming
,
1990,
ML.
[6]
Andrew W. Moore,et al.
Fast, Robust Adaptive Control by Learning only Forward Models
,
1991,
NIPS.
[7]
Daniel E. Koditschek,et al.
Progress in spatial robot juggling
,
1992,
Proceedings 1992 IEEE International Conference on Robotics and Automation.
[8]
S. Schaal,et al.
Robot juggling: implementation of memory-based learning
,
1994,
IEEE Control Systems.