A Framework for Learning from Observation Using Primitives

This paper describes a method to learn task primitives from observation. A framework has been developed that allows an agent to use observed data to initially learn a predefined set of task primitives and the conditions under which they are used. A method is also included for the agent to increase its performance while operating in the environment. Data that is collected while a human performs a task is parsed into small parts of the task called primitives. Modules are created for each primitive that encode the movements required during the performance of the primitive, and when and where the primitives are performed.

[1]  Stefan Schaal,et al.  Statistical Learning for Humanoid Robots , 2002, Auton. Robots.

[2]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[3]  Mark W. Spong,et al.  Control of Planar Rigid Body Sliding with Impacts and Friction , 2000, Int. J. Robotics Res..

[4]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[5]  Jun Morimoto,et al.  Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories , 1998, ICONIP.

[6]  Christopher G. Atkeson,et al.  Learning from observation using primitives , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[8]  Darrin C. Bentivegna,et al.  Learning from Observation and Practice at the Action Generation Level , 2003 .

[9]  Maja J. Matarić,et al.  Behavior-based primitives for articulated control , 1998 .

[10]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[11]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[12]  Christopher G. Atkeson,et al.  Using Primitives in Learning From Observation , 2000 .

[13]  Pattie Maes,et al.  Postural primitives: Interactive Behavior for a Humanoid Robot Arm , 1996 .

[14]  Peter Bakker,et al.  Robot see, robot do: An overview of robot imitation , 1996 .

[15]  Ales Ude,et al.  Integration of Symbolic and Subsymbolic Learning to Support Robot Programming by Human Demonstration , 1996 .

[16]  Takashi Suehiro,et al.  Designing Skills with Visual Feedback for APO , 1996 .

[17]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[18]  Gordon Cheng,et al.  Learning to select primitives and generate sub-goals from practice , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[19]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[20]  Shimon Edelman,et al.  Learning visually guided grasping: a test case in sensorimotor learning , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[21]  W. Shebilske,et al.  Motor Learning and Control , 1993 .

[22]  Gordon Cheng,et al.  Humanoid robot learning and game playing using PC-based vision , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  P. Ribeaux,et al.  Learning and Skill Acquisition , 1978 .

[24]  R. Magill.  Motor Learning And Control , 1980 .

[25]  L.-J. Lin,et al.  Hierarchical learning of robot skills by reinforcement , 1993, IEEE International Conference on Neural Networks.

[26]  Stefan Schaal,et al.  Learning tasks from a single demonstration , 1997, Proceedings of International Conference on Robotics and Automation.