Generalising human demonstration data by identifying affordance symmetries in object interaction trajectories

This paper concerns modelling human hand or tool trajectories when interacting with everyday objects. In these interactions symmetries may be exhibited in portions of the trajectories which can be used to identify task space redundancy. This paper presents a formal description of a set of these symmetries, which we term affordance symmetries, and a method to identify them in multiple demonstration recordings. The approach is robust to arbitrary motion before and after the symmetry artifact and relies only on recorded trajectory data. To illustrate the method's performance two examples are discussed involving two different types of symmetries. An simple illustration of the application of the concept in reproduction planning is also provided.

[1]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[2]  S. Schaal.  Movement Planning and Imitation by Shaping Nonlinear Attractors , 2003 .

[3]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[4]  Rüdiger Dillmann,et al.  Representation and constrained planning of manipulation strategies in the context of Programming by Demonstration , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Gert Kootstra,et al.  Paying Attention to Symmetry , 2008, BMVC.

[6]  Sethu Vijayakumar,et al.  Synthesising Novel Movements through Latent Space Modulation of Scalable Control Policies , 2008, SAB.

[7]  Oliver Brock,et al.  Interactive Perception of Articulated Objects , 2010, ISER.

[8]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Pierre-Yves Oudeyer,et al.  Incremental local online Gaussian Mixture Regression for imitation learning of multiple tasks , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  K. Grammer,et al.  Human (Homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. , 1994, Journal of comparative psychology.

[11]  C. Tyler.  1 The Human Expression of Symmetry : Art and Neuroscience , 2004 .

[12]  A. Fagg,et al.  Learning Grasp Affordances Through Human Demonstration , 2008 .

[13]  Wolfram Burgard,et al.  Vision-based detection for learning articulation models of cabinet doors and drawers in household environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Wolfram Burgard,et al.  Imitation learning with generalized task descriptions , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  Imoleayo Abel,et al.  Hierarchical Attentive Multiple Models for Execution and Recognition of Actions through Training Inverse and Forward Models Explorationally , 2012 .