Mimetic Communication Model with Compliant Physical Contact in Human—Humanoid Interaction

In this paper we aim at extending imitation learning to physical human—robot interaction (pHRI) including contact transitions (from non-contact to contact and vice versa). For interactive learning of pHRI, the paper raises four key issues: (1) motion imitation, (2) understanding motion primitives, (3) understanding interaction primitives, and (4) physical contact establishment. These issues are solved by (1) marker control, (2) mimesis model, (3) mimetic communication model, and (4) real-time motion reshaping and impedance control, respectively. The simple human motion imitation is realized by a direct marker control method in which the robot is virtually connected to the markers attached to the human via virtual springs. Learning procedures are based on ‘‘imitation of a human’’ and ‘‘active involvement’’ of the robot during the learning. The ‘‘imitation of a human’’ scheme provides efficient learning. The ‘‘active involvement’’ scheme supports incremental learning and it also enables to acquire sensory information for physical contacts. By modifying the mimetic communication model proposed by Nakamura et al., we achieve communication in physical domain as well as the symbolic domain. The communication in the symbolic domain is realized through the concept of motion primitives and interaction primitives. In the physical domain, the trajectory of the motion primitive is reshaped in accordance with the human’s motions in real-time. Moreover, for performing compliant contact motion, an appropriate impedance controller is integrated into the setting. All of the presented concepts are applied to ‘‘high five’’-like interaction tasks and evaluated in experiments with a human-size humanoid robot.

[1]  V. Arnold Mathematical Methods of Classical Mechanics , 1974 .

[2]  Paul Evrard,et al.  Learning collaborative manipulation tasks by demonstration using a haptic interface , 2009, ICAR.

[3]  Yoshihiko Nakamura,et al.  From Stochastic Motion Generation and Recognition to Geometric Symbol Development and Manipulation , 2003 .

[4]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[5]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[6]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[7]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[8]  Dana Kulic,et al.  Incremental on-line hierarchical clustering of whole body motion patterns , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[9]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[11]  Atsushi Nakazawa,et al.  Task model of lower body motion for a biped humanoid robot to imitate human dances , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Takanori Shibata,et al.  Emergence of emotional behavior through physical interaction between human and robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Rüdiger Dillmann,et al.  Teaching and learning of robot tasks via observation of human performance , 2004, Robotics Auton. Syst..

[14]  Katsu Yamane,et al.  Primitive communication based on motion recognition and generation with hierarchical mimesis model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[15]  Alin Albu-Schaffer,et al.  Soft robotics , 2008, IEEE Robotics Autom. Mag..

[16]  Christoph Borst,et al.  A Humanoid Two-Arm System for Dexterous Manipulation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[17]  Yoshihiko Nakamura,et al.  Association of whole body motion from tool knowledge for humanoid robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  M. Donald Origins of the modern mind , 1991 .

[19]  Aude Billard,et al.  Active Teaching in Robot Programming by Demonstration , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Tamim Asfour,et al.  Imitation Learning of Dual-Arm Manipulation Tasks in Humanoid Robots , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[21]  Oussama Khatib,et al.  A New Actuation Concept for Human-Friendly Robot Design , 2004 .

[22]  Minoru Asada,et al.  Learning of Joint Attention from Detecting Causality Based on Transfer Entropy , 2008, J. Robotics Mechatronics.

[23]  Dana Kulic,et al.  Representability of human motions by factorial hidden Markov models , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  John Kenneth Salisbury,et al.  Playing it safe [human-friendly robots] , 2004, IEEE Robotics & Automation Magazine.

[25]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[26]  Behzad Dariush,et al.  Whole body humanoid control from human motion descriptors , 2008, 2008 IEEE International Conference on Robotics and Automation.

[27]  Aude Billard,et al.  DRAMA, a Connectionist Architecture for Control and Learning in Autonomous Robots , 1999, Adapt. Behav..

[28]  Dana Kulic,et al.  Combining automated on-line segmentation and incremental clustering for whole body motions , 2008, 2008 IEEE International Conference on Robotics and Automation.

[29]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[30]  Katsu Yamane,et al.  Dynamics computation of structure-varying kinematic chains and its application to human figures , 2000, IEEE Trans. Robotics Autom..

[31]  Aude Billard,et al.  Grounding communication in autonomous robots: An experimental study , 1998, Robotics Auton. Syst..

[32]  Yoshihiko Nakamura,et al.  Mimesis Model from Partial Observations for a Humanoid Robot , 2010, Int. J. Robotics Res..

[33]  D. Harville Matrix Algebra From a Statistician's Perspective , 1998 .

[34]  C. Breazeal,et al.  Robots that imitate humans , 2002, Trends in Cognitive Sciences.

[35]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[36]  Robin R. Murphy,et al.  Human-Robot Interaction , 2012 .

[37]  Jun Tani,et al.  Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[38]  Yoshihiko Nakamura,et al.  Mimesis from partial observations , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[40]  Antonio Bicchi,et al.  Fast and "soft-arm" tactics [robot arm design] , 2004, IEEE Robotics & Automation Magazine.

[41]  Stefan Schaal,et al.  Reinforcement Learning for Humanoid Robotics , 2003 .

[42]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[43]  Katsu Yamane,et al.  Mimetic Communication Theory for Humanoid Robots Interacting with Humans , 2005, ISRR.

[44]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[45]  Aude Billard,et al.  A probabilistic Programming by Demonstration framework handling constraints in joint space and task space , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Dana Kulic,et al.  Missing motion data recovery using factorial hidden Markov models , 2008, 2008 IEEE International Conference on Robotics and Automation.

[47]  Alin Albu-Schäffer,et al.  DLR's torque-controlled light weight robot III-are we reaching the technological limits now? , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[48]  Minoru Asada,et al.  A constructive model for the development of joint attention , 2003, Connect. Sci..

[49]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[50]  Vincent De Sapio,et al.  Human Motion Reconstruction by Direct Control of Marker Trajectories , 2008 .

[51]  K. H. Hunt,et al.  Coefficient of Restitution Interpreted as Damping in Vibroimpact , 1975 .

[52]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[53]  Y. Nakamura,et al.  Unsupervised probabilistic segmentation of motion data for mimesis modeling , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[54]  Yoshihiko Nakamura,et al.  Associating and reshaping of whole body motions for object manipulation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[56]  Yoshihiko Nakamura,et al.  Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[57]  Jun Morimoto,et al.  CB: A Humanoid Research Platform for Exploring NeuroScience , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[58]  Masayuki Inaba,et al.  Motion planning for humanoid robots under obstacle and dynamic balance constraints , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[59]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[60]  David E. Orin,et al.  A compliant contact model with nonlinear damping for simulation of robotic systems , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[61]  Yoshihiko Nakamura,et al.  Mimetic communication with impedance control for physical human-robot interaction , 2009, 2009 IEEE International Conference on Robotics and Automation.

[62]  Pradeep K. Khosla,et al.  Predictive Robot Programming: Theoretical and Experimental Analysis , 2004, Int. J. Robotics Res..

[63]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[64]  Eiichi Yoshida,et al.  Integrating dynamics into motion planning for humanoid robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[65]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[66]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[67]  Aude Billard,et al.  Discriminative and adaptive imitation in uni-manual and bi-manual tasks , 2006, Robotics Auton. Syst..

[68]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[69]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[70]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .