A Low-Cost Humanoid Robot with Human Gestures Imitation Capabilities

Sales of entertainment robots are primed to explode in the next few years. Gesture imitation from a human operator demonstration is considered a promising technique that allows unexperienced users to easily interact with a robotic platform. In this paper a Programming by Demonstration system for a humanoid robot is proposed. The robot is a Robosapien V2 toy which is programmed to observe and imitate human gestures. The system combines inputs from multiple sensory devices, including a dataglove, a motion tracker and a monocular vision system. In the proposed imitation approach the sensor data are mapped to the joint space of the robot. Even though the performance of the robot is constrained by the kinematic and dynamic limitations of RSV2 and by the sensor inaccuracies, experiments involving simple gesture imitation of an untrained user show the viability and effectiveness of the method.

[1]  Sven Behnke,et al.  Playing Soccer with RoboSapien , 2005, RoboCup.

[2]  Paulo Menezes,et al.  A single camera motion capture system dedicated to gestures imitation , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[3]  Francisco Sandoval Hernández,et al.  A model-based humanoid perception system for real-time human motion imitation , 2004, IEEE Conference on Robotics, Automation and Mechatronics, 2004..

[4]  Yoshihiko Nakamura,et al.  Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Yu Zhou,et al.  Integrating Optical Force Sensing with Visual Servoing for Microassembly , 2000, J. Intell. Robotic Syst..

[6]  Masayuki Inaba,et al.  Intent imitation using wearable motion capturing system with on-line teaching of task attention , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[7]  Kerstin Dautenhahn,et al.  Challenges in Building Robots That Imitate People , 2002 .

[8]  Takashi Minato,et al.  Generating natural motion in an android by mapping human motion , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Katsushi Ikeuchi,et al.  Toward an assembly plan from observation. I. Task recognition with polyhedral objects , 1994, IEEE Trans. Robotics Autom..

[10]  Kazuhito Yokoi,et al.  Imitating human dance motions through motion structure analysis , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Jun Tani,et al.  On-line imitative interaction with a humanoid robot using a mirror neuron model , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[13]  Ales Ude,et al.  Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[14]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[15]  Aude Billard,et al.  Robota: Clever toy and educational tool , 2003, Robotics Auton. Syst..

[16]  Rajesh P. N. Rao,et al.  Robotic imitation from human motion capture using Gaussian processes , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[17]  Zhaoqin Peng,et al.  Kinematics mapping and similarity evaluation of humanoid motion based on human motion capture , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Rüdiger Dillmann,et al.  Understanding users intention: programming fine manipulation tasks by demonstration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Masayuki Inaba,et al.  From visuo-motor self learning to early imitation-a neural architecture for humanoid learning , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[21]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[22]  Aude Billard,et al.  Goal-Directed Imitation in a Humanoid Robot , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Atsushi Nakazawa,et al.  Task model of lower body motion for a biped humanoid robot to imitate human dances , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.