Object transportation by two humanoid robots using cooperative learning

In this paper, we propose an approach to the behavior acquisition required for humanoid robots to learn a cooperative transportation task. In case of object transportation with two humanoid robots, mutual position shifts may occur due to the body swinging of robots. Therefore, it is necessary to correct the position in a real-time manner. Many efforts are needed to develop the position shift correction system. We propose to solve the problem by learning required behaviors with two learning algorithms. Successful cooperation of two HOAP-1 humanoid robots in the transportation task obtained by classifier system and Q-learning has been confirmed experimentally in our work.

[1]  Richard S. Sutton,et al.  Dimensions of Reinforcement Learning , 1998 .

[2]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[3]  Kazuhiro Kosuge,et al.  Decentralized control of multiple manipulators handling an object in coordination based on impedance control of each arm , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[4]  Hisashi Osumi,et al.  Cooperative Control for Three Mobile Robots Transporting a Large Object , 2001 .

[5]  Yuan F. Zheng,et al.  Arm-manipulator coordination for load sharing using variable compliance control , 1997, Proceedings of International Conference on Robotics and Automation.

[6]  Hitoshi Iba,et al.  Cooperative Transportation by Humanoid Robots: Learning to Correct Positioning , 2003, HIS.

[7]  Jun Ota,et al.  Cooperative transport system with regrasping car-like mobile robots , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[8]  H. Inoue,et al.  Humanoid Robotics Project of MITI , 2000 .

[9]  Ryojun Ikeura,et al.  Investigating the impedance characteristic of human arm for development of robots to co-operate with human operators , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[10]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[11]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[12]  Jun Ota,et al.  Transferring Control by Cooperation of Two Mobile Robots , 1996 .