Task guided attention control and visual verification in tea serving by the daily assistive humanoid HRP2JSK

This paper describes daily assistive task experiments that conducting on the HRP2JSK humanoid robot. We present overall action and recognition integrated system design to realize daily assistive behaviors autonomously and robustly, along with the demonstration that the HRP2JSK pours tea from a bottle to a cup and wash it after human drink it. To obtain autonomy and robustness, visual recognition and behavior control through perception information are important.

[1]  Tamim Asfour,et al.  Programming by demonstration: dual-arm manipulation tasks for humanoid robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Kikuo Fujimura,et al.  The intelligent ASIMO: system overview and integration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Dariu Gavrila,et al.  A Bayesian Framework for Multi-cue 3D Object Tracking , 2004, ECCV.

[4]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[5]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[6]  Tamim Asfour,et al.  ARMAR-III: An Integrated Humanoid Platform for Sensory-Motor Control , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[7]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[8]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[9]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[10]  Charles C. Kemp,et al.  Manipulation in Human Environments , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[11]  Tomomasa Sato Real World Informatics Environment System , 2006, IAS.

[12]  K. Okada,et al.  Humanoid motion generation system on HRP2-JSK for daily life environment , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[13]  Satoshi Kagami,et al.  Localisation for Autonomous Humanoid Navigation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[14]  Masayuki Inaba,et al.  Multi-cue 3D object recognition in knowledge-based vision-guided humanoid robot system , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Masayuki Inaba,et al.  Vision based behavior verification system of humanoid robot for daily environment tasks , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[16]  Olivier Stasse,et al.  Real-time 3D SLAM for Humanoid Robot considering Pattern Generator Information , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Hirochika Inoue,et al.  HRP: Humanoid Robotics Project of MITI , 2000 .