Assistive robotic arm autonomously bringing a cup to the mouth by face recognition

We developed an assistive-robotic-arm system which autonomously grasps a cup and brings it to the user's mouth. It was developed as a prototype of meal-assistance robot. We utilized two heterogeneous eye-in-hand cameras. One is the front-camera capturing objects, and the other is the side-camera capturing the user's face. The latter keeps an occlusion-free view even during the object bringing. We implemented a face recognition function which robustly identifies the user's face while predicting the face position. The arm is controlled by visual servoing technique. We verified the basic performance of the system through preliminary tests. The arm was able to execute the task, controlling the arm according to the position of the object and the user's face. We demonstrated the basic possibility for the meal-assistance robot.

[1]  Claire Dune,et al.  One Click Focus with Eye-in-hand/Eye-to-hand Cooperation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  Katherine M. Tsui,et al.  Development and evaluation of a flexible interface for a wheelchair mounted robotic arm , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  J. A. van Woerden,et al.  Collaborative Control of the Manus Manipulator , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[4]  Hyun Min Do,et al.  Visual marker system for control of flexible manipulator supporting daily living , 2009, 2009 ICCAS-SICE.

[5]  Hyun Min Do,et al.  Visual Mark for Robot Manipulation and Its RT-Middleware Component , 2008, Adv. Robotics.

[6]  C. Leroux,et al.  Intuitive human interaction with an arm robot for severely handicapped people - A One Click Approach , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[7]  Katherine M. Tsui,et al.  Simplifying Wheelchair Mounted Robotic Arm Control with a Visual Interface , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[8]  Katherine M. Tsui,et al.  Survey of domain-specific performance measures in assistive robotic technology , 2008, PerMIS.