Automated Assistance Robot System for Transferring Model-Free Objects From/To Human Hand Using Vision/Force Control

This paper will propose an assistance robot system which is able to transfer model-free objects from/to human hand with the help of visual servoing and force control. The proposed robot system is fully automated, i.e. the handing-over task is performed exclusively by the robot and the human will be considered as the weakest party, e.g. elderly, disabled, blind, etc. The proposed system is supported with different real time vision algorithms to detect, to recognize and to track: 1. Any object located on flat surface or conveyor. 2. Any object carried by human hand. 3. The loadfree human hand. Furthermore, the proposed robot system has integrated vision and force feedback in order to: 1. Perform the handing-over task successfully starting from the free space motion until the full physical human-robot integration. 2. Guarantee the safety of the human and react to the motion of the human hand during the handing-over task. The proposed system has shown a great efficiency during the experiments.

[1]  John Kenneth Salisbury,et al.  A New Actuation Approach for Human Friendly Robot Design , 2004, Int. J. Robotics Res..

[2]  John Kenneth Salisbury,et al.  A New Actuation Approach for Human Friendly Robot Design , 2002, ISER.

[3]  Miaolong Yuan,et al.  Robust hand tracking using a simple color classification technique , 2008, VRCAI '08.

[4]  Mohamad Bdiwi,et al.  Library automation using different structures of vision-force robot control and automatic decision system , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jiri Matas,et al.  Progressive probabilistic Hough transform for line detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Ling Chen,et al.  Hand posture recognition and tracking based on Bag-of-Words for human robot interaction , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Siddhartha S. Srinivasa,et al.  Human preferences for robot-human hand-over configurations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[9]  Kenneth Sundaraj,et al.  Real-time robot-human interaction by tracking hand movement & orientation based on morphology , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[10]  Miaolong Yuan,et al.  Robust Hand Tracking Using a Simple Color Classification Technique , 2009 .

[11]  Rachid Alami,et al.  Planning Safe and Legible Hand-over Motions for Human-Robot Interaction , 2010 .

[12]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.