Cooperative Work System between Human and Manipulator using Hand Gesture Instructions

This paper provides a cooperative work system between human and manipulator using hand gesture instructions. The goal of our system is that the manipulator can work with humans in the same workspace according to the instructions of hand gestures. Our cooperative work system is composed of the manipulator, a PC and a trinocular stereovision hardware. Since the system has to recognize the position and posture of the hand in the three dimensional workspace, we use the trinocular stereovision hardware. The three dimensional positions of the hand and object are obtained through range images. The gesture is recognized based on the length and width of the hand. We propose the method in which the hand area is divided into two blocks in order to recognize the hand gesture rapidly. Through experimental results, we will show the effectiveness of our system.

[1]  Nobuyuki Yamasaki,et al.  Active interface for human-robot interaction , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[3]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  桑島 茂純.  世界初のフルデジタル・ステレオ・ビジョン・システム「DIGICLOPS」と強化されたステレオ処理ソフトウェア「Triclops API V2.2」 (特集 画像処理UP-to-Data) , 1999 .

[5]  Masayuki Inaba,et al.  Seeing, understanding and doing human task , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[6]  Masaru Nakano,et al.  Image preprocessor of model-based vision system for assembly robots , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[7]  Kazuo Tanie,et al.  Human interaction with a service robot: mobile-manipulator handing over an object to a human , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..