Color and three-dimensional vision-based assistive telemanipulation

This paper presents a general purpose assistive tele-robot system that is designed to manipulate objects in a three-dimensional environment by using color and stereo vision. The incorporated vision system allows the user to operate the robot remotely simply by gesturing (pointing with a laser pointer). In this vision-based tele-manipulation system, the user is in the control loop actively interacting with the reactive robot motion planner through a multimodal interface (vision and speech). Because of this unique feature, the robot system has been simplified and released from performing the complex object recognition tasks that are often required by autonomous systems.

[1]  Mohan M. Trivedi,et al.  Edge-segment-based stereo analysis , 1990, Defense, Security, and Sensing.

[2]  Gonzalo Pajares,et al.  Stereo matching technique based on the perceptron criterion function , 1995, Pattern Recognit. Lett..

[3]  Homayoon Kazerooni,et al.  Dynamics and control of robotic systems worn by humans. , 1991 .

[4]  Zunaid Kazi,et al.  A comparison of rehabilitation robotics languages and software , 1997, Robotica.

[5]  Terry Winograd,et al.  Understanding natural language , 1974 .

[6]  Bill Ross,et al.  A practical stereo vision system , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Andrew Birrell,et al.  Implementing remote procedure calls , 1984, TOCS.

[8]  Ronald C. Arkin,et al.  Intelligent Robotic Systems , 1995, IEEE Expert.

[9]  Larry Leifer,et al.  Environmental Control and Robotic Manipulation Aids , 1982, Engineering in Medicine and Biology Magazine.

[10]  Ioannis Andreadis,et al.  Coloured object recognition using invariant spectral features , 1995, J. Intell. Robotic Syst..

[11]  C. V. Stewart,et al.  Experimental analysis of a number of stereo matching components using LMA , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[12]  L. B. Wolff,et al.  Three-dimensional stereo by photometric ratios , 1994 .

[13]  Shoji Tominaga.  A color classification method for color images using a uniform color space , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[14]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[15]  A. Constantinides,et al.  Graph—theoretical approach to colour picture segmentation and contour classification , 1993 .

[16]  Kazuhiko Kawamura,et al.  Intelligent robotic systems in service of the disabled , 1995 .