Robot grasping of unknown objects, description and validation of the function with quadriplegic people

This document, presents the AVISO system developed to provide severely disabled people (quadriplegic) with a function allowing them to grasp objects in their environment. The proposed solution relies on a dedicated robot arm with a gripper and a controller allowing automatic vision control of robot's motion. The grasping function proposed does not need marks on the objects of the environment and does not use any model of the objects. It is therefore easy to use, polyvalent and can be applied to a wide variety of objects. The AVISO system includes an intuitive man machine interface specially designed to take into account needs and interaction constraints of physically disabled people. The AVISO system was developed together with medical teams. It was tested and evaluated with disabled people of different aetiology and several valid persons under the control of occupational therapists of different hospitals and rehabilitation centres. The results are positive enough to enable to think to an industrial transfer of this technology at mid term. The paper terminates on a description of the future works, to enhance the system developed and improve our man machine interface in order to be furthermore usable by non-computer or robot specialists.

[1]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  Fumio Miyazaki,et al.  Manipulator Control by Visual Ser-voing with the Stereo Vision , 1993 .

[4]  M Busnel,et al.  The robotized workstation "MASTER" for users with tetraplegia: description and evaluation. , 1999, Journal of rehabilitation research and development.

[5]  Danica Kragic,et al.  Robust Visual Servoing , 2003, Int. J. Robotics Res..

[6]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[7]  Gregory D. Hager,et al.  Feature-based visual servoing and its application to telerobotics , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[8]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Philippe Gorce,et al.  A biocybernetic method to learn hand grasping posture , 2003 .

[10]  Antonio Morales,et al.  Vision-based three-finger grasp synthesis constrained by hand geometry , 2006, Robotics Auton. Syst..

[11]  Nikolaos Papanikolopoulos,et al.  Issues and experimental results in vision‐guided robotic grasping of static or moving objects , 1998 .

[12]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[14]  Luc Van Gool,et al.  Automatic object recognition as part of an integrated supervisory control system , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[15]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[16]  Fadi Dornaika,et al.  Visually guided object grasping , 1998, IEEE Trans. Robotics Autom..

[17]  Paolo Dario,et al.  Experimental analysis of the proprioceptive and exteroceptive sensors of an underactuated prosthetic hand , 2004 .

[18]  Tom Brock,et al.  The Industrial Robot , 1983 .

[19]  Etienne Colle,et al.  The development of robot human-like behaviour for an efficient human-machine co-operation , 2001 .

[20]  Michael Schmitt,et al.  Ein Konzept für die mobile Manipulation von unbekannten Objekten mit Hilfe von 3D-Rekonstruktion und Visual Servoing , 1999, AMS.

[21]  Karl-Friedrich Kraiss,et al.  Supervised navigation and manipulation for impaired wheelchair users , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[22]  Fumio Miyazaki,et al.  Manipulator control by using servoing with the stereo vision , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[23]  Martine Guerrand,et al.  MAGRITTE: a graphic supervisor for remote handling interventions , 2004 .

[24]  Edwige Pissaloux,et al.  A qualitative image reconstruction from an axial image sequence , 2001, Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR 2001). Analysis and Understanding of Time Varying Imagery.

[25]  Karl Vollmann,et al.  Manipulator control by calibration-free stereo vision , 1996, Other Conferences.

[26]  Hong Liu,et al.  DLR hand II: experiments and experience with an anthropomorphic hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[27]  R. Horaud,et al.  Vision par ordinateur: outils fondamentaux , 1995 .