Toward automatic robot instruction from perception-recognizing a grasp from observation

Deals with the programming of robots to perform grasping tasks. To do this, the assembly plan from observation (APO) paradigm is adopted, where the key idea is to enable a system to observe a human performing a grasping task, understand it, and perform the task with minimal human intervention. A grasping task is composed of three phases: pregrasp phase, static grasp phase, and manipulation phase. The first step in recognizing a grasping task is identifying the grasp itself. The proposed strategy of identifying the grasp is to map the low-level hand configuration to increasingly more abstract grasp descriptions. To achieve the mapping, a grasp representation is introduced, called the contact web, which is composed of a pattern of effective contact points between the hand and the object. A grasp taxonomy based on the contact web is also proposed as a tool to systematically identify a grasp. The grasp can be described at higher conceptual levels using a certain mapping function that results in an index called the grasp cohesive index. This index can be used to identify the grasp. Results from grasping experiments show that it is possible to distinguish between various types of grasps using the proposed contact web, grasp taxonomy and grasp cohesive index. >

[1]  G. Schlesinger.  Der mechanische Aufbau der künstlichen Glieder , 1919 .

[2]  Taylor Cl,et al.  The anatomy and mechanics of the human hand. , 1955 .

[3]  J. Napier.  The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[4]  C. Long,et al.  Intrinsic-extrinsic muscle control of the hand in power grip and precision handling. An electromyographic study. , 1970, The Journal of bone and joint surgery. American volume.

[5]  Russell H. Taylor,et al.  AL, a programming system for automation. , 1974 .

[6]  K N An,et al.  Normative model of human hand for biomechanical analysis. , 1979, Journal of biomechanics.

[7]  Tomás Lozano-Pérez,et al.  Automatic Planning of Manipulator Transfer Movements , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  David D. Grossman,et al.  XPROBE: An Experimental System for Programming Robots by Example , 1984 .

[9]  M. Jeannerod.  The timing of natural prehension movements. , 1984, Journal of motor behavior.

[10]  Damian M. Lyons,et al.  A simple set of grasps for a dextrous hand , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[11]  M. Arbib.  Coordinated control programs for movements of the hand , 1985 .

[12]  Ruzena Bajcsy,et al.  Object Recognition Using Vision and Touch , 1985, IJCAI.

[13]  Mark R. Cutkosky,et al.  Modeling manufacturing grips and correlations with the design of robotic hands , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[14]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[15]  Van-Duc Nguyen,et al.  Constructing stable grasps in 3D , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[16]  George A. Bekey,et al.  A strategy for grasp synthesis with multifingered robot hands , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[17]  Sharon A. Stansfield,et al.  Visually-aided tactile exploration , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[18]  Thea Iberall,et al.  The nature of human prehension: Three dextrous hands in one , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[19]  H. Harry Asada,et al.  The direct teaching of tool manipulation skills via the impedance identification of human motions , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[20]  S. Shankar Sastry,et al.  Task-oriented optimal grasping by multifingered robot hands , 1987, IEEE J. Robotics Autom..

[21]  Thea Iberall.  A Neural Network for Planning Hand Shapes in Human Prehension , 1988, 1988 American Control Conference.

[22]  Joe Jackson,et al.  Knowledge-based prehension: capturing human dexterity , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[23]  Lucy Pao,et al.  Transformation of human hand positions for robotic hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[24]  James Demmel,et al.  Simulation software for the Utah/MIT dextrous hand , 1989 .

[25]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[26]  Harry E. Stephanou,et al.  A topological model of multifingered prehension , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[27]  Kazuo Tanie,et al.  Contact point detection for grasping of an unknown object using joint compliance , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[28]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[29]  Christine L. MacKenzie,et al.  Opposition space and human prehension , 1990 .

[30]  E. Faldella,et al.  Grasp synthesis for a dextrous robotic hand using a multi-layer perceptron , 1991, [1991 Proceedings] 6th Mediterranean Electrotechnical Conference.

[31]  Gianni Vercelli,et al.  Shape analysis and hand preshaping for grasping , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[32]  Harry E. Stephanou,et al.  A computational model of prehensility and its application to dextrous manipulation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[33]  Katsushi Ikeuchi,et al.  A Framework for Recognizing Grasps , 1991 .

[34]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[35]  Martial Hebert,et al.  Task Oriented Vision , 1992 .

[36]  T J Armstrong,et al.  A kinematic model of the human hand to evaluate its prehensile capabilities. , 1992, Journal of biomechanics.