Force- and Vision-based Detection of Contact State Transitions

A new and systematic basic approach to force- and vision-based robot manipulation of deformable (non-rigid) linear objects is introduced. This approach reduces the computational needs by using a simple state-oriented model of the objects. These states describe the relation between the deformable and rigid obstacles, and are derived from the object image and its features. We give an enumeration of possible contact states and discuss the main characteristics of each state. We investigate the performance of robust transitions between the contact states and derive criteria and conditions for each of the states and for two sensor systems, i.e. a vision sensor and a force/torque sensor. This results in a new and task-independent approach in regarding the handling of deformable objects and in a sensor-based implementation of manipulation primitives for industrial robots. Thus, the usage of sensor processing is an appropriate solution for our problem. Finally, we apply the concept of contact states and state transitions to the description of a typical assembly task. Experimental results show the feasibility of our approach: A robot performs several contact state transitions which can be combined for solving a more complex task.

[1]  Heinz Wörn,et al.  Manipulating deformable linear objects-contact state transitions and transition conditions , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[2]  Hidefumi Wakamatsu,et al.  Dynamic analysis of rodlike object deformation towards their dynamic manipulation , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[3]  Kazuaki Iwata,et al.  Modeling of deformable thin parts for their manipulation , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[4]  Hirofumi Nakagaki,et al.  Study of deformation and insertion tasks of a flexible wire , 1997, Proceedings of International Conference on Robotics and Automation.

[5]  Hirofumi Nakagaki,et al.  Study of insertion task of a flexible wire into a hole by using visual tracking observed by stereo vision , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Dominik Henrich,et al.  Manipulating Deformable Linear Objects: Characteristics in Force Signals for Detecting Contact State Transitions , 2001 .

[7]  Uli Kutter,et al.  Literatur. , 1941, Subjekt.

[8]  Dominik Henrich,et al.  Direct and Inverse Simulation of Deformable Linear Objects , 2000 .

[9]  Masayuki INABA,et al.  Hand Eye Coordination in Rope Handling , 1985 .

[10]  Kunikatsu Takase,et al.  Assembly motion teaching system using position/force simulator - extracting a sequence of contact state transition , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[11]  Heinz Wörn,et al.  Manipulating deformable linear objects - Vision-based recognition of contact state transitions - , 1999 .

[12]  Heinz Wörn,et al.  Robot Manipulation of Deformable Objects: Advanced Manufacturing , 2000 .

[13]  Jong-Eun Byun,et al.  Determining the 3-D pose of a flexible object by stereo matching of curvature representations , 1996, Pattern Recognit..

[14]  A. Gray.  Modern Differential Geometry of Curves and Surfaces , 1993 .

[15]  D. Henrich,et al.  Manipulating deformable linear objects - contact states and point contacts , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[16]  Yuan F. Zheng,et al.  Deformation identification and estimation of one-dimensional objects by using vision sensors , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Yuan F. Zheng,et al.  Strategies for automatic assembly of deformable objects , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[18]  Werner Kraus,et al.  Case studies in the manipulation of flexible parts using a hybrid position/force approach , 1997, Proceedings of International Conference on Robotics and Automation.

[19]  Philip W. Smith.  Image-based manipulation planning for nonrigid objects , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[20]  Heinz Wörn,et al.  A parallel control architecture for industrial robot cells , 1998, DARS.

[21]  Pradeep K. Khosla,et al.  Manipulation task primitives for composing robot skills , 1997, Proceedings of International Conference on Robotics and Automation.

[22]  Kazuaki Iwata,et al.  Modeling of linear objects considering bend, twist, and extensional deformations , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[23]  Kunikatsu Takase,et al.  Representation and Control of Motion in Contact and Its Application to Assembly Tasks , 1988 .

[24]  L. Kauffman.  An Introduction to Knot Theory , 2001 .

[25]  Heinz Wörn,et al.  Manipulating deformable linear objects-force-based detection of contact state transitions , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[26]  Pradeep K. Khosla,et al.  Sensorimotor primitives for robotic assembly skills , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[27]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[28]  Hirofumi Nakagaki,et al.  Application of semi-automatic robot technology on hot-line maintenance work , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[29]  T. Suehiro,et al.  A model-based manipulation system with skill-based execution in unstructured environment , 1991 .

[30]  W. Lickorish,et al.  An Introduction to Knot Theory , 1997 .

[31]  Leonard S. Haynes,et al.  Robotic assembly by constraints , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.