Design and Control of Admittance-Type Telemanipulation Systems

This thesis summarizes guidelines for the design and control of a highly integrated, multi-modal, and intuitive teleoperation system that can be used to perform a variety of different manipulation tasks requiring bimanual and multi-fingered interactions as well as the collaboration of multiple operators. Hereby, exclusively teleoperation systems using admittance-type devices are investigated. Bimanual 6 DOF manipulations with high interaction forces are realized by newly developed admittance-type haptic interfaces, which are mounted on a mobile platform and thus also allow performance of manipulations in large remote environments. Taking into account a large number of mechatronic requirements, a novel, enhanced, and highly integrated teleoperation system consisting of redundant haptic interfaces and telemanipulators as well as a stereo-vision-system is developed. Dextrous fine manipulations are realized by a multi-fingered telemanipulation system, whereby efficient position and force mapping algorithms are used to map human hand motions to gripper motions and to provide a realistic force feedback. The usage of admittance-type devices instead of classical impedance-type devices poses new challenges on the control concepts. Different types of bilateral control algorithms suitable for admittance-type devices are proposed and robust stability of them is analyzed by using the parameter space approach. Further improvements are achieved by incorporating human factors in the development process. Effects of varied human movement control on task performance and feeling of telepresence are analyzed by means of experimental evaluation and new design guidelines for a user-friendly teleoperation system are derived. Finally, different types of collaborative teleoperation architectures are proposed, application scenarios are described, and challenges on the control of these systems are formulated. In particular, robust stability of a bimanual, a multi-user, and a cooperative teleoperation system is investigated in detail. A variety of laboratory experiments, characterized particularly by their very high complexity, serve for the evaluation and validation of all proposed software and hardware developments.

[1]  Greg R. Luecke,et al.  Dynamic simulation of virtual mechanisms with haptic feedback using industrial robotics equipment , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  Hiroshi Noborio,et al.  A shared autonomy of multiple mobile robots in teleoperation , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[3]  Shahin Sirouspour,et al.  Multi-operator/multi-robot teleoperation: an adaptive nonlinear control approach , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  G. Visentin,et al.  The ESA Human Arm Exoskeleton for Space Robotics Telepresence , 2003 .

[5]  Neville Hogan,et al.  An analysis of contact instability in terms of passive physical equivalents , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[6]  Keum Shik Hong,et al.  Manipulability analysis of a parallel machine tool: Application to optimal link length design , 2000, J. Field Robotics.

[7]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[8]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[9]  Kazuhito Yokoi,et al.  Whole-Body Motion Generation Integrating Operator's Intention and Robot's Autonomy in Controlling Humanoid Robots , 2007, IEEE Transactions on Robotics.

[10]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[11]  Hyung-Soon Park,et al.  Transparent teleoperation using two-channel control architectures , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jong Hyeon Park,et al.  Impedance Control with Variable Damping for Bilateral Teleoperation under Time Delay , 2005 .

[13]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[14]  Bruno Siciliano,et al.  Quaternion-based kinematic control of redundant spacecraft/manipulator systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[15]  Gerd Hirzinger,et al.  Time Domain Passivity Control-based Telepresence with Time Delay , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Martin Buss,et al.  Haptic feedback systems for virtual reality and telepresence applications , 2006 .

[17]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[18]  Darwin G. Caldwell,et al.  Telepresence feedback and input systems for a twin armed mobile robot , 1996, IEEE Robotics Autom. Mag..

[19]  Jeff Rose,et al.  Rotating virtual objects with real handles , 1999, TCHI.

[20]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[21]  Stanley A. Schneider,et al.  Object impedance control for cooperative manipulation: theory and experimental results , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[22]  Bartlomiej Stanczyk,et al.  Tele-assembly in Wide Remote Environments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Kazuhito Yokoi,et al.  Force Strategies for Cooperative Tasks in Multiple Mobile Manipulation Systems , 1996 .

[24]  Bartlomiej Stanczyk,et al.  Advanced Telerobotics: Dual-Handed and Mobile Remote Manipulation , 2007, Advances in Telerobotics.

[25]  Imad H. Elhajj,et al.  Design and Analysis of Internet-Based Tele-Coordinated Multi-Robot Systems , 2003, Auton. Robots.

[26]  Martin Buss,et al.  Design and control concepts of a hyper redundant haptic interface for interaction with virtual environments , 2004 .

[27]  Shumin Zhai,et al.  Investigating Coordination in Multidegree of Freedom Control I: Time-On-Target Analysis of 6 DOF Tracking , 1997 .

[28]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[29]  Wen-Hong Zhu,et al.  Stability guaranteed teleoperation: an adaptive motion/force control approach , 2000, IEEE Trans. Autom. Control..

[30]  Sandra Hirche,et al.  Bilateral Control Architectures for Telerobotics , 2007, Advances in Telerobotics.

[31]  M.M. Stanisic,et al.  Kinematic mapping between the EXOS Handmaster exoskeleton and the Utah/MIT dextrous hand , 1990, 1990 IEEE International Conference on Systems Engineering.

[32]  Martin Buss,et al.  Redundancy resolution of a 7 DOF haptic interface considering collision and singularity avoidance , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Robert Rohling,et al.  Optimized fingertip mapping for teleoperation of dextrous robot hands , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[34]  Nives Klop.  Kinematic Model for Determination of Human Arm Reachable Workspace , 2005 .

[35]  M. Turvey.  The bernstein perspective I , 1982 .

[36]  Vincent Hayward,et al.  Performance Measures for Haptic Interfaces , 1996 .

[37]  Isao Endo,et al.  Cooperative formation among multiple mobile robot teleoperation in inspection task , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[38]  Paul G. Backes.  Dual-arm supervisory and shared control task description and execution , 1994, Robotics Auton. Syst..

[39]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[40]  Gerd Hirzinger,et al.  Learning techniques in a dataglove based telemanipulation system for the DLR hand , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[41]  Marc-Walter Ueberle,et al.  Design, Control, and Evaluation of a Family of Kinesthetic Haptic Interfaces , 2006 .

[42]  M. Buss,et al.  Robust stability analysis of bilateral teleoperation systems using admittance-type devices , 2008, 2008 SICE Annual Conference.

[43]  G. Hirzinger,et al.  Telepresence and Teleaction in Minimally Invasive Surgery , 2004 .

[44]  Domenico Prattichizzo,et al.  A mobile platform for haptic grasping in large environments , 2006, Virtual Reality.

[45]  G. Raisbeck.  A Definition of Passive Linear Networks in Terms of Time and Energy , 1954 .

[46]  Rajnikant V. Patel,et al.  An Internet-based distributed multiple-telerobot system , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[47]  Bartlomiej Stanczyk,et al.  Development of a telerobotic system for exploration of hazardous environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[48]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[49]  Jong Hyeon Park,et al.  Impedance controller design of Internet-based teleoperation using absolute stability concept , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Bartlomiej Stanczyk,et al.  Development of a high-performance haptic telemanipulation system with dissimilar kinematics , 2006, Adv. Robotics.

[51]  Sigal Berman,et al.  Object-action abstraction for teleoperation , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[52]  Günther Schmidt,et al.  A mobile haptic interface mastering a mobile teleoperator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[53]  P.G. Backes.  Generalized compliant motion with sensor fusion , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[54]  Danica Kragic,et al.  Interactive grasp learning based on human demonstration , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[55]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[56]  Bartlomiej Stanczyk,et al.  Haptic Telemanipulation in Extensive Remote Environments , 2005 .

[57]  Masaru Uchiyama,et al.  An Experimental Teleoperation System for Dual-Arm Space Robotics , 2000, J. Robotics Mechatronics.

[58]  N. A. Bernshteĭn.  The co-ordination and regulation of movements , 1967 .

[59]  S. Bhattacharyya,et al.  Robust control , 1987, IEEE Control Systems Magazine.

[60]  Charles Baur,et al.  Overview of the Delta Haptic Device , 2001 .

[61]  Woodrow Barfield,et al.  A Review of Presence and Performance in Virtual Environments , 2000, Int. J. Hum. Comput. Interact..

[62]  Warren P. Seering,et al.  Understanding bandwidth limitations in robot force control , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[63]  Paul Milgram,et al.  Measuring the allocation of control in a 6 degree-of-freedom docking experiment , 2000, CHI.

[64]  Terry Allard,et al.  Spatial Orientation and Wayfinding in Large-Scale Virtual Spaces II: Guest Editors' Introduction , 1999, Presence.

[65]  Shahin Sirouspour.  Robust Control Design for Cooperative Teleoperation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[66]  Bartlomiej Stanczyk,et al.  High fidelity telepresence systems: Design, control, and evaluation , 2005 .

[67]  Martin Buss,et al.  Robust stability analysis of bilateral teleoperation architectures for admittance-type devices , 2008, ICRA 2008.

[68]  Masami Kobayashi,et al.  Telexistence cockpit for humanoid robot control , 2003, Adv. Robotics.

[69]  F. Barbagli,et al.  Performance of Mobile Haptic Interfaces , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[70]  Pere Ridao,et al.  Underwater Telerobotics for Collaborative Research , 2007, Advances in Telerobotics.

[71]  Daniel K. E. Aarno,et al.  Intention Recognition in Human Machine Collaborative Systems , 2007 .

[72]  M. Buss,et al.  A New Admittance-Type Haptic Interface for Bimanual Manipulations , 2008, IEEE/ASME Transactions on Mechatronics.

[73]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[74]  Robert O. Ambrose,et al.  Cooperative manipulation between humans and teleoperated agents , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[75]  Rod McCall,et al.  Measuring presence in virtual environments , 2004, CHI EA '04.

[76]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[77]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps , 1997, IEEE Trans. Robotics Autom..

[78]  Uwe D. Hanebeck,et al.  Design issues of mobile haptic interfaces , 2003, J. Field Robotics.

[79]  Jiawei Hong,et al.  Calibrating a VPL DataGlove for teleoperating the Utah/MIT hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[80]  W. J. Duncan,et al.  On the Criteria for the Stability of Small Motions , 1929 .

[81]  Gunther Reinhart,et al.  Telepresence as a Solution to Manual Micro-Assembly , 2004 .

[82]  M. Buss,et al.  Control and performance evaluation of a new redundant haptic interface , 2007, SICE Annual Conference 2007.

[83]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[84]  Martin Buss,et al.  A Mobile Haptic Interface for Bimanual Manipulations in Extended Remote/Virtual Environments , 2008 .

[85]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[86]  F. B. Llewellyn,et al.  Some Fundamental Properties of Transmission Systems , 1952, Proceedings of the IRE.

[87]  S. Tachi,et al.  Development of Teleoperation Master System with a Kinesthetic Sensation of Presence , 1999 .

[88]  Kenzo Nonami,et al.  Hand posture detection by neural network and grasp mapping for a master slave hand system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[89]  S. Hirche,et al.  Bilateral teleoperation over the internet: the time varying delay problem , 2003, Proceedings of the 2003 American Control Conference, 2003..

[90]  Klaus Landzettel,et al.  DLR's Advanced Telerobotic Concepts and Experiments for On-Orbit Servicing , 2007, Advances in Telerobotics.

[91]  Lucy Y. Pao,et al.  Rate-hardness: a new performance metric for haptic interfaces , 2000, IEEE Trans. Robotics Autom..

[92]  Vincent Hayward,et al.  Fundamental limits in the rendering of virtual haptic textures , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[93]  Jong-Oh Park,et al.  KIST teleoperation system for humanoid robot , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[94]  Fumio Kanehiro,et al.  Humanoid robot HRP-2 , 2008, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[95]  Marc O. Ernst,et al.  A Bayesian view on multimodal cue integration , 2006 .

[96]  J. Davenport.  Editor , 1960 .

[97]  Martin Buss,et al.  Robust stability analysis of a bilateral teleoperation system using the parameter space approach , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[98]  Hong Liu,et al.  DLR hand II: experiments and experience with an anthropomorphic hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[99]  Robert G. Bonitz,et al.  Internal force-based impedance control for cooperating manipulators , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[100]  Martin Buss,et al.  Towards a mobile haptic interface for bimanual manipulations , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[101]  吉川 恒夫,et al.  Foundations of robotics : analysis and control , 1990 .

[102]  Shahin Sirouspour,et al.  Modeling and control of cooperative teleoperation systems , 2005, IEEE Transactions on Robotics.

[103]  Stefano Caselli,et al.  Grasp recognition in virtual reality for robot pregrasp planning by demonstration , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[104]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[105]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[106]  Tsuneo Yoshikawa,et al.  Translational and Rotational Manipulability of Robotic Manipulators , 1990, 1990 American Control Conference.

[107]  S. Hayati,et al.  A testbed for a unified teleoperated-autonomous dual-arm robotic system , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[108]  Heinz Ulbrich,et al.  A 2D-Motion Platform: The Cybercarpet , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[109]  R. Dillmann,et al.  Programming service tasks in household environments by human demonstration , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[110]  Christopher W. Tyler,et al.  Sensory processing of binocular disparity , 1983 .

[111]  Ali Shahdi,et al.  Discrete-time multi-model control for cooperative teleoperation under time delay , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[112]  Klaus Diepold,et al.  A New HRTF Interpolation Approach for Fast Synthesis of Dynamic Environmental Interaction , 2008 .

[113]  Kunikatsu Takase,et al.  Multioperator Teleoperation of Multirobot Systems with Time Delay: Part IITestbed Description , 2002, Presence: Teleoperators & Virtual Environments.

[114]  Dongjun Lee,et al.  Bilateral teleoperation of a wheeled mobile robot over delayed communication network , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[115]  Keyvan Hashtrudi-Zaad,et al.  A four-channel multilateral shared control architecture for dual-user teleoperation systems , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[116]  Perry Y. Li,et al.  Passive bilateral control and tool dynamics rendering for nonlinear mechanical teleoperators , 2005, IEEE Transactions on Robotics.

[117]  Kam S. Tso,et al.  UMI: an interactive supervisory and shared control system for telerobotics , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[118]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[119]  Javier Martín,et al.  Mechanisms for haptic torque feedback , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[120]  Günther Schmidt,et al.  Stability and Performance Analysis of Kinesthetic Control Architectures for Bimanual Telepresence Systems , 2006, J. Intell. Robotic Syst..

[121]  Dale A. Lawrence.  Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[122]  Martin Buss,et al.  Effects of Varied Human Movement Control on Task Performance and Feeling of Telepresence , 2008, EuroHaptics.

[123]  Kostas J. Kyriakopoulos,et al.  Kinematic analysis and position/force control of the Anthrobot dextrous hand , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[124]  Sandra Hirche,et al.  The Human Role in Telerobotics , 2007, Advances in Telerobotics.

[125]  Olivier Stasse,et al.  Intercontinental cooperative telemanipulation between Germany and Japan , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[126]  Shumin Zhai,et al.  Investigating Coordination in Multidegree of Freedom Control II: Correlation Analysis in 6 DOF Tracking , 1997 .

[127]  John T. Wen,et al.  Motion and force control of multiple robotic manipulators , 1992, Autom..

[128]  Lucy Pao,et al.  Transformation of human hand positions for robotic hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[129]  S. Shankar Sastry,et al.  Robotics for telesurgery: second generation Berkeley/UCSF laparoscopic telesurgical workstation and looking towards the future applications , 2003, Ind. Robot.

[130]  S. Gruber,et al.  Robot hands and the mechanics of manipulation , 1987, Proceedings of the IEEE.

[131]  Bartlomiej Stanczyk,et al.  Haptic telemanipulation with dissimilar kinematics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[132]  H. Häcker,et al.  Dorsch Psychologisches Wörterbuch , 1998 .

[133]  Barbara Deml,et al.  Telepräsenzsysteme: Gestaltung der Mensch-System-Schnittstelle , 2004 .

[134]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[135]  Dongjun Lee,et al.  Passive Bilateral Teleoperation With Constant Time Delay , 2006, IEEE Transactions on Robotics.

[136]  Klaus Diepold,et al.  Binaural Source Localization and Spatial Audio Reproduction for Telepresence Applications , 2007, PRESENCE: Teleoperators and Virtual Environments.

[137]  Martin Buss,et al.  Study on Computer Assistance for Telepresent Reaching Movements , 2008, EuroHaptics.

[138]  Dale A. Lawrence,et al.  Performance trade-offs for hand controller design , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.