High fidelity telepresence systems: Design, control, and evaluation

An overview of subjectively selected recent topics and research trends in the area of modern telepresence and teleaction is given. Multi-modal telepresence systems are to enable human operators to become present and active in remote or inaccessible environments through a communication network and a suitable telerobotic system. The major challenges of such a multimodal telepresence system like stabilizing measures, and transparency, e.g. in the case of time-delay (latency) in the communication network, are discussed. A practical implementation of an integrated mobile and bimanual multi-user telepresence and teleaction system as well as some exemplary experiments are presented. Furthermore, it is discussed how the performance of telepresence systems can be improved by using psychophysical knowledge of human perception.

[1]  Martin Buss,et al.  Actuating a Data-Glove with Thermal-Tactile Feedback - Human Factors Considerations , 2005 .

[2]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[3]  Greg Welch,et al.  High-Performance Wide-Area Optical Tracking: The HiBall Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[4]  Domenico Prattichizzo,et al.  An Experimental Study of the Limitations of Mobile Haptic Interfaces , 2004, ISER.

[5]  Bartlomiej Stanczyk,et al.  Advanced Telerobotics: Dual-Handed and Mobile Remote Manipulation , 2007, Advances in Telerobotics.

[6]  Martin Buss,et al.  A control algorithm and preliminary user studies for a bone drilling medical training system , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[7]  Guenther Schmidt,et al.  Motion compression for telepresent walking in large-scale remote environments , 2003, SPIE Defense + Commercial Sensing.

[8]  Richard M. Satava,et al.  Virtual Environments for Medical Training and Education , 1997, Presence: Teleoperators & Virtual Environments.

[9]  Y. Kunii,et al.  Tele-teaching by human demonstration in virtual environment for robotic network system , 1997, Proceedings of International Conference on Robotics and Automation.

[10]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[11]  Uwe D. Hanebeck,et al.  Design issues of mobile haptic interfaces , 2003, J. Field Robotics.

[12]  Martin Buss,et al.  Dynamic display of distributed tactile shape information by a prototypical actuator array , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[13]  Georg Passig.  Scene Model Acquisition for a Photo-Realistic Predictive Display , 2003 .

[14]  Jean-Jacques E. Slotine,et al.  Towards force-reflecting teleoperation over the Internet , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[15]  Robert Riener,et al.  Knee Joint Simulator Based on Haptic, Visual and Acoustic Feedback , 2000 .

[16]  Georg Passig,et al.  A Photorealistic Predictive Display , 2004, Presence: Teleoperators & Virtual Environments.

[17]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[18]  Peter J. Werkhoven,et al.  The Effects of Proprioceptive and Visual Feedback on Geographical Orientation in Virtual Environments , 1999, Presence: Teleoperators & Virtual Environments.

[19]  Martin Buss,et al.  Control Problems in Multi-Modal Telepresence Systems , 1999 .

[20]  Barbara Deml,et al.  A Study on Visual, Auditory, and Haptic Feedback for Assembly Tasks , 2004, Presence: Teleoperators & Virtual Environments.

[21]  Martin Buss.  Study on intelligent cooperative manipulation , 1994 .

[22]  Hideki Hashimoto,et al.  Motion Scheme for Dextrous Manipulation in the Intelligent Cooperative Manipulation System - ICMS , 1994, IROS.

[23]  Won S. Kim,et al.  Virtual Reality Calibration and Preview/Predictive Displays for Telerobotics , 1996, Presence: Teleoperators & Virtual Environments.

[24]  Nathan Delson,et al.  Robot programming by human demonstration: Subtask compliance controller identification , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[25]  Martin Buss,et al.  Towards a Hyper-Redundant Haptic Display , 2003 .

[26]  Roy A. Ruddle,et al.  Movement in Cluttered Virtual Environments , 2001, Presence: Teleoperators & Virtual Environments.

[27]  Robert J. Anderson,et al.  Autonomous, teleoperated, and shared control of robot systems , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[28]  Sandra Hirche,et al.  Transparency of haptic telepresence systems with constant time delay , 2005 .

[29]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[30]  Hideki Hashimoto,et al.  Skill acquisition and transfer system as approach to the intelligent assisting system-IAS , 1993, Proceedings of IEEE International Conference on Control and Applications.

[31]  Uwe D. Hanebeck,et al.  Feedback Controlled Motion Compression for Extended Range Telepresence , 2004 .

[32]  Bartlomiej Stanczyk,et al.  Experimental Comparison of Interaction Control Methods for a Redundant Telemanipulator , 2005 .

[33]  Claudio Melchiorri,et al.  Haptic tele-operation of a mobile robot , 2003 .

[34]  Martin Buss,et al.  Control mode switching for teledrilling based on a hybrid system model , 1997, Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[35]  Martin Buss,et al.  A systems theoretical model for human perception in multimodal presence systems , 2001 .

[36]  Günther Schmidt,et al.  A mobile haptic interface mastering a mobile teleoperator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[37]  John M. Hollerbach,et al.  Some current issues in haptics research , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[38]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[39]  Sandra Hirche,et al.  Telemanipulation over the Internet: a Tele-Assembly Experiment , 2004 .

[40]  Bartlomiej Stanczyk,et al.  Haptic telemanipulation with dissimilar kinematics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Martin Buss,et al.  First evaluation of a novel tactile display exerting shear force via lateral displacement , 2005, TAP.

[42]  Oussama Khatib,et al.  Robust Haptic Teleoperation of a Mobile Manipulation Platform , 2004, ISER.

[43]  Franz Freyberger,et al.  Interactive stereo vision telepresence for correct communication of spatial geometry , 2003, Adv. Robotics.

[44]  Uwe D. Hanebeck,et al.  A modular wheel system for mobile robot applications , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[45]  Rudy Darken,et al.  The omni-directional treadmill: a locomotion device for virtual worlds , 1997, UIST '97.

[46]  Hiroo Iwata,et al.  Walking about virtual environments on an infinite floor , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[47]  Günther Schmidt,et al.  Display of Holistic Haptic Sensations by Combined Tactile and Kinesthetic Feedback , 2004, Presence: Teleoperators & Virtual Environments.

[48]  Martin Buss,et al.  Design and control concepts of a hyper redundant haptic interface for interaction with virtual environments , 2004 .

[49]  Uwe D. Hanebeck,et al.  Extending Telepresent Walking by Motion Compression , 2002 .

[50]  Matthias Eichner,et al.  Walking with and Without Walking: Perception of Distance in Large-Scale Urban Areas in Reality and in Virtual Reality , 2004, Presence: Teleoperators & Virtual Environments.

[51]  Tobias Ortmaier,et al.  Toward High-Fidelity Telepresence in Space and Surgery Robotics , 2004, Presence: Teleoperators & Virtual Environments.

[52]  Klaus Schilling,et al.  Haptic interfaces for the remote control of mobile robots , 2002 .

[53]  Bartlomiej Stanczyk,et al.  Haptic Telemanipulation in Extensive Remote Environments , 2005 .

[54]  Klaus Landzettel,et al.  ROTEX - The First Robot in Space , 1994 .

[55]  Bruno Siciliano,et al.  Control Problems in Robotics and Automation , 1998 .

[56]  Sandra Hirche,et al.  TOWARDS DEADBAND CONTROL IN NETWORKED TELEOPERATION SYSTEMS , 2005 .

[57]  Bartlomiej Stanczyk,et al.  Development of a telerobotic system for exploration of hazardous environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[58]  Uwe D. Hanebeck,et al.  Mobile haptische Schnittstellen für weiträumige Telepräsenz: Idee und Methodik (Mobile Haptic Interfaces for Extended Area Telepresence: Idea and Methodology) , 2003 .

[59]  G. Schmidt,et al.  Bimanual Haptic Telepresence Technology Employed to Demining Operations , 2004 .

[60]  Martin Buss,et al.  Human-robot-interface for intelligent service robot assistance , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[61]  Uwe D. Hanebeck,et al.  Mobile haptic interaction with extended real or virtual environments , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[62]  Kazuhiro Kosuge,et al.  Bilateral feedback control of telemanipulators via computer network , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[63]  Peter F. Kammermeier.  Verteilte taktile Stimulation zur Vermittlung mechanischer Berührungsinformationen in Telepräsenzanwendungen , 2004 .

[64]  Martin Buss,et al.  VISHARD10, a novel hyper-redundant haptic interface , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[65]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[66]  Martin Buss,et al.  Design, Control, and Evaluation of a Hyper-redundant Haptic Device , 2007, Advances in Telerobotics.

[67]  Sandra Hirche,et al.  NETWORK TRAFFIC REDUCTION IN HAPTIC TELEPRESENCE SYSTEMS BY DEADBAND CONTROL , 2005 .

[68]  Terry Allard,et al.  Spatial Orientation and Wayfinding in Large-Scale Virtual Spaces. , 1999 .

[69]  Uwe D. Hanebeck,et al.  Motion Compression for Telepresent Walking in Large Target Environments , 2004, Presence: Teleoperators & Virtual Environments.

[70]  Rüdiger Dillmann,et al.  Interactive generation of flexible robot programs , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[71]  Sandra Hirche,et al.  A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..