Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part II: Time-Delayed Communication

Two of the major challenges in networked haptic telepresence and teleaction systems are the time delay associated with the data transmission over the network and the limited communication resources. Sophisticated control methods are available for the stabilization in the presence of time delay. The reduction of haptic network traffic, however, is only poorly treated in the known literature. Data reduction approaches for time delayed haptic telepresence are not available at all. This article presents a novel approach to reduce the network traffic in haptic telepresence systems with constant (unknown) time delay. With the proposed deadband control approach data are sent only if the signal to transmit changes more than a given threshold value. In order to guarantee stability with time delay and data reduction a well-known time delay approach, the scattering transformation, is extended. Experimental user studies show that an average network traffic reduction up to 96 is achieved without significantly impairing the perception of the remote environment compared to the standard approach with time delay.

[1]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[2]  S. Hirche,et al.  Packet loss effects in passive telepresence systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[3]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[4]  Tsuneo Yoshikawa,et al.  Bilateral control with energy balance monitoring under time-varying communication delay , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Sandra Hirche,et al.  Haptic Telepresence in Packet Switched Communication Networks , 2005 .

[6]  Sandra Hirche,et al.  Insights on Human Adapted Control of Networked Telepresence and Teleaction Systems , 2005 .

[7]  Adam Wolisz,et al.  Adaptive Coding and Packet Rates for TCP-Friendly VoIP Flows , 2005 .

[8]  Mark W. Spong,et al.  Discrete time passivity in bilateral teleoperation over the Internet , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  Sandra Hirche,et al.  Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part I: Communication without Time Delay , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[11]  Wayne J. Book,et al.  Control Techniques and Programming Issues for Time Delayed Internet Based Teleoperation , 2003 .

[12]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[13]  Antonio Ortega,et al.  A comparison of different haptic compression techniques , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[14]  S. Hirche,et al.  Bilateral teleoperation over the internet: the time varying delay problem , 2003, Proceedings of the 2003 American Control Conference, 2003..

[15]  Mark W. Spong,et al.  PASSIVATION OF FORCE REFLECTING BILATERAL TELEOPERATORS WITH TIME VARYING DELAY , 2002 .

[16]  Stefano Stramigioli,et al.  Dealing with unreliabilities in digital passive geometric telemanipulation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  Jean-Jacques E. Slotine,et al.  Towards force-reflecting teleoperation over the Internet , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[18]  Stefano Stramigioli,et al.  About the Use of Port Concepts for Passive Geometric Telemanipulation with Varying Time Delays , 2002 .

[19]  Ernst Heinrich Weber Die Lehre vom Tastsinne und Gemeingefühle auf Versuche gegründet , 1851 .

[20]  Tsuneo Yoshikawa,et al.  Bilateral control with time-varying delay including communication blackout , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[21]  S. Munir,et al.  Internet-based teleoperation using wave variables with prediction , 2002 .

[22]  Nikita Barabanov,et al.  Position and force tracking in bilateral teleoperation , 2004 .

[23]  S. A. Stoeter,et al.  Proceedings - IEEE International Conference on Robotics and Automation , 2003 .

[24]  Eckehard G. Steinbach,et al.  Disposal of explosive ordnances by use of a bimanual haptic telepresence system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[25]  Kazuhiro Kosuge,et al.  Bilateral feedback control of telemanipulators via computer network , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[26]  Christoph W. Borst,et al.  Predictive coding for efficient host-device communication in a pneumatic force-feedback display , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.