A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems

One of the key challenges in telepresence and teleaction systems is the fact that a global control loop is closed over a communication network. The transmission delay of haptic information is extremely critical. Therefore, new data samples from the haptic sensors are typically immediately forwarded to the receiver which leads to a large number of packets being generated when using the Internet as the communication infrastructure. We present a novel approach to reduce the number of packets and, therefore, the amount data communicated in a telepresence and teleaction system. Our method uses a passive deadband transmission approach which only delivers data packets over the network when the sampled sensor data changes more than a given threshold value. The threshold value is determined by psychophysical experiments. This approach leads to a considerable reduction (up to 90%) of packet rate and data rate without sacrificing the fidelity and immersiveness of the system.

[1]  S. Hirche,et al.  Packet loss effects in passive telepresence systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[3]  James Moyne,et al.  Using deadbands to reduce communication in networked control systems , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[4]  Eckehard G. Steinbach,et al.  Disposal of explosive ordnances by use of a bimanual haptic telepresence system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  S. Hirche,et al.  Bilateral teleoperation over the internet: the time varying delay problem , 2003, Proceedings of the 2003 American Control Conference, 2003..

[6]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[7]  Martin Buss,et al.  Control Problems in Multi-Modal Telepresence Systems , 1999 .