Combating Latency in Haptic Collaborative Virtual Environments

Haptic (force) feedback is increasingly being used in surgical-training simulators. The addition of touch is important extra information that can add another dimension to the realism of the experience. Progress in networking these systems together over long distances has been held back, principally because the latency of the network can induce severe instability in any dynamic objects in the scene. This paper describes techniques allowing long-distance sharing of haptic-enabled, dynamic scenes. At the CSIRO Virtual Environments Laboratory, we have successfully used this system to connect a prototype of a surgical-simulation application between participants on opposite sides of the world in Sweden and Australia, over a standard Internet connection spanning 3 continents and 2 oceans. The users were able to simultaneously manipulate pliable objects in a shared workspace, as well as guide each other's hands (and shake hands!) over 22,000 km (13620 miles) of Internet connection. The main obstacle to overcome was the latency-induced instability in the system, caused by the delays and jitter inherent in the network. Our system involved a combination of an event-collection mechanism, a network event-forwarding mechanism and a pseudophysics mechanism. We found that the resulting behavior of the interconnected body organs, under simultaneous-user manipulation, was sufficiently convincing to be considered for training surgical procedures.

[1]  Kunikatsu Takase,et al.  Multioperator Teleoperation of Multirobot Systems with Time Delay: Part IAids for Collision-Free Control , 2002, Presence: Teleoperators & Virtual Environments.

[2]  Chris Gunn,et al.  Collaborative virtual sculpting with haptic feedback , 2006, Virtual Reality.

[3]  W. Richard Stevens,et al.  Unix network programming , 1990, CCRV.

[4]  Alana Sherman,et al.  Bilateral controller design for telemanipulation in soft environments , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Gaurav S. Sukhatme,et al.  Haptic Collaboration over the Internet , 2000 .

[6]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[7]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[8]  Ian Oakley,et al.  Can You Feel the Force? An Investigation of Haptic Collaboration in Shared Editors , 2001 .

[9]  Hiroo Iwata,et al.  Haptic interfaces , 2002 .

[10]  Blake Hannaford,et al.  Architectures for shared haptic virtual environments , 1997, Comput. Graph..

[11]  Ian Oakley,et al.  Communicating with Feeling , 2000, Haptic Human-Computer Interaction.

[12]  Kunikatsu Takase,et al.  Multioperator Teleoperation of Multirobot Systems with Time Delay: Part IITestbed Description , 2002, Presence: Teleoperators & Virtual Environments.

[13]  Jack McLaughlin,et al.  Haptic Workbench: a multisensory virtual environment , 1999, Electronic Imaging.

[14]  W. Richard Stevens,et al.  UNIX network programming, 2nd Edition , 1998 .

[15]  Jed Hartman,et al.  The VRML 2.0 handbook - building moving worlds on the web , 1996 .

[16]  F. Bogsanyi,et al.  Tool and object based synchronization in collaborative haptics , 2002, IEEE International Workshop HAVE Haptic Virtual Environments and Their.