Co-located haptic interaction for virtual USG exploration

Ultrasonography is a widespread diagnostic technique that can take advantage of virtual reality for the purpose of training and rehearsal. The placement, orientation and body interaction of the probe is fundamental for the execution of the exploration. This paper introduces a virtual reality setup that employs visuo-haptic feedback for virtual ultrasonography. The haptic feedback is provided by desktop delta-like haptic interface with a 3D printed ultrasonography probe, and features haptic point-cloud rendering with implicit surface rendering. The visual feedback is provided by a Head Mounted Display that displays the virtual body, the probe and the operator's hand while not in contact with the probe. The system provides a co-located experience by means of precise calibration of the reference system allowing to synchronize the display of the hand and the probe with the location of the corresponding physical entities.

[1]  Gábor Székely,et al.  Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[2]  Carlo Alberto Avizzano,et al.  Encountered haptic Augmented Reality interface for remote examination , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[3]  Carlo Alberto Avizzano,et al.  Immersive ROS-integrated framework for robot teleoperation , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  Oussama Khatib,et al.  Spanning large workspaces using small haptic devices , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[5]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[6]  Darwin G. Caldwell,et al.  Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation , 2011, IEEE Transactions on Haptics.

[7]  K. Salisbury,et al.  Haptic Rendering of Surfaces Defined by Implicit Functions , 1997, Dynamic Systems and Control.

[8]  Ulrich Eck,et al.  HARP: A framework for visuo-haptic augmented reality , 2013, 2013 IEEE Virtual Reality (VR).

[9]  Marc Alexa,et al.  Approximating and Intersecting Surfaces from Points , 2003, Symposium on Geometry Processing.