Encountered-type haptic interface for virtual interaction with real objects based on implicit surface haptic rendering for remote palpation

The shortage of physicians afflicting developed countries encourages engineers and doctors to collaborate towards the development of telemedicine. In particular, robotic systems have the potential for helping doctors making examination. A very common examination that can be the goal of a robotic system is palpation. Most of the robotics systems that have been developed for palpation present interesting features such as integrating augmented reality environments or allowing for hand free interaction. In this paper we present a novel palpation system that allows us to perform virtual palpation of real objects by means of a haptic and an augmented reality feedback. This system features an encountered-type haptic interface in which the haptic feedback is calculated by a collision detection algorithm that is based on online recording of the surface to be touched. The system allows the users to remove their hand from the haptic interface end-effector that follows the user's hand thanks to the tracking performed by a Leap Motion. We show that the system provides a natural interaction during the contact-non contact switch, a suitable force during indentation, and it allows to discriminate objects within the body through the haptic channel.

[1]  Alexei Sourin,et al.  Virtual Palpation for Medical Training in Cyberworlds , 2012, 2012 International Conference on Cyberworlds.

[2]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[3]  Carlo Alberto Avizzano,et al.  Encountered haptic Augmented Reality interface for remote examination , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  G. Poisson,et al.  Use of a robotic arm to perform remote abdominal telesonography. , 2007, AJR. American journal of roentgenology.

[5]  Geoff Wyvill,et al.  Data structure forsoft objects , 1986, The Visual Computer.

[6]  Dominiek Reynaerts,et al.  Towards Palpation in Virtual Reality by an Encountered-Type Haptic Screen , 2014, EuroHaptics.

[7]  Manfred Tscheligi,et al.  Towards a remote medical diagnostician for medical examination , 2014 .

[8]  K. Salisbury,et al.  Haptic Rendering of Surfaces Defined by Implicit Functions , 1997, Dynamic Systems and Control.

[9]  Rajnikant V. Patel,et al.  Remote palpation to localize tumors in robot-assisted minimally invasive approach , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Carlo Alberto Avizzano,et al.  Immersive ROS-integrated framework for robot teleoperation , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[11]  Marc Alexa,et al.  Approximating and Intersecting Surfaces from Points , 2003, Symposium on Geometry Processing.

[12]  R. Webster,et al.  Advanced technologies for gastrointestinal endoscopy. , 2012, Annual review of biomedical engineering.

[13]  John Kenneth Salisbury,et al.  Voxel-Based Haptic Rendering Using Implicit Sphere Trees , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[14]  Y. Kinfu,et al.  Forecasting the global shortage of physicians: an economic- and needs-based approach. , 2008, Bulletin of the World Health Organization.

[15]  Darwin G. Caldwell,et al.  Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation , 2011, IEEE Transactions on Haptics.

[16]  Mayank Srivastava,et al.  The virtual haptic back for palpatory training , 2004, ICMI '04.

[17]  Suwoong Lee,et al.  Development of haptic devices using flexible sheets for virtual training of abdominal palpation , 2014, Adv. Robotics.

[18]  Christophe Rosenberger,et al.  A tele-operated mobile ultrasound scanner using a light-weight robot , 2005, IEEE Transactions on Information Technology in Biomedicine.

[19]  Antonio Frisoli,et al.  Design and validation of a complete haptic system for manipulative tasks , 2006, Adv. Robotics.