Distributed virtual environment for intravascular tele-surgery using multimedia telecommunication

The number of specialized medical doctors is decreasing. It is important to assist doctors in their operation of surgical tools. To solve this problem, we propose a distributed VR system using multimedia telecommunication for training, diagnosis, and assistance in surgery. To realize this system, it is important to exchange high quality moving pictures. We use high speed optical fiber network with ATM (Asynchronous Transfer Mode). ATM has excellent features such as bandwidth allocation which is suitable for multimedia communication on computer networks. Based on this new information infrastructure we built a prototype telesurgery system for intravascular neurosurgery. We made a virtual simulator for the operation of a catheter, that is designed for minimum invasive surgery inside complex and narrow brain blood vessels. A force display and visual assistance method are proposed to assist the doctor. We undertook teleoperation experiments between Nagoya and Tokyo, about 350 km away each other, using high speed optical fiber network, and evaluated the effectiveness of the proposed system.

[1]  James Gordon,et al.  Organization of voluntary movement , 1991, Current Opinion in Neurobiology.

[2]  John W. Hill,et al.  Telepresence surgery demonstration system , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Fumihito Arai,et al.  Intelligent assistance for intravascular tele-surgery and experiments on virtual simulator , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[4]  A. Streri.  Seeing, Reaching, Touching: The Relations Between Vision and Touch in Infancy , 1993 .

[5]  A. Leslie,et al.  Do six-month-old infants perceive causality? , 1987, Cognition.

[6]  B. Stein,et al.  The Merging of the Senses , 1993 .

[7]  P Schmalbrock,et al.  Echo‐Time Reduction for Submillimeter Resolution Imaging with a 3D Phase Encode Time Reduced Acquisition Method , 1995, Magnetic resonance in medicine.

[8]  Fumihito Arai,et al.  Interactive adaptive interface using recursive fuzzy reasoning , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[9]  Pat Hanrahan,et al.  Hierarchical splatting: a progressive refinement algorithm for volume rendering , 1991, SIGGRAPH.

[10]  Craig M. Wittenbrink.  IFS fractal interpolation for 2D and 3D visualization , 1995, Proceedings Visualization '95.

[11]  Mamoru Mitsuishi,et al.  A tele-micro-surgery system across the Internet with a fixed viewpoint/operation-point , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[12]  Terrence Fernando,et al.  A distributed virtual environment for concurrent engineering , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[13]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[14]  C Ghez,et al.  Roles of proprioceptive input in the programming of arm trajectories. , 1990, Cold Spring Harbor symposia on quantitative biology.

[15]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[16]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  P Schmalbrock,et al.  Phased Array RF Coils for High‐Resolution MRI of the Inner Ear and Brain Stem , 1995, Journal of computer assisted tomography.

[18]  Kenneth Y. Goldberg,et al.  Desktop teleoperation via the World Wide Web , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[19]  P. Dario,et al.  A miniature device for medical intracavitary intervention , 1991, [1991] Proceedings. IEEE Micro Electro Mechanical Systems.

[20]  H. Stammberger,et al.  Functional Endoscopic Sinus Surgery: The Messerklinger Technique , 1991 .

[21]  John Rohlf,et al.  IRIS performer: a high performance multiprocessing toolkit for real-time 3D graphics , 1994, SIGGRAPH.

[22]  Roni Yagel,et al.  Visibility Computation for Efficient Walkthrough of Complex Environments , 1996, Presence: Teleoperators & Virtual Environments.

[23]  Jayaram K. Udupa,et al.  Interactive surgical planning: High-speed object rendition and manipulation without specialized hardware , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[24]  Kazuhiro Kosuge,et al.  Micro active catheter system with multi degrees of freedom , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[25]  J. Kelso,et al.  Exploring a vibratory systems analysis of human movement production. , 1980, Journal of neurophysiology.