Virtual reality and medicine: from training systems to performance machines

The paper reviews a decade of work in applying virtual reality to medicine. Beginning with a brief history of simulations and surgery, we present a background to surgery simulators and then discuss the problem of limited human body models in past systems. We present our work at developing human body models beginning with the first virtual reality leg simulator in 1989. This model allowed simple tendon transfers and osteotomies with the computer able to predict the resulting mechanics and ability to walk. We also discuss the leg model's evolution into a performance machine which will allow a surgeon to predict position and subsequent function of an Anterior Cruciate Ligament (ACL) repair. This is paralleled by Department of Defense work on a leg model that can have a simulated wound and predicts blood loss and its ability to function. We review computer aided surgery and virtual reality technologies. We then present our work in plastic surgery computer aided planning and predict the importance of this work for surgical training.

[1]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[2]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[3]  S. Delp,et al.  Effects of hip center location on the moment-generating capacity of the muscles. , 1993, Journal of biomechanics.

[4]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[5]  W. Larrabee,et al.  A finite element model of skin deformation. III. The finite element model , 1986, The Laryngoscope.

[6]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[7]  K Ono,et al.  Computer‐Aided Analysis of Z‐Plasties , 1989, Plastic and reconstructive surgery.

[8]  F. Zajac,et al.  Force- and moment-generating capacity of lower-extremity muscles before and after tendon lengthening. , 1992, Clinical orthopaedics and related research.

[9]  S. J. McKenna,et al.  Wound ballistics. A review of common misconceptions , 1988 .

[10]  Cagatay Basdogan,et al.  Surgical simulation: an emerging technology for military medical training , 1995, Proceedings of the National Forum: Military Telemedicine On-Line Today Research, Practice, and Opportunities.

[11]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[12]  M Motoyoshi,et al.  Finite element model of facial soft tissue. Deformation following surgical correction. , 1992, The Journal of Nihon University School of Dentistry.

[13]  R C Mattison.  Facial Video Image Processing: Standard Facial Image Capturing, Software Modification, Development of a Surgical Plan, and Comparison of Presurgical and Postsurgical Results , 1992, Annals of plastic surgery.

[14]  M B Constantian,et al.  The expert teaching system: a new method for learning rhinoplasty using interactive computer graphics. , 1987, Plastic and reconstructive surgery.

[15]  R. Kikinis,et al.  Computer‐Assisted Three‐Dimensional Planning in Craniofacial Surgery , 1993, Plastic and reconstructive surgery.

[16]  W. Lorensen,et al.  Two algorithms for the three-dimensional reconstruction of tomograms. , 1988, Medical physics.

[17]  R N Haber,et al.  Flight simulation. , 1986, Scientific American.

[18]  M L Fackler,et al.  Gunshot wounds: 1. Bullets, ballistics, and mechanisms of injury. , 1990, AJR. American journal of roentgenology.

[19]  J. M. Rolfe,et al.  Flight simulation , 1988 .

[20]  M Motoyoshi,et al.  Finite element model of facial soft tissue. Effects of thickness and stiffness on changes following simulation of orthognathic surgery. , 1993, The Journal of Nihon University School of Dentistry.

[21]  J. Foley.  Interfaces for advanced computing , 1987 .

[22]  Steven D. Pieper,et al.  Hands-on interaction with virtual environments , 1989, UIST '89.

[23]  F L Bookstein,et al.  Three‐Dimensional Computer‐Assisted Design of Craniofacial Surgical Procedures: Optimization and Interaction with Cephalometric and CT‐Based Models , 1986, Plastic and reconstructive surgery.

[24]  Michael McKenna.  A physically based human figure model with a complex foot and low level behavior control , 1995 .