Distributed training system with high-resolution deformable virtual models

Virtual environments (VEs) allow the development of promising tools in several application domains. In medical training, the learning potential of VE is significantly amplified by the capability of the tools to present 3D deformable models in real-time. This paper presents a distributed software architecture that allows visualization of a 3D deformable lungs model superimposed on a human patient simulator at several remote trainee locations. The paper presents the integration of deformable 3D anatomical models in a distributed software architecture targeted towards medical prognostics and training, as well as the assessment of the shared state consistency across multiple users. The results of the assessment prove that with delay compensation, the distributed interactive VE prototype achieves high levels of shared state consistency.

[1]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[2]  François Faure.  Interactive Solid Animation Using Linearized Displacement Constraints , 1998, Computer Animation and Simulation.

[3]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[4]  Charles E. Hughes,et al.  Marker Mapping Techniques for Augmented Reality Visualisation , 2002 .

[5]  D. Schmalstieg,et al.  Distributed applications for collaborative augmented reality , 2002, Proceedings IEEE Virtual Reality 2002.

[6]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[7]  Felix G. Hamza-Lup.  - 1-Distributed Consistency Maintenance Scheme for Interactive Mixed Reality Environments , 2004 .

[8]  Jannick P. Rolland.  Model for Pre-Operative Visualization of COPD and Associated Dyspnea , 2003 .

[9]  Jason Daly,et al.  Development of a training tool for endotracheal intubation: distributed augmented reality. , 2003, Studies in health technology and informatics.

[10]  Long Chen.  INTRODUCTION TO FINITE ELEMENT METHODS , 2003 .

[11]  D. C. Miller,et al.  SIMNET: the advent of simulator networking , 1995, Proc. IEEE.

[12]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[13]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[14]  Michael Zyda,et al.  NPSNET: constructing a 3D virtual world , 1992, I3D '92.

[15]  Chris Greenhalgh,et al.  Inside MASSIVE-3: flexible support for data consistency and world structuring , 2000, CVE '00.

[16]  Dinesh K. Pai,et al.  Multiresolution green's function methods for interactive simulation of large-scale elastostatic objects , 2003, TOGS.

[17]  H Fuchs,et al.  Virtual environments technology to aid needle biopsies of the breast. An example of real-time data fusion. , 1996, Studies in health technology and informatics.

[18]  Michael Zyda,et al.  Exploiting reality with multicast groups , 1995, IEEE Computer Graphics and Applications.

[19]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2002, Comput. Graph..

[20]  Jannick P. Rolland,et al.  PRASAD: an augmented reality based non-invasive pre-operative visualization framework for lungs , 2004, IEEE Virtual Reality 2004.

[21]  Felix G. Hamza-Lup,et al.  Adaptive scene synchronization for virtual and mixed reality environments , 2004, IEEE Virtual Reality 2004.

[22]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[23]  Felix G. Hamza-Lup,et al.  Scene Synchronization for Real-Time Interaction in Distributed Mixed Reality and Virtual Reality Environments , 2004, Presence: Teleoperators & Virtual Environments.

[24]  Felix G. Hamza-Lup,et al.  Physically-based Deformation of High-Resolution 3D Lung Models for Augmented Reality based Medical Visualization , 2004 .

[25]  Gerald Quirchmayr,et al.  Through-Walls Communication for Medical Emergency Services , 2003, Int. J. Hum. Comput. Interact..

[26]  Hirokazu Kato,et al.  Collaborative augmented reality , 2002, CACM.

[27]  Mehdi Hamadou,et al.  ARVIKA – Augmented Reality für Entwicklung, Produktion und Service (ARVIKA – Augmented Reality for Development, Production and Service) , 2002, i-com.

[28]  Bari Hoffman-Ruddy,et al.  An adaptive driver and real-time deformation algorithm for visualization of high-density lung models. , 2004, Studies in health technology and informatics.

[29]  P.M. Sharkey,et al.  A local perception filter for distributed virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[30]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[31]  Demetri Terzopoulos,et al.  Modeling inelastic deformation: viscolelasticity, plasticity, fracture , 1988, SIGGRAPH.