RepliExplore: coupling physical and virtual anatomy models

PurposeWe present a system which co-registers physical anatomy models with virtual three-dimensional (3D) representations. Interactions performed on the physical model by means of a 3D pointing device are directly reflected on its virtual counterpart. Complex anatomical information integrated into the virtual model thus becomes accessible through the physical interface in a simple and intuitive manner.MethodsUsing an optical tracking system, we implemented and tested a reference application that includes several tools for the exploration and quantification of anatomical models. We theoretically evaluated the accuracy of the landmark-based registration for different landmark configurations.ResultsPhysicians and computer scientists found the system simple to learn and intuitive to use. By optimizing landmark configurations, the accuracy could be significantly increased, particularly for scenarios in which only selected regions required higher accuracy.ConclusionsPhysical anatomical models can benefit from the combination with a virtual counterpart in several ways. Applications include anatomical education and the study of patient-individual organ models. Optimizing the registration landmark configuration for specific applications can lower the accuracy requirements for the tracking system.

[1]  J. McLachlan,et al.  Teaching anatomy without cadavers , 2004, Medical education.

[2]  Hans-Peter Meinzer,et al.  Stereolithographic reproduction of complex cardiac morphology based on high spatial resolution imaging , 2007, Clinical Research in Cardiology.

[3]  Lena Maier-Hein,et al.  Towards a Mixed Reality Environment for Preoperative Planning of Cardiac Surgery , 2009, MMVR.

[4]  Fernando Bello,et al.  Using multimedia and Web3D to enhance anatomy teaching , 2007, Comput. Educ..

[5]  Volkmar Falk,et al.  3D-Imaging of cardiac structures using 3D heart models for planning in heart surgery: a preliminary study. , 2008, Interactive cardiovascular and thoracic surgery.

[6]  R. Kneebone Simulation in surgical training: educational issues and practical implications , 2003, Medical education.

[7]  Nassir Navab,et al.  Simulation and Fully Automatic Multimodal Registration of Medical Ultrasound , 2007, MICCAI.

[8]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[9]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[10]  Jay B. West,et al.  Fiducial Point Placement and the Accuracy of Point-based, Rigid Body Registration , 2001, Neurosurgery.

[11]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[12]  Nassir Navab,et al.  Laparoscopic Virtual Mirror New Interaction Paradigm for Monitor Based Augmented Reality , 2007, 2007 IEEE Virtual Reality Conference.

[13]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[14]  Purang Abolmaesumi,et al.  A Theoretical Comparison of Different Target Registration Error Estimators , 2008, MICCAI.

[15]  E. Acosta,et al.  An interactive three‐dimensional virtual body structures system for anatomical training over the internet , 2006, Clinical anatomy.

[16]  Hyungjun Park,et al.  Tangible augmented prototyping of digital handheld products , 2009, Comput. Ind..

[17]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[18]  O. K. Hansen,et al.  Visualization of morphological details in congenitally malformed hearts: virtual three-dimensional reconstruction from magnetic resonance imaging , 2003, Cardiology in the Young.

[19]  Andreas Pommert,et al.  Computer-based anatomy a prerequisite for computer-assisted radiology and surgery. , 2006, Academic radiology.