Advanced Algorithms in Medical Computer Graphics

Advanced algorithms and efficient visualization techniques are of major importance in intra-operative imaging and image-guided surgery. The surgical environment is characterized by a high information flow and fast decisions, requiring efficient and intuitive presentation of complex medical data and precision in the visualization results. Regions or organs that are classified as risk structures are in this context of particular interest. This paper summarizes advanced algorithms for medical visualization with special focus on risk structures such as tumors, vascular systems and white matter fiber tracts. algorithms and techniques employed in intra-operative situations or virtual and mixed reality simulations are discussed. Finally, the prototyping and software development process of medical visualization algorithms is addressed.

[1]  Carl-Fredrik Westin,et al.  Diffusion Tensor Visualization with Glyph Packing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[2]  Zhizhou Wang,et al.  DTI segmentation using an information theoretic tensor dissimilarity measure , 2005, IEEE Transactions on Medical Imaging.

[3]  Anders Ynnerman,et al.  Uncertainty Visualization in Medical Volume Rendering Using Probabilistic Animation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[4]  A. Anderson,et al.  Classification and quantification of neuronal fiber pathways using diffusion tensor MRI , 2003, Magnetic resonance in medicine.

[5]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[6]  Carl-Fredrik Westin,et al.  Uncertainty in White Matter Fiber Tractography , 2005, MICCAI.

[7]  Markus Hadwiger,et al.  High-quality two-level volume rendering of segmented data sets on consumer graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[8]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[9]  Gareth J. Barker,et al.  Estimating distributed anatomical connectivity using fast marching methods and diffusion tensor imaging , 2002, IEEE Transactions on Medical Imaging.

[10]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[11]  Bernhard Preim,et al.  Visualization of vasculature with convolution surfaces: method, validation and evaluation , 2005, IEEE Transactions on Medical Imaging.

[12]  Karol Myszkowski,et al.  Fast collision detection between complex solids using rasterizing graphics hardware , 1995, The Visual Computer.

[13]  Dinesh K. Pai,et al.  BD-tree: output-sensitive collision detection for reduced deformable models , 2004, ACM Trans. Graph..

[14]  Dirk Bartz,et al.  Occlusion handling for medical augmented reality using a volumetric phantom model , 2004, VRST '04.

[15]  Brian A. Wandell,et al.  800Exploration of the brain's white matter pathways with dynamic queries , 2004, IEEE Visualization 2004.

[16]  Simon Stegmaier,et al.  A simple and flexible volume rendering framework for graphics-hardware-based raycasting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[17]  Stephen D. Laycock,et al.  Collision Detection for Deformable Objects using Octrees , 2006, TPCG.

[18]  Richard A. Robb,et al.  ANALYZE: a software system for biomedical image analysis , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[19]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[20]  B. Tomandl,et al.  CT angiography of intracranial aneurysms: a focus on postprocessing. , 2004, Radiographics : a review publication of the Radiological Society of North America, Inc.

[21]  Jules Bloomenthal,et al.  Convolution surfaces , 1991, SIGGRAPH.

[22]  Ming C. Lin,et al.  Fast penetration depth estimation for elastic bodies using deformed distance fields , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[23]  Bernhard Preim,et al.  Intraoperative augmented reality for minimally invasive liver interventions , 2003, SPIE Medical Imaging.

[24]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[25]  Markus Hadwiger,et al.  Real‐Time Ray‐Casting and Advanced Shading of Discrete Isosurfaces , 2005, Comput. Graph. Forum.

[26]  Christopher Nimsky,et al.  Analysis and Visualization of the Brain Shift Phenomenon in Neurosurgery , 1999 .

[27]  David H. Laidlaw,et al.  Visualization and image processing of tensor fields , 2006 .

[28]  Carl-Fredrik Westin,et al.  A Bayesian approach for stochastic white matter tractography , 2006, IEEE Transactions on Medical Imaging.

[29]  Stefan Bruckner,et al.  Memory efficient acceleration structures and techniques for CPU-based volume raycasting of large data , 2004 .

[30]  Helmut Seibert,et al.  A flexible tracking concept applied to medical scenarios using an AR window , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[31]  Gordon Kindlmann,et al.  Superquadric tensor glyphs , 2004, VISSYM'04.

[32]  Marie-Paule Cani,et al.  Real-Time Simulation of Self-collisions for Virtual Intestinal Surgery , 2003, IS4TH.

[33]  Charl P. Botha,et al.  Fast and reproducible fiber bundle selection in DTI visualization , 2005 .

[34]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[35]  Stan Melax,et al.  Dynamic Plane Shifting BSP Traversal , 2000, Graphics Interface.

[36]  Milan Sonka,et al.  Computer Aided Liver Surgery Planning Based on Augmented Reality Techniques , 2003, Bildverarbeitung für die Medizin.

[37]  Klaus Mueller,et al.  GPU accelerated image aligned splatting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[38]  Anna Vilanova,et al.  DTI visualization with streamsurfaces and evenly-spaced volume seeding , 2004, VISSYM'04.

[39]  W. Eric L. Grimson,et al.  Automated Atlas-Based Clustering of White Matter Fiber Tracts from DTMRI , 2005, MICCAI.

[40]  Heinz-Otto Peitgen,et al.  Efficient fiber clustering using parameterized polynomials , 2008, SPIE Medical Imaging.

[41]  Knut Hartmann,et al.  Illustrative shadows: integrating 3D and 2D information displays , 2003, IUI '03.

[42]  Gordon L. Kindlmann,et al.  Tensorlines: advection-diffusion based propagation through diffusion tensor fields , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[43]  Anna Vilanova,et al.  Determination of mouse skeletal muscle architecture using three‐dimensional diffusion tensor imaging , 2005, Magnetic resonance in medicine.

[44]  Douglas C. Schmidt,et al.  Object-oriented application frameworks , 1997, CACM.

[45]  Ruzena Bajcsy,et al.  Similarity Measures for Matching Diffusion Tensor Images , 1999, BMVC.

[46]  Gabriel Zachmann,et al.  Geometric data structures for computer graphics , 2002, Eurographics.

[47]  Ron Kikinis,et al.  White Matter Tractography Using Sequential Importance Sampling , 2002 .

[48]  C Nimsky,et al.  Uncertainty in diffusion tensor based fibre tracking. , 2006, Acta neurochirurgica. Supplement.

[49]  Jean-Christophe Lombardo,et al.  Real-time collision detection for virtual surgery , 1999, Proceedings Computer Animation 1999.

[50]  Gabriel Zachmann,et al.  Point cloud surfaces using geometric proximity graphs , 2004, Comput. Graph..

[51]  Yonggang Lu,et al.  Improved fiber tractography with Bayesian tensor regularization , 2006, NeuroImage.

[52]  Philip M. Hubbard,et al.  Approximating polyhedra with spheres for time-critical collision detection , 1996, TOGS.

[53]  Gabriel Zachmann,et al.  Point Cloud Collision Detection , 2004, Comput. Graph. Forum.

[54]  Thomas Ertl,et al.  Smart Hardware-Accelerated Volume Rendering , 2003, VisSym.

[55]  T. Ebbers,et al.  Particle trace visualization of intracardiac flow using time‐resolved 3D phase contrast MRI , 1999, Magnetic resonance in medicine.

[56]  Yiorgos Chrysanthou,et al.  Fast Cloth Animation on Walking Avatars , 2001, Comput. Graph. Forum.

[57]  Derek K Jones,et al.  Applications of diffusion‐weighted and diffusion tensor MRI to white matter diseases – a review , 2002, NMR in biomedicine.

[58]  Bernhard Preim,et al.  Visualization in Medicine: Theory, Algorithms, and Applications , 2007 .

[59]  Katja Bühler,et al.  Surface models of tube trees , 2004 .

[60]  C. Westin,et al.  A method for clustering white matter fiber tracts. , 2006, AJNR. American journal of neuroradiology.

[61]  Dinesh Manocha,et al.  Rapid and Accurate Contact Determination between Spline Models using ShellTrees , 1998, Comput. Graph. Forum.

[62]  Markus Hadwiger,et al.  Perspective Isosurface and Direct Volume Rendering for Virtual Endoscopy Applications , 2006, EuroVis.

[63]  Michael Gervautz,et al.  Occlusion in collaborative augmented environments , 1999, Comput. Graph..

[64]  Hanspeter Pfister,et al.  The VolumePro real-time ray-casting system , 1999, SIGGRAPH.

[65]  Mikio Shinya,et al.  Interference detection through rasterization , 1991, Comput. Animat. Virtual Worlds.

[66]  Joe Michael Kniss,et al.  Interactive Texture-Based Volume Rendering for Large Data Sets , 2001, IEEE Computer Graphics and Applications.

[67]  Katja Bühler,et al.  Geometric Methods for Vessel Visualization and Quantification — A Survey , 2004 .

[68]  Heinz-Otto Peitgen,et al.  An Application Framework for Rapid Prototyping of Clinically Applicable Software Assistants , 2006, GI Jahrestagung.

[69]  Terry M. Peters,et al.  Mixed Reality Merging of Endoscopic Images and 3-D Surfaces , 2000, MICCAI.

[70]  C. Henriquez,et al.  Magnetic resonance myocardial fiber-orientation mapping with direct histological correlation. , 1998, American journal of physiology. Heart and circulatory physiology.

[71]  Gino van den Bergen.  Efficient Collision Detection of Complex Deformable Models using AABB Trees , 1997, J. Graphics, GPU, & Game Tools.

[72]  Dongliang Zhang,et al.  Collision detection for clothed human animation , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[73]  Markus H. Gross,et al.  Signed distance transform using graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[74]  Hans-Heino Ehricke,et al.  Visualization of vasculature from volume data , 1994, Comput. Graph..

[75]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[76]  Gabriel Zachmann,et al.  Rapid collision detection by dynamically aligned DOP-trees , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[77]  Gabriel Zachmann,et al.  Minimal hierarchical collision detection , 2002, VRST '02.

[78]  Laurent Grisoni,et al.  An intestinal surgery simulator: real-time collision processing and visualization , 2004, IEEE Transactions on Visualization and Computer Graphics.

[79]  David H. Laidlaw,et al.  Visualizing Diffusion Tensor MR Images Using Streamtubes and Streamsurfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[80]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[81]  David E. Breen,et al.  Level Set Modeling and Segmentation of DT-MRI Brain Data , 2001 .

[82]  Joe Michael Kniss,et al.  Statistically quantitative volume visualization , 2005, VIS 05. IEEE Visualization, 2005..

[83]  Christos Trantakis,et al.  Neuronavigation based on intraoperative 3D-ultrasound during tumor resection , 2005 .

[84]  Zhengwei Yang,et al.  Invariant matching and identification of curves using B-splines curve representation , 1995, IEEE Trans. Image Process..

[85]  Heinz-Otto Peitgen,et al.  Grid-based spectral fiber clustering , 2007, SPIE Medical Imaging.

[86]  Bernhard Preim,et al.  Virtual 3D Puzzles: A New Method for Exploring Geometric Models in VR , 2001, IEEE Computer Graphics and Applications.

[87]  Thomas Lange,et al.  Vessel-Based Non-Rigid Registration of MR/CT and 3D Ultrasound for Navigation in Liver Surgery , 2003, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[88]  Andreas Kolb,et al.  Opacity Peeling for Direct Volume Rendering , 2006, Comput. Graph. Forum.

[89]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[90]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[91]  A. Gress,et al.  Object-space interference de-tection on programmable graphics hardware , 2003 .

[92]  Bernhard Preim,et al.  Implicit vessel surface reconstruction for visualization and CFD simulation , 2008, International Journal of Computer Assisted Radiology and Surgery.

[93]  P. Sundgren,et al.  Diffusion tensor imaging of the brain: review of clinical applications , 2004, Neuroradiology.

[94]  Stefan Bruckner,et al.  Semantic Layers for Illustrative Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[95]  Dirk Bartz,et al.  Augmented reality interaction for semiautomatic volume classification , 2005, EGVE'05.

[96]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[97]  Bernhard Preim,et al.  Real-Time Illustration of Vascular Structures , 2006, IEEE Transactions on Visualization and Computer Graphics.

[98]  Dirk Bartz,et al.  Virtual Endoscopy in Research and Clinical Practice , 2005, Comput. Graph. Forum.

[99]  Josie Wernecke,et al.  The inventor mentor - programming object-oriented 3D graphics with Open Inventor, release 2 , 1993 .

[100]  Bernhard Preim,et al.  Visualization and interaction techniques for the exploration of vascular structures , 2001, Proceedings Visualization, 2001. VIS '01..

[101]  Richard L. Grimsdale,et al.  Collision Detection for Animation using Sphere‐Trees , 1995, Comput. Graph. Forum.

[102]  Xavier Bresson,et al.  White matter fiber tract segmentation in DT-MRI using geometric flows , 2005, Medical Image Anal..

[103]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[104]  François Faure,et al.  Hierarchy Accelerated Stochastic Collision Detection , 2004, VMV.

[105]  Dinesh Manocha,et al.  Fast and reliable collision culling using graphics hardware , 2005, SIGGRAPH Courses.

[106]  Christof Rezk-Salama,et al.  High-Level User Interfaces for Transfer Function Design with Semantics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[107]  Lukas Mroz,et al.  RTVR-a flexible Java library for interactive volume rendering , 2001, Proceedings Visualization, 2001. VIS '01..

[108]  George Baciu,et al.  Hardware-assisted self-collision for deformable surfaces , 2002, VRST '02.

[109]  Simon Stegmaier,et al.  Exploiting frame-to-frame coherence for accelerating high-quality volume raycasting on graphics hardware , 2005, VIS 05. IEEE Visualization, 2005..

[110]  David E. Breen,et al.  Interactive Occlusion and Automatic Object Placement for Augmented Reality , 1996, Comput. Graph. Forum.

[111]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[112]  Daniel Thalmann,et al.  An Adaptive Spatial Subdivision of the Object Space for Fast Collision Detection of Animated Rigid Bodies , 1995, Comput. Graph. Forum.

[113]  Fabio Ganovelli,et al.  BucketTree: Improving Collision Detection Between Deformable Objects , 2000 .

[114]  Anna Vilanova,et al.  Evaluation of fiber clustering methods for diffusion tensor imaging , 2005, VIS 05. IEEE Visualization, 2005..

[115]  Yoshifumi Kitamura,et al.  A Real-Time Algorithm for Accurate Collision Detection for Deformable Polyhedral Objects , 1998, Presence.

[116]  Gilles Debunne,et al.  Monte-Carlo collision detection , 2004 .

[117]  Susumu Mori,et al.  Fiber tracking: principles and strategies – a technical review , 2002, NMR in biomedicine.

[118]  Carl-Fredrik Westin,et al.  Geometrically constrained two-tensor model for crossing tracts in DWI. , 2006, Magnetic resonance imaging.

[119]  Ken Masamune,et al.  Region-Growing Based Feature Extraction Algorithm for Tree-Like Objects , 1996, VBC.

[120]  Steven G. Parker,et al.  Biomedical computing and visualization software environments , 2004, CACM.

[121]  Anders Ynnerman,et al.  Full Body Virtual Autopsies using a State-of-the-art Volume Rendering Pipeline , 2006, IEEE Transactions on Visualization and Computer Graphics.

[122]  Ronald N. Perry,et al.  Adaptively sampled distance fields: a general representation of shape for computer graphics , 2000, SIGGRAPH.

[123]  George Baciu,et al.  Image-Based Techniques in a Hybrid Collision Detector , 2003, IEEE Trans. Vis. Comput. Graph..

[124]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[125]  Peter Hastreiter,et al.  High performance volume splatting for visualization of neurovascular data , 2005, VIS 05. IEEE Visualization, 2005..

[126]  Chris R. Johnson,et al.  NHI-NSF Visualization Research Challenges Report , 2005 .

[127]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[128]  Guido Gerig,et al.  Symbolic Description of 3-D Structures Applied to Cerebral Vessel Tree Obtained from MR Angiography Volume Data , 1993, IPMI.

[129]  B. M. ter Haar Romeny,et al.  Visualization of the fibrous structure of the heart , 2006 .

[130]  Bernhard Preim,et al.  Interactive Visual Analysis of Perfusion Data , 2007, IEEE Transactions on Visualization and Computer Graphics.

[131]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[132]  Thomas Lange,et al.  Augmenting Intraoperative 3D Ultrasound with Preoperative Models for Navigation in Liver Surgery , 2004, MICCAI.

[133]  Arnulph Fuhrmann,et al.  Distance Fields for Rapid Collision Detection in Physically Based Modeling , 2003 .

[134]  O Ganslandt,et al.  Preliminary experience in glioma surgery with intraoperative high-field MRI. , 2003, Acta neurochirurgica. Supplement.

[135]  James K Takayesu,et al.  A comprehensive medical simulation education curriculum for emergency medicine residents. , 2007, Annals of emergency medicine.

[136]  Joachim Gudmundsson,et al.  Box-Trees and R-Trees with Near-Optimal Query Time , 2001, SCG '01.

[137]  Joseph S. B. Mitchell,et al.  Efficient Collision Detection Using Bounding Volume Hierarchies of k-DOPs , 1998, IEEE Trans. Vis. Comput. Graph..

[138]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[139]  Gordon L. Kindlmann,et al.  Strategies for Direct Volume Rendering of Diffusion Tensor Fields , 2000, IEEE Trans. Vis. Comput. Graph..

[140]  Greg Turk,et al.  Interactive Collision Detection for Molecular Graphics , 1990 .

[141]  Dirk Bartz,et al.  Medical Augmented Reality based on Commercial Image Guided Surgery , 2004, EGVE.

[142]  Lukas Mroz,et al.  Advanced virtual endoscopic pituitary surgery , 2005, IEEE Transactions on Visualization and Computer Graphics.

[143]  Ming C. Lin,et al.  Accurate and Fast Proximity Queries Between Polyhedra Using Convex Surface Decomposition , 2001, Comput. Graph. Forum.

[144]  Tomas Akenine-Möller,et al.  Collision Detection for Continuously Deforming Bodies , 2001, Eurographics.