Sampling and Visualizing Creases with Scale-Space Particles

Particle systems have gained importance as a methodology for sampling implicit surfaces and segmented objects to improve mesh generation and shape analysis. We propose that particle systems have a significantly more general role in sampling structure from unsegmented data. We describe a particle system that computes samplings of crease features (i.e. ridges and valleys, as lines or surfaces) that effectively represent many anatomical structures in scanned medical data. Because structure naturally exists at a range of sizes relative to the image resolution, computer vision has developed the theory of scale-space, which considers an n-D image as an (n + 1)-D stack of images at different blurring levels. Our scale-space particles move through continuous four-dimensional scale-space according to spatial constraints imposed by the crease features, a particle-image energy that draws particles towards scales of maximal feature strength, and an inter-particle energy that controls sampling density in space and scale. To make scale-space practical for large three-dimensional data, we present a spline-based interpolation across scale from a small number of pre-computed blurrings at optimally selected scales. The configuration of the particle system is visualized with tensor glyphs that display information about the local Hessian of the image, and the scale of the particle. We use scale-space particles to sample the complex three-dimensional branching structure of airways in lung CT, and the major white matter structures in brain DTI.

[1]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[2]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[3]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[4]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Tony Lindeberg,et al.  Scale-Space for Discrete Signals , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  SzeliskiRichard,et al.  Surface modeling with oriented particle systems , 1992 .

[7]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[8]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[9]  Alex T. Pang,et al.  Spray rendering: Visualization using smart particles , 1993, Proceedings Visualization '93.

[10]  Richard Szeliski,et al.  Modeling surfaces of arbitrary topology with dynamic particles , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  John M. Gauch,et al.  Multiresolution Analysis of Ridges and Valleys in Grey-Scale Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Paul S. Heckbert,et al.  Using particles to sample and control implicit surfaces , 1994, SIGGRAPH.

[13]  T. Lindeberg Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[14]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[15]  Paul S. Heckbert,et al.  A Pliant Method for Anisotropic Mesh Generation , 1996 .

[16]  Márta Fidrich Iso-surface extraction in 4D with applications related to scale space , 1996, DGCI.

[17]  P. Basser,et al.  Toward a quantitative assessment of diffusion anisotropy , 1996, Magnetic resonance in medicine.

[18]  S. Pizer,et al.  Marching cores: a method for extracting cores from 3D medical images , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[19]  David H. Eberly,et al.  Ridges in Image and Data Analysis , 1996, Computational Imaging and Vision.

[20]  S. Pizer,et al.  Intensity ridge and widths for tubular object segmentation and description , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[21]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Dietmar Saupe,et al.  Interactive Visualization of Implicit Surfaces with Singularities , 1997, Comput. Graph. Forum.

[23]  Klaus Mueller,et al.  Evaluation and Design of Filters Using a Taylor Series Expansion , 1997, IEEE Trans. Vis. Comput. Graph..

[24]  Patricia J. Crossno,et al.  Isosurface extraction using particle systems , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[25]  P. Heckbert Fast Surface Particle Repulsion , 1997 .

[26]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[27]  Joan Serrat,et al.  Creaseness measures for CT and MR image registration , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[28]  Ronald Peikert,et al.  The "Parallel Vectors" operator-a vector field visualization primitive , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[29]  Alejandro F. Frangi,et al.  Model-based quantitation of 3-D magnetic resonance angiographic images , 1999, IEEE Transactions on Medical Imaging.

[30]  M. Raichle,et al.  Tracking neuronal fiber pathways in the living human brain. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[31]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[32]  Kenji Shimada,et al.  High Quality Anisotropic Tetrahedral Mesh Generation Via Ellipsoidal Bubble Packing , 2000, IMR.

[33]  C. Beaulieu,et al.  The basis of anisotropic water diffusion in the nervous system – a technical review , 2002, NMR in biomedicine.

[34]  Ronald Peikert,et al.  Vortex Tracking in Scale-Space , 2002, VisSym.

[35]  Stephen R. Aylward,et al.  Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction , 2002, IEEE Transactions on Medical Imaging.

[36]  Carl-Fredrik Westin,et al.  Processing and visualization for diffusion tensor MRI , 2002, Medical Image Anal..

[37]  Denis Le Bihan,et al.  Looking into the functional architecture of the brain with diffusion MRI , 2003, Nature Reviews Neuroscience.

[38]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[39]  P. Paré,et al.  The nature of small-airway obstruction in chronic obstructive pulmonary disease. , 2004, The New England journal of medicine.

[40]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[41]  Michael H. F. Wilkinson,et al.  CPM: a deformable model for shape recovery and segmentation based on charged particles , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[43]  Gordon Kindlmann,et al.  Superquadric tensor glyphs , 2004, VISSYM'04.

[44]  Atsushi Imiya,et al.  Linear Scale-Space has First been Proposed in Japan , 1999, Journal of Mathematical Imaging and Vision.

[45]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for volume visualization , 1999, IEEE Trans. Vis. Comput. Graph..

[46]  David H. Eberly,et al.  Ridges for image analysis , 1994, Journal of Mathematical Imaging and Vision.

[47]  Xiangmin Jiao,et al.  Parallel Feature-Preserving Mesh Smoothing , 2005, ICCSA.

[48]  Max A. Viergever,et al.  Linear scale-space , 1994, Journal of Mathematical Imaging and Vision.

[49]  John C. Hart,et al.  A programmable particle system framework for shape modeling , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[50]  Ross T. Whitaker,et al.  Robust particle systems for curvature dependent sampling of implicit surfaces , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[51]  Thomas Brox,et al.  PDEs for Tensor Image Processing , 2006, Visualization and Processing of Tensor Fields.

[52]  Miriah D. Meyer,et al.  Entropy-Based Particle Systems for Shape Correspondence , 2006 .

[53]  Rachid Deriche,et al.  Statistics on the Manifold of Multivariate Normal Distributions: Theory and Application to Diffusion Tensor MRI Processing , 2006, Journal of Mathematical Imaging and Vision.

[54]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[55]  John H. Gilmore,et al.  Improved Correspondence for DTI Population Studies Via Unbiased Atlas Building , 2006, MICCAI.

[56]  Bram van Ginneken,et al.  Computer analysis of computed tomography scans of the lung: a survey , 2006, IEEE Transactions on Medical Imaging.

[57]  Daniel Rueckert,et al.  Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data , 2006, NeuroImage.

[58]  Carl-Fredrik Westin,et al.  Delineating white matter structure in diffusion tensor MRI with anisotropy creases , 2007, Medical Image Anal..

[59]  Ross T. Whitaker,et al.  Particle Systems for Efficient and Accurate High-Order Finite Element Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[60]  Luc Florack,et al.  A generic approach to diffusion filtering of matrix-fields , 2007, Computing.

[61]  Ross T. Whitaker,et al.  Topology, Accuracy, and Quality of Isosurface Meshes Using Dynamic Particles , 2007, IEEE Transactions on Visualization and Computer Graphics.

[62]  Anna Vilanova,et al.  Particle-based non-photorealistic volume visualization , 2008, The Visual Computer.

[63]  Martin Styner,et al.  Shape Modeling and Analysis with Entropy-Based Particle Systems , 2007, IPMI.

[64]  R. Kikinis,et al.  A review of diffusion tensor imaging studies in schizophrenia. , 2007, Journal of psychiatric research.

[65]  Thomas Ertl,et al.  Scale-Space Tracking of Critical Points in 3D Vector Fields , 2007, Topology-based Methods in Visualization.

[66]  Carl-Fredrik Westin,et al.  Invariant Crease Lines for Topological and Structural Analysis of Tensor Fields , 2008, IEEE Transactions on Visualization and Computer Graphics.

[67]  Lars Linsen,et al.  Surface Extraction from Multi-field Particle Volume Data Using Multi-dimensional Cluster Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[68]  Ross T. Whitaker,et al.  Particle-based Sampling and Meshing of Surfaces in Multimaterial Volumes , 2008, IEEE Transactions on Visualization and Computer Graphics.

[69]  Luc Florack,et al.  A multi-resolution framework for diffusion tensor images , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[70]  Carl-Fredrik Westin,et al.  Tract-based morphometry for white matter group analysis , 2009, NeuroImage.

[71]  G. Kindlmann,et al.  Superquadric Glyphs for Symmetric Second-Order Tensors , 2010, IEEE Transactions on Visualization and Computer Graphics.

[72]  Hans-Peter Seidel,et al.  Crease Surfaces: From Theory to Extraction and Application to Diffusion Tensor MRI , 2010, IEEE Transactions on Visualization and Computer Graphics.