Diffusion MRI visualization

Modern diffusion magnetic resonance imaging (dMRI) acquires intricate volume datasets and biological meaning can only be found in the relationship between its different measurements. Suitable strategies for visualizing these complicated data have been key to interpretation by physicians and neuroscientists, for drawing conclusions on brain connectivity and for quality control. This article provides an overview of visualization solutions that have been proposed to date, ranging from basic grayscale and color encodings to glyph representations and renderings of fiber tractography. A particular focus is on ongoing and possible future developments in dMRI visualization, including comparative, uncertainty, interactive and dense visualizations.

[1]  J. van Wijk,et al.  Spot noise texture synthesis for data visualization , 1991, SIGGRAPH.

[2]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[3]  Lambertus Hesselink,et al.  Visualizing second-order tensor fields with hyperstreamlines , 1993, IEEE Computer Graphics and Applications.

[4]  Hans-Christian Hege,et al.  Fast and resolution independent line integral convolution , 1995, SIGGRAPH.

[5]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[6]  P. Basser,et al.  Microstructural and physiological features of tissues elucidated by quantitative-diffusion-tensor MRI. , 1996, Journal of magnetic resonance. Series B.

[7]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[8]  P. Basser,et al.  Toward a quantitative assessment of diffusion anisotropy , 1996, Magnetic resonance in medicine.

[9]  H.-C. Hege,et al.  Interactive visualization of 3D-vector fields using illuminated stream lines , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[10]  David H. Eberly,et al.  Ridges in Image and Data Analysis , 1996, Computational Imaging and Vision.

[11]  Victoria Interrante,et al.  Strategies for effectively visualizing 3D flow with volume LIC , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[12]  Peter Hastreiter,et al.  Interactive exploration of volume line integral convolution based on 3D-texture mapping , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[13]  Carl-Fredrik Westin,et al.  Image Processing for Diffusion Tensor Magnetic Resonance Imaging , 1999, MICCAI.

[14]  P. V. van Zijl,et al.  Three‐dimensional tracking of axonal projections in the brain by magnetic resonance imaging , 1999, Annals of neurology.

[15]  Y. Cohen,et al.  Displacement imaging of spinal cord using q‐space diffusion‐weighted MRI , 2000, Magnetic resonance in medicine.

[16]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[17]  Sinisa Pajevic,et al.  Color schemes to represent the orientation of anisotropic tissues from diffusion tensor data: Application to white matter fiber tract mapping in the human brain , 1999, Magnetic resonance in medicine.

[18]  Gordon L. Kindlmann,et al.  Strategies for Direct Volume Rendering of Diffusion Tensor Fields , 2000, IEEE Trans. Vis. Comput. Graph..

[19]  Benjamin D. Greenberg,et al.  An immersive virtual environment for DT-MRI volume visualization applications: a case study , 2001, Proceedings Visualization, 2001. VIS '01..

[20]  Nc Usa,et al.  Generalized Line Integral Convolution Rendering of Diffusion Tensor Fields , 2001 .

[21]  Derek K. Jones,et al.  Spatial Normalization and Averaging of Diffusion Tensor MRI Data Sets , 2002, NeuroImage.

[22]  Jarke J. van Wijk,et al.  Image based flow visualization , 2002, ACM Trans. Graph..

[23]  Robert S. Laramee,et al.  Feature Extraction and Visualisation of Flow Fields , 2002, Eurographics.

[24]  T. Mareci,et al.  Generalized diffusion tensor imaging and analytical relationships between diffusion tensor imaging and high angular resolution diffusion imaging , 2003, Magnetic resonance in medicine.

[25]  Jean-Philippe Thiran,et al.  DTI mapping of human brain connectivity: statistical fibre tracking and virtual dissection , 2003, NeuroImage.

[26]  David H. Laidlaw,et al.  Visualizing Diffusion Tensor MR Images Using Streamtubes and Streamsurfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[27]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[28]  Derek K. Jones,et al.  Determining and visualizing uncertainty in estimates of fiber orientation from diffusion tensor MRI , 2003, Magnetic resonance in medicine.

[29]  Y. Hashash,et al.  Glyph and hyperstreamline representation of stress and strain tensors and material constitutive response , 2003 .

[30]  Burkhard Wünsche,et al.  Advanced Texturing Techniques for the Effective Visualization of Neoroanatomy from Diffusion Tensor Imaging Data , 2004, APBC.

[31]  Alan Connelly,et al.  Direct estimation of the fiber orientation density function from diffusion-weighted MRI data using spherical deconvolution , 2004, NeuroImage.

[32]  S. Wakana,et al.  Fiber tract-based atlas of human white matter anatomy. , 2004, Radiology.

[33]  Anna Vilanova,et al.  DTI visualization with streamsurfaces and evenly-spaced volume seeding , 2004, VISSYM'04.

[34]  Hans Hagen,et al.  Physically based methods for tensor field visualization , 2004, IEEE Visualization 2004.

[35]  Robert S. Laramee,et al.  The State of the Art in Flow Visualization: Dense and Texture‐Based Techniques , 2004, Comput. Graph. Forum.

[36]  Gordon Kindlmann,et al.  Superquadric tensor glyphs , 2004, VISSYM'04.

[37]  Heinz-Otto Peitgen,et al.  Unique planar color coding of fiber bundles and its application to fiber integrity quantification , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[38]  D. Tuch.  Q‐ball imaging , 2004, Magnetic resonance in medicine.

[39]  Christopher Nimsky,et al.  Visualization of white matter tracts with wrapped streamlines , 2005, VIS 05. IEEE Visualization, 2005..

[40]  Hans-Peter Seidel,et al.  Visualization with stylized line primitives , 2005, VIS 05. IEEE Visualization, 2005..

[41]  Frans Vos,et al.  Fast and reproducible fiber bundle selection in DTI visualization , 2005, VIS 05. IEEE Visualization, 2005..

[42]  Carlo Pierpaoli,et al.  PASTA: Pointwise assessment of streamline tractography attributes , 2005, Magnetic resonance in medicine.

[43]  Brian A. Wandell,et al.  Exploring connectivity of the brain's white matter with dynamic queries , 2005, IEEE Transactions on Visualization and Computer Graphics.

[44]  P. Hagmann,et al.  Mapping complex tissue architecture with diffusion spectrum magnetic resonance imaging , 2005, Magnetic resonance in medicine.

[45]  Carl-Fredrik Westin,et al.  Diffusion Tensor Visualization with Glyph Packing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[46]  Christopher Nimsky,et al.  Hybrid Visualization for White Matter Tracts using Triangle Strips and Point Sprites , 2006, IEEE Transactions on Visualization and Computer Graphics.

[47]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[48]  Thomas Ertl,et al.  GPU-Based Hyperstreamlines for Diffusion Tensor Imaging , 2006, EuroVis.

[49]  Gerik Scheuermann,et al.  Streamline Predicates , 2006, IEEE Transactions on Visualization and Computer Graphics.

[50]  G. Kindlmann,et al.  Orthogonal tensor invariants and the analysis of diffusion tensor magnetic resonance images , 2006, Magnetic resonance in medicine.

[51]  J. Helpern,et al.  Three‐dimensional characterization of non‐gaussian water diffusion in humans using diffusion kurtosis imaging , 2006, NMR in biomedicine.

[52]  Roland G. Henry,et al.  Comparison of bootstrap approaches for estimation of uncertainties of DTI parameters , 2006, NeuroImage.

[53]  Daniel Rueckert,et al.  Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data , 2006, NeuroImage.

[54]  David H. Laidlaw,et al.  An Introduction to Visualization of Diffusion Tensor Imaging and Its Applications , 2006, Visualization and Processing of Tensor Fields.

[55]  Carl-Fredrik Westin,et al.  Delineating white matter structure in diffusion tensor MRI with anisotropy creases , 2007, Medical Image Anal..

[56]  Hans-Peter Seidel,et al.  Segmentation of DT-MRI Anisotropy Isosurfaces , 2007, EuroVis.

[57]  Bernhard Preim,et al.  Visual Computing for Medicine: Theory, Algorithms, and Applications , 2007 .

[58]  Vid Petrovic,et al.  Visualizing Whole-Brain DTI Tractography with GPU-based Tuboids and LoD Management , 2007, IEEE Transactions on Visualization and Computer Graphics.

[59]  Peter J. Basser,et al.  Spectral decomposition of a 4th-order covariance tensor: Applications to diffusion tensor MRI , 2007, Signal Process..

[60]  Carl-Fredrik Westin,et al.  Automatic Tractography Segmentation Using a High-Dimensional White Matter Atlas , 2007, IEEE Transactions on Medical Imaging.

[61]  Hans-Peter Seidel,et al.  Topological Visualization of Brain Diffusion MRI Data , 2007, IEEE Transactions on Visualization and Computer Graphics.

[62]  Tim McGraw,et al.  Stochastic DT-MRI Connectivity Mapping on the GPU , 2007, IEEE Transactions on Visualization and Computer Graphics.

[63]  Carl-Fredrik Westin,et al.  Invariant Crease Lines for Topological and Structural Analysis of Tensor Fields , 2008, IEEE Transactions on Visualization and Computer Graphics.

[64]  Paul M. Thompson,et al.  Visualization Tools for High Angular Resolution Diffusion Imaging , 2008, MICCAI.

[65]  Carl-Fredrik Westin,et al.  Global Illumination of White Matter Fibers from DT-MRI Data , 2008, Visualization in Medicine and Life Sciences.

[66]  Ed X. Wu,et al.  Towards better MR characterization of neural tissues using directional diffusion kurtosis analysis , 2008, NeuroImage.

[67]  Derek K. Jones.  Tractography Gone Wild: Probabilistic Fibre Tracking Using the Wild Bootstrap With Diffusion Tensor MRI , 2008, IEEE Transactions on Medical Imaging.

[68]  David S. Ebert,et al.  Abstractive Representation and Exploration of Hierarchically Clustered Diffusion Tensor Fiber Tracts , 2008, Comput. Graph. Forum.

[69]  Baba C. Vemuri,et al.  Extracting Tractosemas from a Displacement Probability Field for Tractography in DW-MRI , 2008, MICCAI.

[70]  Tobias Isenberg,et al.  Depth-Dependent Halos: Illustrative Rendering of Dense Line Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[71]  Carl-Fredrik Westin,et al.  Sampling and Visualizing Creases with Scale-Space Particles , 2009, IEEE Transactions on Visualization and Computer Graphics.

[72]  David H. Laidlaw,et al.  Exploring 3D DTI Fiber Tracts with Linked 2D Representations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[73]  Bart M. ter Haar Romeny,et al.  Parameter Sensitivity Visualization for DTI Fiber Tracking , 2009, IEEE Transactions on Visualization and Computer Graphics.

[74]  David F. Tate,et al.  A Novel Interface for Interactive Exploration of DTI Fibers , 2009, IEEE Transactions on Visualization and Computer Graphics.

[75]  Heinz-Otto Peitgen,et al.  A GPU-based fiber tracking framework using geometry shaders , 2009, Medical Imaging.

[76]  David H. Laidlaw,et al.  Coloring 3D Line Fields Using Boy’s Real Projective Plane Immersion , 2009, IEEE Transactions on Visualization and Computer Graphics.

[77]  Bart M. ter Haar Romeny,et al.  Fast and sleek glyph rendering for interactive HARDI data exploration , 2009, 2009 IEEE Pacific Visualization Symposium.

[78]  Anna Vilanova,et al.  Illustrative White Matter Fiber Bundles , 2010, Comput. Graph. Forum.

[79]  Thomas Schultz,et al.  A Maximum Enhancing Higher‐Order Tensor Glyph , 2010, Comput. Graph. Forum.

[80]  Eric Achten,et al.  Optimal Experimental Design for Diffusion Kurtosis Imaging , 2010, IEEE Transactions on Medical Imaging.

[81]  G. Kindlmann,et al.  Superquadric Glyphs for Symmetric Second-Order Tensors , 2010, IEEE Transactions on Visualization and Computer Graphics.

[82]  Hans Hagen,et al.  Tensor Field Reconstruction Based on Eigenvector and Eigenvalue Interpolation , 2010, Scientific Visualization: Advanced Concepts.

[83]  Alexander Leemans.  Visualization of Diffusion MRI Data , 2010 .

[84]  Alan Connelly,et al.  Track-density imaging (TDI): Super-resolution white matter imaging using whole-brain track-density mapping , 2010, NeuroImage.

[85]  Hans-Peter Seidel,et al.  Crease Surfaces: From Theory to Extraction and Application to Diffusion Tensor MRI , 2010, IEEE Transactions on Visualization and Computer Graphics.

[86]  Rachid Deriche,et al.  Unsupervised white matter fiber clustering and tract probability map generation: Applications of a Gaussian process framework for white matter fibers , 2010, NeuroImage.

[87]  Timo Ropinski,et al.  Survey of glyph-based visualization techniques for spatial multivariate medical data , 2011, Comput. Graph..

[88]  Alan Connelly,et al.  Track density imaging (TDI): Validation of super resolution property , 2011, NeuroImage.

[89]  Gerik Scheuermann,et al.  Fast and Memory Efficient GPU-Based Rendering of Tensor Data , 2011 .

[90]  B. Ardekani,et al.  Estimation of tensors and tensor‐derived measures in diffusional kurtosis imaging , 2011, Magnetic resonance in medicine.

[91]  Bart M. ter Haar Romeny,et al.  Fused DTI/HARDI Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[92]  Sarang C. Joshi,et al.  Detection of Crossing White Matter Fibers with High-Order Tensors and Rank-k Decompositions , 2011, IPMI.

[93]  Jonathan C. Roberts,et al.  Visual comparison for information visualization , 2011, Inf. Vis..

[94]  Bart M. ter Haar Romeny,et al.  GPU-Based Ray-Casting of Spherical Functions Applied to High Angular Resolution Diffusion Imaging , 2011, IEEE Transactions on Visualization and Computer Graphics.

[95]  Xavier Tricoche,et al.  Fast Extraction of High‐quality Crease Surfaces for Visual Analysis , 2011, Comput. Graph. Forum.

[96]  Thomas Schultz,et al.  Towards Resolving Fiber Crossings with Higher Order Tensor Inpainting , 2012 .

[97]  Douglas L. Rosene,et al.  The Geometric Structure of the Brain Fiber Pathways , 2012, Science.

[98]  David H. Laidlaw,et al.  Exploring Brain Connectivity with Two-Dimensional Neural Maps , 2012, IEEE Transactions on Visualization and Computer Graphics.

[99]  David H. Laidlaw,et al.  Effects of Stereo and Screen Size on the Legibility of Three-Dimensional Streamtube Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[100]  Bart M. ter Haar Romeny,et al.  Illustrative uncertainty visualization of DTI fiber pathways , 2012, The Visual Computer.

[101]  Jeff M. Phillips,et al.  Uncertainty visualization in HARDI based on ensembles of ODFs , 2012, 2012 IEEE Pacific Visualization Symposium.

[102]  Stuart Crozier,et al.  Apparent Fibre Density: A novel measure for the analysis of diffusion-weighted magnetic resonance images , 2012, NeuroImage.

[103]  Bernd Hamann,et al.  Image-Space Tensor Field Visualization Using a LIC-like Method , 2012, Visualization in Medicine and Life Sciences II.

[104]  Bernhard Schölkopf,et al.  HiFiVE: A Hilbert Space Embedding of Fiber Variability Estimates for Uncertainty Modeling and Visualization , 2013, Comput. Graph. Forum.

[105]  Ghassan Hamarneh,et al.  Uncertainty in Tractography via Tract Confidence Regions , 2013, CDMRI/MMBC@MICCAI.

[106]  Gerik Scheuermann,et al.  LineAO - Improved Three-Dimensional Line Rendering , 2013, IEEE Trans. Vis. Comput. Graph..

[107]  M. Viergever,et al.  Multi-Fiber Tractography Visualizations for Diffusion MRI Data , 2013, PloS one.

[108]  Daniel S. Margulies,et al.  Visualizing the human connectome , 2013, NeuroImage.

[109]  Carl-Fredrik Westin,et al.  Visualization and Processing of Tensors and Higher Order Descriptors for Multi-Valued Data , 2014 .

[110]  Thomas Schultz,et al.  Visualizing Uncertainty in HARDI Tractography Using Superquadric Streamtubes , 2014, EuroVis.

[111]  Rachid Deriche,et al.  Higher-Order Tensors in Diffusion Imaging , 2014, Visualization and Processing of Tensors and Higher Order Descriptors for Multi-Valued Data.

[112]  Hans-Heino Ehricke,et al.  Fiber Visualization with LIC Maps Using Multidirectional Anisotropic Glyph Samples , 2014, Int. J. Biomed. Imaging.

[113]  Thomas Schultz,et al.  Fuzzy Fibers: Uncertainty in dMRI Tractography , 2013, Scientific Visualization.

[114]  Amitabh Varshney,et al.  Visualization of Brain Microstructure Through Spherical Harmonics Illumination of High Fidelity Spatio-Angular Fields , 2014, IEEE Transactions on Visualization and Computer Graphics.

[115]  Maxime Descoteaux,et al.  Real-time multi-peak tractography for instantaneous connectivity display , 2014, Front. Neuroinform..

[116]  Søren Hauberg,et al.  Probabilistic Shortest Path Tractography in DTI Using Gaussian Process ODE Solvers , 2014, MICCAI.

[117]  J. Estellé,et al.  Chronic Trichuris muris Infection Decreases Diversity of the Intestinal Microbiota and Concomitantly Increases the Abundance of Lactobacilli , 2015, PloS one.

[118]  Thomas Schultz,et al.  Quantifying Microstructure in Fiber Crossings with Diffusional Kurtosis , 2015, MICCAI.

[119]  Maxime Descoteaux,et al.  Visualization of Diffusion Propagator and Multiple Parameter Diffusion Signal , 2015, Visualization and Processing of Higher Order Descriptors for Multi-Valued Data.

[120]  Max A. Viergever,et al.  Seeing More by Showing Less: Orientation-Dependent Transparency Rendering for Fiber Tractography Visualization , 2015, PloS one.

[121]  Tobias Isenberg.  A Survey of Illustrative Visualization Techniques for Diffusion-Weighted MRI Tractography , 2015, Visualization and Processing of Higher Order Descriptors for Multi-Valued Data.

[122]  Thomas Schultz,et al.  Visualization and Processing of Higher Order Descriptors for Multi-Valued Data , 2015 .

[123]  P. Dyke.  Mathematics and Art: A Cultural History , 2016, Leonardo.

[124]  Max A. Viergever,et al.  Sheet Probability Index (SPI): Characterizing the geometrical organization of the white matter with diffusion MRI , 2016, NeuroImage.

[125]  Kai Lawonn,et al.  Glyph-Based Comparative Visualization for Diffusion Tensor Fields , 2016, IEEE Transactions on Visualization and Computer Graphics.

[126]  Thomas Schultz,et al.  Visualizing Tensor Normal Distributions at Multiple Levels of Detail , 2016, IEEE Transactions on Visualization and Computer Graphics.

[127]  Max A. Viergever,et al.  Quantifying the brain's sheet structure with normalized convolution , 2017, Medical Image Anal..

[128]  T. Schultz,et al.  A Sheet Probability Index from Diffusion Tensor Imaging , 2018 .

[129]  Ben Jeurissen,et al.  Diffusion MRI fiber tractography of the brain , 2019, NMR in biomedicine.