Multimodality Neurological Data Visualization With Multi-VOI-Based DTI Fiber Dynamic Integration

Brain lesions are usually located adjacent to critical spinal structures, so it is a challenging task for neurosurgeons to precisely plan a surgical procedure without damaging healthy tissues and nerves. The advancement of medical imaging technologies produces a large amount of neurological data, which are capable of showing a wide variety of brain properties. Advanced algorithms of medical data computing and visualization are critically helpful in efficiently utilizing the acquired data for disease diagnosis and brain function and structure exploration, which is helpful for treatment planning. In this paper, we describe new algorithms and a software framework for multiple volume of interest specified diffusion tensor imaging (DTI) fiber dynamic visualization. The displayed results have been integrated with a volume rendering pipeline for multimodality neurological data exploration. A depth texture indexing algorithm is used to detect DTI fiber tracts in graphics process units (GPUs), which makes fibers to be displayed and interactively manipulated with brain data acquired from functional magnetic resonance imaging, T1 and T2-weighted anatomic imaging, and angiographic imaging. The developed software platform is built on an object-oriented structure, which is transparent and extensible. It provides a comprehensive human-computer interface for data exploration and information extraction. The GPU-accelerated high-performance computing kernels have been implemented to enable our software to dynamically visualize neurological data. The developed techniques will be useful in computer-aided neurological disease diagnosis, brain structure exploration, and general cognitive neuroscience.

[1]  Rebecca Saxe,et al.  fMRI item analysis in a theory of mind task , 2011, NeuroImage.

[2]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[3]  Bart M. ter Haar Romeny,et al.  Illustrative uncertainty visualization of DTI fiber pathways , 2012, The Visual Computer.

[4]  C. Westin,et al.  An introduction to diffusion tensor image analysis. , 2011, Neurosurgery clinics of North America.

[5]  Timothy Edward John Behrens,et al.  A Bayesian framework for global tractography , 2007, NeuroImage.

[6]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2005, Medical Image Anal..

[7]  Joseph S. Gati,et al.  Characterization of the blood-oxygen level-dependent (BOLD) response in cat auditory cortex using high-field fMRI , 2013, NeuroImage.

[8]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[9]  Patrik Vuilleumier,et al.  Processing social aspects of human gaze: A combined fMRI-DTI study , 2011, NeuroImage.

[10]  Hanchuan Peng,et al.  Extensible visualization and analysis for multidimensional images using Vaa3D , 2014, Nature Protocols.

[11]  R. Kikinis,et al.  Interactive Diffusion Tensor Tractography Visualization for Neurosurgical Planning , 2011, Neurosurgery.

[12]  Klaus Hahn,et al.  A review of diffusion tensor magnetic resonance imaging computational methods and software tools , 2011, Comput. Biol. Medicine.

[13]  R. Kikinis,et al.  A review of magnetic resonance imaging and diffusion tensor imaging findings in mild traumatic brain injury , 2012, Brain Imaging and Behavior.

[14]  Tobias Isenberg,et al.  DTI in Context: Illustrating Brain Fiber Tracts In Situ , 2010, Comput. Graph. Forum.

[15]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[16]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[17]  Bart M. ter Haar Romeny,et al.  Parameter Sensitivity Visualization for DTI Fiber Tracking , 2009, IEEE Transactions on Visualization and Computer Graphics.

[18]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[19]  Jörg-Stefan Praßni,et al.  Pre-Operative Planning of Brain Tumor Resections , 2010 .

[20]  Pablo Irarrazaval,et al.  Volume visualization using a spatially aware mobile display device , 2012, Comput. Medical Imaging Graph..

[21]  Haiying Liu,et al.  Intraoperative Real-Time Querying of White Matter Tracts During Frameless Stereotactic Neuronavigation , 2011, Neurosurgery.

[22]  Heinz-Otto Peitgen,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Interactive Visualization of Multimodal Volume Data for Neurosurgical Tumor Treatment , 2022 .

[23]  Olivier Clatz,et al.  Glioma Dynamics and Computational Models: A Review of Segmentation, Registration, and In Silico Growth Algorithms and their Clinical Applications , 2007 .

[24]  Hervé Delingette,et al.  Dynamic Model of Communicating Hydrocephalus for Surgery Simulation , 2007, IEEE Transactions on Biomedical Engineering.

[25]  Meng Law,et al.  Diffusion-weighted imaging, diffusion-tensor imaging, and fiber tractography of the spinal cord. , 2009, Magnetic resonance imaging clinics of North America.

[26]  Bart M. ter Haar Romeny,et al.  Fused DTI/HARDI Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[27]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[28]  M Nolden,et al.  MITK Diffusion Imaging , 2012, Methods of Information in Medicine.

[29]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.