Toward a Multimodal Diagnostic Exploratory Visualization of Focal Cortical Dysplasia

Focal cortical dysplasia (FCD) is a malformation of cortical development and a common cause of pharmacoresistant epilepsy. Resective surgery of clear-cut lesions may be curative. However, the localization of the seizure focus and the evaluation of its spatial extent can be challenging in many situations. For concordance assessment, medical studies show the relevance of accurate correlation of multisource imaging sequences. to improve the sensitivity and specificity of the evaluation. In this paper, we share the process we went through to reach our simple, but effective, solution for integrating multi-volume rendering into an exploratory visualization environment for the diagnosis of FCD. We focus on fetching of multiple data assigned to a sample when they are rendered. Knowing that the major diagnostic role of multiple volumes is to complement information, we demonstrate that appropriate geometric transformations in the texture space are sufficient for accomplishing this task. This allows us to fully implement our proposal in the OpenGL rendering pipeline and to easily integrate it into the existing visual diagnostic application. Both time performance and the visual quality of our proposal were evaluated with a set of clinical data volumes for assessing the potential practical impact of our solution in routine diagnostic use.

[1]  Harlen Costa Batagelo,et al.  A framework for GPU-based application-independent 3D interactions , 2008, The Visual Computer.

[2]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[3]  William H Theodore,et al.  Presurgical Focus Localization in Epilepsy: PET and SPECT. , 2017, Seminars in nuclear medicine.

[4]  Min Chen,et al.  Modelling and Rendering Graphics Scenes Composed of Multiple Volumetric Datasets , 1999, Comput. Graph. Forum.

[5]  Simon Stegmaier,et al.  A simple and flexible volume rendering framework for graphics-hardware-based raycasting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[6]  Shin-Ting Wu,et al.  Snapping a Cursor on Volume Data , 2011, 2011 24th SIBGRAPI Conference on Graphics, Patterns and Images.

[7]  Li Yu-fang,et al.  Volume Rendering Techniques Application in Coal Seismic Data , 2002 .

[8]  C. Yasuda,et al.  Neuroimaging for the prediction of response to medical and surgical treatment in epilepsy. , 2012, Expert opinion on medical diagnostics.

[9]  Dieter Schmalstieg,et al.  Ray casting of multiple volumetric datasets with polyhedral boundaries on manycore GPUs , 2009, ACM Trans. Graph..

[10]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[11]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, SIGGRAPH '04.

[12]  Bart M. ter Haar Romeny,et al.  Flexible GPU-Based Multi-Volume Ray-Casting , 2008, VMV.

[13]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[14]  F Cendes,et al.  Diagnosis of subtle focal dysplastic lesions: Curvilinear reformatting from three‐dimensional magnetic resonance imaging , 1999, Annals of neurology.

[15]  Shin-Ting Wu,et al.  Interactive Curvilinear Reformatting in Native Space , 2012, IEEE Transactions on Visualization and Computer Graphics.

[16]  Hans-Christian Hege,et al.  amira: A Highly Interactive System for Visual Data Analysis , 2005, The Visualization Handbook.

[17]  Shin-Ting Wu,et al.  Pre-alignment for Co-registration in Native Space , 2014, 2014 27th SIBGRAPI Conference on Graphics, Patterns and Images.