Query Tools for Interactive Exploration of 3D Neuroimages: Cropping, Probe and Lens

Dynamic queries continuously update the data that is visualized in accordance with the user actions. They are typically applied for visual information seeking. This paper proposes to introduce this interaction style for exploring 3D medical neuroimages in its original form, enhancing visual seeking technology in a medical diagnostic procedure. More precisely, we present three dynamic query tools that allow the user to change the focus on-the-fly, while the surrounding tissue is preserved. They are a curvilinear cropper, a volumetric probe and a movable magnifying lens. Once information-preserving visualization is essential for accurate diagnosis and legal protection, the dataset is in its original form. The originality of our work relies on the input interface through which an expert can directly manipulate those tools on the raw data and the responsiveness of each displayed voxel by exploiting the power of GPUs. The proposed techniques have been integrated in a visualization prototype and were assessed by the neuroimaging experts, who were be able to identify subtle lesions in the brain.

[1]  R. Nick Bryan,et al.  Confocal volume rendering: fast, segmentation-free visualization of internal structures , 2000, Medical Imaging.

[2]  Maria Thom,et al.  The clinicopathologic spectrum of focal cortical dysplasias: A consensus classification proposed by an ad hoc Task Force of the ILAE Diagnostic Methods Commission 1 , 2011, Epilepsia.

[3]  Min-Yang Yang,et al.  Triangular mesh offset for generalized cutter , 2005, Comput. Aided Des..

[4]  Stefan Bruckner,et al.  Dynamic Focus + Context for Volume Rendering , 2010, VMV.

[5]  Ken Brodlie,et al.  The volume in focus: hardware-assisted focus and context effects for volume visualization , 2008, SAC '08.

[6]  Nadia Colombo,et al.  Focal cortical dysplasia type IIa and IIb: MRI aspects in 118 cases proven by histopathology , 2012, Neuroradiology.

[7]  Klaus Mueller,et al.  The magic volume lens: an interactive focus+context technique for volume rendering , 2005, VIS 05. IEEE Visualization, 2005..

[8]  Harlen Costa Batagelo,et al.  What you see is what you snap: snapping to geometry deformed on the GPU , 2005, I3D '05.

[9]  Eduard Gröller,et al.  Two-Level Volume Rendering , 2001, IEEE Trans. Vis. Comput. Graph..

[10]  Stefan Bruckner,et al.  TECHNICAL REPORT VolumeShop: An Interactive System for Direct Volume , 2022 .

[11]  Shin-Ting Wu,et al.  Snapping a Cursor on Volume Data , 2011, 2011 24th SIBGRAPI Conference on Graphics, Patterns and Images.

[12]  Georgios Papaioannou,et al.  A Fast Depth-Buffer-Based Voxelization Algorithm , 1999, J. Graphics, GPU, & Game Tools.

[13]  Thomas Ertl,et al.  Interactive Clipping Techniques for Texture-Based Volume Visualization and Volume Shading , 2003, IEEE Trans. Vis. Comput. Graph..

[14]  H. Vinters,et al.  Incomplete resection of focal cortical dysplasia is the main predictor of poor postsurgical outcome , 2009, Neurology.

[15]  Bernd Hamann,et al.  A magnification lens for interactive volume visualization , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[16]  Fernando Cendes,et al.  Neuroimaging in Investigation of Patients With Epilepsy , 2013, Continuum.

[17]  Luciana Porcher Nedel,et al.  Erasing, digging and clipping in volumetric datasets with one or two hands , 2006, VRCIA '06.

[18]  Jianlong Zhou,et al.  Focal region-guided feature-based volume rendering , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[19]  Stefan Bruckner,et al.  Exploded Views for Volume Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[20]  C. Rorden,et al.  Stereotaxic display of brain lesions. , 2000, Behavioural neurology.

[21]  Ivan Viola,et al.  Importance-driven feature enhancement in volume visualization , 2005, IEEE Transactions on Visualization and Computer Graphics.

[22]  Shin-Ting Wu,et al.  Interactive Curvilinear Reformatting in Native Space , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Hans-Peter Seidel,et al.  Fast parallel surface and solid voxelization on GPUs , 2010, SIGGRAPH 2010.

[24]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[25]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .