Illustrative Hybrid Visualization and Exploration of Anatomical and Functional Brain Data

Common practice in brain research and brain surgery involves the multi‐modal acquisition of brain anatomy and brain activation data. These highly complex three‐dimensional data have to be displayed simultaneously in order to convey spatial relationships. Unique challenges in information and interaction design have to be solved in order to keep the visualization sufficiently complete and uncluttered at the same time. The visualization method presented in this paper addresses these issues by using a hybrid combination of polygonal rendering of brain structures and direct volume rendering of activation data. Advanced rendering techniques including illustrative display styles and ambient occlusion calculations enhance the clarity of the visual output. The presented rendering pipeline produces real‐time frame rates and offers a high degree of configurability. Newly designed interaction and measurement tools are provided, which enable the user to explore the data at large, but also to inspect specific features closely. We demonstrate the system in the context of a cognitive neurosciences dataset. An initial informal evaluation shows that our visualization method is deemed useful for clinical research.

[1]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[2]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[3]  J. Lewin Functional MRI: An introduction to methods , 2003 .

[4]  Bernhard Preim,et al.  Combining Silhouettes, Surface, and Volume Rendering for Surgery Education and Planning , 2005, EuroVis.

[5]  Stephen C. Strother,et al.  A symbolic environment for visualizing activated foci in functional neuroimaging datasets , 1998, Medical Image Anal..

[6]  Chandrajit L. Bajaj,et al.  Sampling and reconstructing manifolds using alpha-shapes , 1997, CCCG.

[7]  Arie E. Kaufman,et al.  Mixing translucent polygons with volumes , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[8]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[9]  A. James Stewart,et al.  Vicinity shading for enhanced perception of volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[10]  Peter Bandettini,et al.  Functional MRI today. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Thomas Ertl,et al.  Simultaneous visualization of anatomical and functional 3D data by combining volume rendering and flow visualization , 2007, SPIE Medical Imaging.

[12]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[13]  Dirk Bartz,et al.  Illustrative display of hidden iso-surface structures , 2005, VIS 05. IEEE Visualization, 2005..

[14]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[15]  Thomas Ertl,et al.  GPU-based Multi-Volume Rendering for the Visualization of Functional Brain Images , 2006, SimVis.