Creating connected representations of cortical gray matter for functional MRI visualization

Describes a system that is being used to segment gray matter from magnetic resonance imaging (MRI) and to create connected cortical representations for functional MRI visualization (fMRI). The method exploits knowledge of the anatomy of the cortex and incorporates structural constraints into the segmentation. First, the white matter and cerebral spinal fluid (CSF) regions in the MR volume are segmented using a novel techniques of posterior anisotropic diffusion. Then, the user selects the cortical white matter component of interest, and its structure is verified by checking for cavities and handles. After this, a connected representation of the gray matter is created by a constrained growing-out from the white matter boundary. Because the connectivity is computed, the segmentation can be used as input to several methods of visualizing the spatial pattern of cortical activity within gray matter. In the authors' case, the connected representation of gray matter is used to create a flattened representation of the cortex. Then, fMRI measurements are overlaid on the flattened representation, yielding a representation of the volumetric data within a single image. The software is freely available to the research community.

[1]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Olivier D. Faugeras,et al.  Improving Consistency and Reducing Ambiguity in Stochastic Labeling: An Optimization Approach , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[5]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[6]  Azriel Rosenfeld,et al.  Digital topology: Introduction and survey , 1989, Comput. Vis. Graph. Image Process..

[7]  P. Perona Anisotropic diffusion processes in early vision , 1989, Sixth Multidimensional Signal Processing Workshop,.

[8]  R. Kikinis,et al.  Three-dimensional segmentation of MR images of the head using probability and connectivity. , 1990, Journal of computer assisted tomography.

[9]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[10]  Philippe Saint-Marc,et al.  Adaptive Smoothing: A General Tool for Early Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[12]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[13]  Bernard Mazoyer,et al.  Three-dimensional segmentation and interpolation of magnetic resonance brain images , 1993, IEEE Trans. Medical Imaging.

[14]  L M Fletcher,et al.  A multispectral analysis of brain tissues , 1993, Magnetic resonance in medicine.

[15]  Guy Marchal,et al.  Continuous Voxel Classification by Stochastic Relaxation: Theory and Application to MR Imaging and MR Angiography , 1993, IPMI.

[16]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[17]  M. Gado,et al.  Interactive segmentation of cerebral gray matter, white matter, and CSF: photographic and MR images. , 1994, Computerized Medical Imaging and Graphics.

[18]  Rangasami L. Kashyap,et al.  Building Skeleton Models via 3-D Medial Surface/Axis Thinning Algorithms , 1994, CVGIP Graph. Model. Image Process..

[19]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[20]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[21]  M. Stella Atkins,et al.  Three-dimensional partial volume segmentation of multispectral magnetic resonance images using stochastic relaxation , 1994, Electronic Imaging.

[22]  Jitendra Malik,et al.  Anisotropic Diffusion , 1994, Geometry-Driven Diffusion in Computer Vision.

[23]  Isabelle Bloch,et al.  Automatic construction of an attributed relational graph representing the cortex topography using homotopic transformations , 1994, Optics & Photonics.

[24]  C. Davatzikos,et al.  Using a deformable surface model to obtain a shape representation of the cortex , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[25]  Max A. Viergever,et al.  Probabilistic Hyperstack Segmentation of MR Brain Data , 1995, CVRMed.

[26]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[27]  B. Wandell Foundations of vision , 1995 .

[28]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[30]  Jianhua Xuan,et al.  Segmentation of magnetic resonance brain image: integrating region growing and edge detection , 1995, Proceedings., International Conference on Image Processing.

[31]  J. Li,et al.  Multiresolution Adaptive K-means Algorithm for Segmentation of Brain MRI , 1995, ICSC.

[32]  Guillermo Sapiro,et al.  Object detection and measurements in medical images via geodesic deformable contours , 1995, Optics & Photonics.

[33]  Stacia R. Engel,et al.  Creating images of the flattened cortical sheet , 1996 .

[34]  D. V. van Essen,et al.  Computerized Mappings of the Cerebral Cortex: A Multiresolution Flattening Method and a Surface-Based Coordinate System , 1996, Journal of Cognitive Neuroscience.

[35]  A. Dale,et al.  New images from human visual cortex , 1996, Trends in Neurosciences.

[36]  E. DeYoe,et al.  Mapping striate and extrastriate visual areas in human cerebral cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Guillermo Sapiro,et al.  Three Dimensional Object Modeling via Minimal Surfaces , 1996, ECCV.

[38]  Guillermo Sapiro,et al.  Anisotropic smoothing of posterior probabilities , 1997, Proceedings of International Conference on Image Processing.

[39]  M. Carter Computer graphics: Principles and practice , 1997 .

[40]  Sabine Kastner,et al.  An investigation of fMRI resolution in the visual cortex , 1997 .

[41]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[42]  Ravi S. Menon,et al.  Ocular dominance in human V1 demonstrated by functional magnetic resonance imaging. , 1997, Journal of neurophysiology.

[43]  Guillermo Sapiro,et al.  Minimal Surfaces Based Object Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  G. Glover,et al.  Retinotopic organization in human visual cortex and the spatial precision of functional MRI. , 1997, Cerebral cortex.

[45]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..