A Fast 3D Brain Extraction and Visualization Framework Using Active Contour and Modern OpenGL Pipelines

Brain extraction is a process of removing non-brain tissue in the brain magnetic resonance (MR) images and serves as a first step towards more delicate brain segmentation. Although many brain extraction methods have been proposed in the literature, most of them are either laborious or time consuming, and lack of instant visualization. This leads to a time lag between image acquisition and comprehensive visualization. Especially for intraoperative image based neurosurgery navigation, the time lag from image acquisition to brain visualization should be reduced as much as possible. In this paper, we propose an end-to-end fast brain extraction and visualization framework. The input is a T1-weighted MR volume and the output is comprehensive brain visualization. An improved brain extraction tool (BET) algorithm is proposed to evolve a 3D active mesh model to fit the brain surface in the 3D image. Then the brain mask is generated per slice using a polygon fill algorithm. At last, a ray-casting volume rendering algorithm is used to visualize the brain surface with the help of the generated mask. All the operations are performed using the modern OpenGL pipelines running on a graphics processing unit (GPU). Experiments were performed on two publicly available datasets and one clinical dataset to compare our method with five state-of-the-art methods including the original BET in terms of segmentation accuracy and time cost. Our method achieved mean Dice coefficients of 96.8%, 97.1%, 98.5% and mean time cost of 361 ms, 341 ms, 502 ms on the three datasets, outperforming all the other methods.

[1]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[2]  Christian Barillot,et al.  Atlas-based segmentation of 3D cerebral structures with competitive level sets and fuzzy control , 2009, Medical Image Anal..

[3]  Herng-Hua Chang,et al.  Automatic segmentation of brain MR images using an adaptive balloon snake model with fuzzy classification , 2013, Medical & Biological Engineering & Computing.

[4]  Wilfried Philips,et al.  MRI Segmentation of the Human Brain: Challenges, Methods, and Applications , 2015, Comput. Math. Methods Medicine.

[5]  Hassan Khastavaneh,et al.  Brain extraction: A region based histogram analysis strategy , 2015, 2015 Signal Processing and Intelligent Systems Conference (SPIS).

[6]  Sébastien Ourselin,et al.  Brain MAPS: An automated, accurate and robust brain extraction technique using a template library , 2011, NeuroImage.

[7]  M. Stella Atkins,et al.  Fully automatic segmentation of the brain in MRI , 1998, IEEE Transactions on Medical Imaging.

[8]  Claudio A. Perez,et al.  An accurate skull stripping method based on simplex meshes and histogram analysis for magnetic resonance images , 2012, Journal of Neuroscience Methods.

[9]  Hongen Liao,et al.  3-D Augmented Reality for MRI-Guided Surgery Using Integral Videography Autostereoscopic Image Overlay , 2010, IEEE Transactions on Biomedical Engineering.

[10]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[11]  Nobuhiko Hata,et al.  Surgical navigation by autostereoscopic image overlay of integral videography , 2004, IEEE Transactions on Information Technology in Biomedicine.

[12]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[13]  Michael W. L. Chee,et al.  Skull stripping using graph cuts , 2010, NeuroImage.

[14]  Henry Rusinek,et al.  Fully automatic segmentation of the brain from T1‐weighted MRI using Bridge Burner algorithm , 2008, Journal of magnetic resonance imaging : JMRI.

[15]  Stephen M. Smith,et al.  Enhanced brain extraction improves the accuracy of brain atrophy estimation , 2008, NeuroImage.

[16]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[17]  Jing Bai,et al.  Atlas-Based Fuzzy Connectedness Segmentation and Intensity Nonuniformity Correction Applied to Brain MRI , 2007, IEEE Transactions on Biomedical Engineering.

[18]  Heidar Ali Talebi,et al.  Intraoperative Brain Shift Estimation Using Atlas of Brain Deformations and Constrained Kalman Filter , 2020, IEEE Transactions on Control Systems Technology.

[19]  Stefan Bauer,et al.  Multiscale Modeling for Image Analysis of Brain Tumor Studies , 2012, IEEE Transactions on Biomedical Engineering.

[20]  Russell M. Mersereau,et al.  Automatic Detection of Brain Contours in MRI Data Sets , 1991, IPMI.

[21]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[22]  Örjan Smedby,et al.  Multi-organ Segmentation Using Shape Model Guided Local Phase Analysis , 2015, MICCAI.

[23]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[24]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[25]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[26]  M. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network. , 2016, IEEE transactions on medical imaging.

[27]  Richard M. Leahy,et al.  Surface-based labeling of cortical anatomy using a deformable atlas , 1997, IEEE Transactions on Medical Imaging.

[28]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[29]  Sukanta Sabut,et al.  Extraction of brain from MRI images by skull stripping using histogram partitioning with maximum entropy divergence , 2016, 2016 International Conference on Communication and Signal Processing (ICCSP).

[30]  Hafiz Zia Ur Rehman,et al.  3D U-Net for Skull Stripping in Brain MRI , 2019, Applied Sciences.

[31]  D. Louis Collins,et al.  Simultaneous segmentation and grading of anatomical structures for patient's classification: Application to Alzheimer's disease , 2012, NeuroImage.

[32]  Olivier Clatz,et al.  Non-rigid alignment of pre-operative MRI, fMRI, and DT-MRI with intra-operative MRI for enhanced visualization and navigation in image-guided neurosurgery , 2007, NeuroImage.

[33]  Agma J. M. Traina,et al.  Smart histogram analysis applied to the skull-stripping problem in T1-weighted MRI , 2012, Comput. Biol. Medicine.

[34]  Anders M. Dale,et al.  A hybrid approach to the Skull Stripping problem in MRI , 2001, NeuroImage.

[35]  Cüneyt Güzelis,et al.  Integrating Segmentation Methods From Different Tools Into a Visualization Program Using an Object-Based Plug-In Interface , 2010, IEEE Transactions on Information Technology in Biomedicine.

[36]  Pieter L Kubben,et al.  Intraoperative MRI-guided resection of glioblastoma multiforme: a systematic review. , 2011, The Lancet. Oncology.

[37]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[38]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[39]  Hervé Delingette,et al.  Robust nonrigid registration to capture brain shift from intraoperative MRI , 2005, IEEE Transactions on Medical Imaging.

[40]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[41]  Jyrki Lötjönen,et al.  Robust whole-brain segmentation: Application to traumatic brain injury , 2015, Medical Image Anal..

[42]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[43]  Arthur W. Toga,et al.  Skull-stripping magnetic resonance brain images using a model-based level set , 2006, NeuroImage.

[44]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[45]  Pierre Robe,et al.  How Intraoperative Tools and Techniques Have Changed the Approach to Brain Tumor Surgery , 2018, Current Oncology Reports.

[46]  G. Hagemann,et al.  Fast, accurate, and reproducible automatic segmentation of the brain in T1‐weighted volume MRI data , 1999, Magnetic resonance in medicine.