Patient-specific model-based segmentation of brain tumors in 3D intraoperative ultrasound images

PurposeIntraoperative ultrasound (iUS) imaging is commonly used to support brain tumor operation. The tumor segmentation in the iUS images is a difficult task and still under improvement because of the low signal-to-noise ratio. The success of automatic methods is also limited due to the high noise sensibility. Therefore, an alternative brain tumor segmentation method in 3D-iUS data using a tumor model obtained from magnetic resonance (MR) data for local MR–iUS registration is presented in this paper. The aim is to enhance the visualization of the brain tumor contours in iUS.MethodsA multistep approach is proposed. First, a region of interest (ROI) based on the specific patient tumor model is defined. Second, hyperechogenic structures, mainly tumor tissues, are extracted from the ROI of both modalities by using automatic thresholding techniques. Third, the registration is performed over the extracted binary sub-volumes using a similarity measure based on gradient values, and rigid and affine transformations. Finally, the tumor model is aligned with the 3D-iUS data, and its contours are represented.ResultsExperiments were successfully conducted on a dataset of 33 patients. The method was evaluated by comparing the tumor segmentation with expert manual delineations using two binary metrics: contour mean distance and Dice index. The proposed segmentation method using local and binary registration was compared with two grayscale-based approaches. The outcomes showed that our approach reached better results in terms of computational time and accuracy than the comparative methods.ConclusionThe proposed approach requires limited interaction and reduced computation time, making it relevant for intraoperative use. Experimental results and evaluations were performed offline. The developed tool could be useful for brain tumor resection supporting neurosurgeons to improve tumor border visualization in the iUS volumes.

[1]  Javad Alirezaie,et al.  Brain-shift compensation by non-rigid registration of intra-operative ultrasound images with preoperative MR images based on residual complexity , 2015, International Journal of Computer Assisted Radiology and Surgery.

[2]  E. Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2007, Methods of Information in Medicine.

[3]  Xavier Bresson,et al.  Evaluation and Comparison of Current Fetal Ultrasound Image Segmentation Methods for Biometric Measurements: A Grand Challenge , 2014, IEEE Transactions on Medical Imaging.

[4]  Jianrong Xu,et al.  Intra-Patient Supine-Prone Colon Registration in CT Colonography Using Shape Spectrum , 2010, MICCAI.

[5]  Qinghua Huang,et al.  Breast ultrasound image segmentation: a survey , 2017, International Journal of Computer Assisted Radiology and Surgery.

[6]  J. Modersitzki,et al.  Ill-posed medicine—an introduction to image registration , 2008 .

[7]  G. Unsgaard,et al.  Ability of navigated 3D ultrasound to delineate gliomas and metastases – comparison of image interpretations with histopathology , 2005, Acta Neurochirurgica.

[8]  Yimin Chen,et al.  Fully automatic prostate segmentation from transrectal ultrasound images based on radial bas-relief initialization and slice-based propagation , 2016, Comput. Biol. Medicine.

[9]  J. Meixensberger,et al.  Integration of a 3D ultrasound probe into neuronavigation , 2011, Acta Neurochirurgica.

[10]  Pascal Haigron,et al.  MRI to CT Prostate Registration for Improved Targeting in Cancer External Beam Radiotherapy , 2017, IEEE Journal of Biomedical and Health Informatics.

[11]  Fa Wu,et al.  Ultrasound image-based thyroid nodule automatic segmentation using convolutional neural networks , 2017, International Journal of Computer Assisted Radiology and Surgery.

[12]  Min Xian,et al.  Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains , 2015, Pattern Recognit..

[13]  Jie Huang,et al.  Ultrasound kidney segmentation with a global prior shape , 2013, J. Vis. Commun. Image Represent..

[14]  Xu Li,et al.  Segmentation of prostate from ultrasound images using level sets on active band and intensity variation across edges. , 2016, Medical physics.

[15]  Lian-Wen Jin,et al.  A robust graph-based segmentation method for breast tumors in ultrasound images. , 2012, Ultrasonics.

[16]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.

[17]  Nassir Navab,et al.  3D intra-operative ultrasound and MR image guidance: pursuing an ultrasound-based management of brainshift to enhance neuronavigation , 2017, International Journal of Computer Assisted Radiology and Surgery.

[18]  Hui-Fuang Ng Automatic thresholding for defect detection , 2006, Pattern Recognit. Lett..

[19]  Long Tang,et al.  Instantaneous Real-Time Kinematic Decimeter-Level Positioning with BeiDou Triple-Frequency Signals over Medium Baselines , 2015, Sensors.

[20]  Francesco Conversano,et al.  Validation of an automatic segmentation method to detect vertebral interfaces in ultrasound images , 2016 .

[21]  Desire Sidibé,et al.  A supervised learning framework of statistical shape and probability priors for automatic prostate segmentation in ultrasound images , 2013, Medical Image Anal..

[22]  D. Louis Collins,et al.  Clinical validation of vessel-based registration for correction of brain-shift , 2007, Medical Image Anal..

[23]  Baohua Zhang,et al.  Research on the ROI registration algorithm of the cardiac CT image time series , 2018, Biomed. Signal Process. Control..

[24]  D. Louis Collins,et al.  Nonrigid Registration of Ultrasound and MRI Using Contextual Conditioned Mutual Information , 2014, IEEE Transactions on Medical Imaging.

[25]  Jan Modersitzky,et al.  FAIR - Flexible Algorithms for Image Registration , 2009, Fundamentals of algorithms.

[26]  Ron Kikinis,et al.  Role of Computers and Image Processing in Image-Guided Brain Tumor Surgery , 2015 .

[27]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[28]  Erlend Hodneland,et al.  Normalized gradient fields and mutual information for motion correction of DCE-MRI images , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[29]  Nassir Navab,et al.  Automatic ultrasound-MRI registration for neurosurgery using the 2D and 3D LC2 Metric , 2014, Medical Image Anal..

[30]  Guy Cloutier,et al.  Segmentation method of intravascular ultrasound images of human coronary arteries , 2014, Comput. Medical Imaging Graph..

[31]  Robert Sheng Xu,et al.  Multiscale Registration of Real-Time and Prior MRI Data for Image-Guided Cardiac Interventions , 2014, IEEE Transactions on Biomedical Engineering.

[32]  Susanne Winter,et al.  Brain tumor classification on intraoperative contrast-enhanced ultrasound , 2015, International Journal of Computer Assisted Radiology and Surgery.

[33]  Xuelong Li,et al.  Graph-based learning for segmentation of 3D ultrasound images , 2015, Neurocomputing.

[34]  Aaron Fenster,et al.  Automatic segmentation approach to extracting neonatal cerebral ventricles from 3D ultrasound images , 2017, Medical Image Anal..

[35]  Jürgen Meixensberger,et al.  Evaluation of a semi-automatic segmentation algorithm in 3D intraoperative ultrasound brain angiography , 2013, Biomedizinische Technik. Biomedical engineering.

[36]  Milan Sonka,et al.  Graph-Based IVUS Segmentation With Efficient Computer-Aided Refinement , 2013, IEEE Transactions on Medical Imaging.

[37]  Isabelle Bloch,et al.  Segmentation of embryonic and fetal 3D ultrasound images based on pixel intensity distributions and shape priors , 2015, Medical Image Anal..

[38]  Erlend Hodneland,et al.  Normalized gradient fields for nonlinear motion correction of DCE-MRI time series , 2014, Comput. Medical Imaging Graph..

[39]  Farida Cheriet,et al.  Segmentation of the spinous process and its acoustic shadow in vertebral ultrasound images , 2016, Comput. Biol. Medicine.

[40]  Eigil Samset,et al.  Automated Segmentation of the Right Ventricle in 3D Echocardiography: A Kalman Filter State Estimation Approach , 2016, IEEE Transactions on Medical Imaging.

[41]  Zhen Yang,et al.  Automatic gallbladder and gallstone regions segmentation in ultrasound image , 2017, International Journal of Computer Assisted Radiology and Surgery.

[42]  Xuelong Li,et al.  Optimized graph-based segmentation for ultrasound images , 2014, Neurocomputing.

[43]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.