Fast anatomy segmentation by combining coarse scale multi-atlas label fusion with fine scale corrective learning

Deformable registration based multi-atlas segmentation has been successfully applied in a broad range of anatomy segmentation applications. However, the excellent performance comes with a high computational burden due to the requirement for deformable image registration and voxel-wise label fusion. To address this problem, we investigate the role of corrective learning (Wang et al., 2011) in speeding up multi-atlas segmentation. We propose to combine multi-atlas segmentation with corrective learning in a multi-scale analysis fashion for faster speeds. First, multi-atlas segmentation is applied in a low spatial resolution. After resampling the segmentation result back to the native image space, learning-based error correction is applied to correct systematic errors due to performing multi-atlas segmentation in a low spatial resolution. In cardiac CT and brain MR segmentation experiments, we show that applying multi-atlas segmentation in a coarse scale followed by learning-based error correction in the native space can substantially reduce the overall computational cost, with only modest or no sacrificing segmentation accuracy.

[1]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[2]  Yuankai Huo,et al.  Multi-atlas learner fusion: An efficient segmentation approach for large-scale data , 2015, Medical Image Anal..

[3]  Yaozong Gao,et al.  Learning to Rank Atlases for Multiple-Atlas Segmentation , 2014, IEEE Transactions on Medical Imaging.

[4]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[5]  Nassir Navab,et al.  Metric hashing forests , 2016, Medical Image Anal..

[6]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[7]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[8]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[9]  Brian B. Avants,et al.  The optimal template effect in hippocampus studies of diseased populations , 2010, NeuroImage.

[10]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[11]  Paul A. Yushkevich,et al.  Spatial bias in multi-atlas based segmentation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Brian B. Avants,et al.  A learning-based wrapper method to correct systematic errors in automatic image segmentation: Consistently improved performance in hippocampus, cortex and brain segmentation , 2011, NeuroImage.

[13]  Valerie Duay,et al.  Atlas-based Segmentation , 2015 .

[14]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[15]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[16]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[17]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Paul M. Thompson,et al.  Automated Extraction of the Cortical Sulci Based on a Supervised Learning Approach , 2007, IEEE Transactions on Medical Imaging.

[20]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[21]  Hongzhi Wang,et al.  Segmentation of anatomical structures in cardiac CTA using multi-label V-Net , 2018, Medical Imaging.

[22]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[23]  Paul A. Yushkevich,et al.  Multi-atlas segmentation with joint label fusion and corrective learning—an open source implementation , 2013, Front. Neuroinform..

[24]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[25]  D. Louis Collins,et al.  Optimized PatchMatch for Near Real Time and Accurate Label Fusion , 2014, MICCAI.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.