Fast medical image segmentation based on patch sharing

The lack of labeled medical data is a severe challenge of applying CNNs in medical image segmentation. The common method to solve this problem is employing patches extracted from every pixel of the entire image as train samples. But classifying every pixel in the image is time-consuming, which is not appropriate in practical medical application. This paper proposed a fast segmentation algorithm based on trained network model to reduce test time. Transforming the fully-connected layer of trained network into convolutional layer is used as the test network and the entire image is the input of test network. However, due to the convolutional and pooling operation of CNN, some pixel classification results are missed. To obtain corresponding segmentation, different size of original image are cropped as the input of test network, and interpolation is taken to supply the final image segmentation, according to the offset rule of the input images. The numerical simulation experiments indicated that the proposed algorithm show prominent performance in segmentation time and remain unchanged in the final segmentation result compared with initial train network architecture.

[1]  Stefan Bauer,et al.  Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization , 2011, MICCAI.

[2]  Shuiwang Ji,et al.  Residual Deconvolutional Networks for Brain Electron Microscopy Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[3]  Brian B. Avants,et al.  Evaluation of automatic neonatal brain segmentation algorithms: The NeoBrainS12 challenge , 2015, Medical Image Anal..

[4]  Max A. Viergever,et al.  Automatic segmentation of MR brain images of preterm infants using supervised classification , 2015, NeuroImage.

[5]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[6]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[7]  Brian B. Avants,et al.  Optimal Symmetric Multimodal Templates and Concatenated Random Forests for Supervised Brain Tumor Segmentation (Simplified) with ANTsR , 2014, Neuroinformatics.

[8]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[9]  Jürgen Schmidhuber,et al.  Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation , 2015, NIPS.

[10]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[11]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[12]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[13]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Hao Chen,et al.  VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation , 2016, ArXiv.

[15]  Henning Müller,et al.  Using Multiscale Visual Words for Lung Texture Classification and Retrieval , 2011, MCBR-CDS.

[16]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[17]  Dimitri Van De Ville,et al.  Near-Affine-Invariant Texture Learning for Lung Tissue Analysis Using Isotropic Wavelet Frames , 2012, IEEE Transactions on Information Technology in Biomedicine.

[18]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Daniel Rueckert,et al.  Automatic tissue and structural segmentation of neonatal brain MRI using Expectation-Maximization , 2012 .

[21]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[22]  P. Lambin,et al.  Predicting outcomes in radiation oncology—multifactorial decision support systems , 2013, Nature Reviews Clinical Oncology.

[23]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[24]  L. Schwartz,et al.  Promise and pitfalls of quantitative imaging in oncology clinical trials. , 2012, Magnetic resonance imaging.

[25]  B. van Ginneken,et al.  Computer-aided diagnosis in high resolution CT of the lungs. , 2003, Medical physics.

[26]  Lauge Sørensen,et al.  A Texton-Based Approach for the Classification of Lung Parenchyma in CT Images , 2010, MICCAI.

[27]  Chi-Hoon Lee,et al.  Segmenting Brain Tumors Using Pseudo-Conditional Random Fields , 2008, MICCAI.