Automatic segmentation of head anatomical structures from sparsely-annotated images

Bionic humanoid systems, which are elaborate human models with sensors, have been developed as a tool for quantitative evaluation of doctors' psychomotor skills and medical device performances. For creation of the elaborate human models, this study presents automated segmentation of head sectioned images using sparsely-annotated data based on deep convolutional neural network. We applied the following fully convolutional networks (FCNs) to the sparse-annotation-based segmentation: a standard FCN and a dilated convolution based FCN. To validate the availability of FCNs for segmentation of head structures from sparse annotation, we performed 8- and 243-label segmentation experiments using different two sets of head sectioned images in the Visible Korean Human project. In the segmentation experiments, only 10% of all images in each data set were used for training data. Both of the FCNs could achieve the mean segmentation accuracy of more than 85% in the 8-label segmentation. In the 243-label segmentation, though the mean segmentation accuracy was about 50%, the results suggested that the FCNs, especially the dilated convolution based FCNs, had potential to achieve accurate segmentation of anatomical structures, except for small-sized and complex-shaped tissues, even from sparse annotation.

[1]  Fumihito Arai,et al.  Training system using Bionic-eye for internal limiting membrane peeling , 2016, 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[2]  Byeong-Seok Shin,et al.  Visible Korean Human: Its techniques and applications , 2006, Clinical anatomy.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[5]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[6]  Yang Li,et al.  Gland Instance Segmentation by Deep Multichannel Neural Networks , 2016, ArXiv.

[7]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[8]  Yang Li,et al.  Gland Instance Segmentation Using Deep Multichannel Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[9]  Yoichi Haga,et al.  Micro sensors and actuators for minimally invasive medical devices and bionic humanoid , 2016, 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[10]  Mohammad Eshghi,et al.  Comparison of the deep-learning-based automated segmentation methods for the head sectioned images of the virtual Korean human project , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[11]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[12]  George Papandreou,et al.  Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[15]  Danny Ziyi Chen,et al.  A Deep Learning Approach for Semantic Segmentation in Histology Tissue Images , 2016, MICCAI.

[16]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[17]  Ronald M. Summers,et al.  Spatial Aggregation of Holistically-Nested Networks for Automated Pancreas Segmentation , 2016, MICCAI.