Automatic segmentation of eyeball structures from micro-CT images based on sparse annotation

A surgical simulator with elaborate artificial eyeball models has been developed for ophthalmic surgeries, in which sophisticated skills are required. To create the elaborate eyeball models with microstructures included in an eyeball, a database of eyeball models should be compiled by segmenting eye structures based on high-resolution medical images. Therefore, this paper presents an automated segmentation of eye structures from micro-CT images by using Fully Convolutional Networks (FCNs). In particular, we aim to construct a method for accurately segmenting eye structures from sparse annotation data. This method performs end-to-end segmentation of eye structures, including a workflow from training the FCN based on sparse annotation to obtaining the segmentation of the entire eyeball. We use the FCN trained on the slices sparsely annotated in a micro-CT volume to segment the remaining slices in the same volume. To achieve accurate segmentation from less annotated images, the multi-class segmentation is performed by using the network trained on the preprocessed and augmented micro-CT images; in the preprocessing, we apply filters for removing ring artifacts and random noises to the images, while in the data augmentation process, rotation and elastic deformation operations are performed on the sparsely-annotated training data. From the results of experiments for evaluating segmentation performances based on sparse annotation, we found that the FCN trained with data augmentation could achieve high segmentation accuracy of more than 90% even from a sparse training subset of only 2.5% of all slices.

[1]  Meritxell Bach Cuadra,et al.  Automatic Segmentation of the Eye in 3D Magnetic Resonance Imaging: A Novel Statistical Shape Model for Treatment Planning of Retinoblastoma. , 2015, International journal of radiation oncology, biology, physics.

[2]  Krish D Singh,et al.  Three-dimensional modeling of the human eye based on magnetic resonance imaging. , 2006, Investigative ophthalmology & visual science.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Sundaresh Ram,et al.  Three-Dimensional Segmentation of the Ex-Vivo Anterior Lamina Cribrosa From Second-Harmonic Imaging Microscopy , 2018, IEEE Transactions on Biomedical Engineering.

[5]  Fumihito Arai,et al.  Training system using Bionic-eye for internal limiting membrane peeling , 2016, 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[6]  Gregory Shakhnarovich,et al.  Feedforward semantic segmentation with zoom-out features , 2014, CVPR.

[7]  Jelena Novosel,et al.  Loosely coupled level sets for simultaneous 3D retinal layer segmentation in optical coherence tomography , 2015, Medical Image Anal..

[8]  B. Münch,et al.  Stripe and ring artifact removal with combined wavelet--Fourier filtering. , 2009, Optics express.

[9]  C. R. Ethier,et al.  Automated segmentation of the lamina cribrosa using Frangi's filter: a novel approach for rapid identification of tissue volume fraction and beam orientation in a trabeculated structure in the eye , 2015, Journal of The Royal Society Interface.