A recursive ensemble organ segmentation (REOS) framework: application in brain radiotherapy

The aim of this work is to develop a novel recursive ensemble OARs segmentation (REOS) framework for accurate organs-at-risk (OARs) automatic segmentation. The REOS recursively segment individual OARs by ensembling images features extracted from an organ localization module and a contour detection module. Both modules are based on a 3D U-Net architecture. The organ localization module is trained for rough segmentation to localize a region of interest (ROI) that encompasses the to-be-delineated OAR, while the contour detection module is trained to segment the OAR within the identified ROI. In this study, the developed REOS framework is applied for brain radiotherapy on segmenting six OARs including the eyes, the brainstem (BS), the optical nerves and the chiasm. Eighty T1-weighted magnetic resonance images (MRI) from 80 brain cancer patients' cases with OARs' gold standard contours were collected for training and testing REOS. On 20 testing cases, the REOS achieve a high segmentation accuracy with Dice similarity coefficient (DSC) mean and standard deviation of 93.9%  ±  1.4%, 94.5%  ±  2.0%, 90.6%  ±  2.7%, on the left and right eyes and the BS, respectively. On small and segmentation-challenging organs, the left and right optical nerves and the chiasm, the REOS achieves DSC of 78.0%  ±  10.5%, 82.2%  ±  5.9% and 71.1%  ±  9.1%. The satisfactory performances demonstrated the effectiveness of the REOS in OARs segmentation.

[1]  Dinggang Shen,et al.  Interleaved 3D-CNNs for joint segmentation of small-volume structures in head and neck CT images. , 2018, Medical physics.

[2]  Raheel Nawaz,et al.  Active Contours Based Segmentation and Lesion Periphery Analysis for Characterization of Skin Lesions in Dermoscopy Images , 2019, IEEE Journal of Biomedical and Health Informatics.

[3]  M A Deeley,et al.  Comparison of manual and automatic segmentation methods for brain structures in the presence of space-occupying lesions: a multi-expert study , 2011, Physics in medicine and biology.

[4]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[5]  Linghong Zhou,et al.  Internal Motion Estimation by Internal-external Motion Modeling for Lung Cancer Radiotherapy , 2018, Scientific Reports.

[6]  Dean F. Sittig,et al.  Prospective randomized double-blind study of atlas-based organ-at-risk autosegmentation-assisted radiation planning in head and neck cancer. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[7]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[8]  Maximilien Vermandel,et al.  A deep learning classification scheme based on augmented-enhanced features to segment organs at risk on the optic region in brain cancer patients , 2017, ArXiv.

[9]  Miao Liao,et al.  Automatic liver vessel segmentation using 3D region growing and hybrid active contour model , 2018, Comput. Biol. Medicine.

[10]  Nicholas Slevin,et al.  Evaluation of an automatic segmentation algorithm for definition of head and neck organs at risk , 2014, Radiation oncology.

[11]  Maximilien Vermandel,et al.  A fast and fully automated approach to segment optic nerves on MRI and its application to radiosurgery , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[12]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Mehdi Astaraki,et al.  Evaluation of localized region-based segmentation algorithms for CT-based delineation of organs at risk in radiotherapy , 2018, Physics and imaging in radiation oncology.

[14]  Thomas Vetter,et al.  Image Segmentation with a Statistical Appearance Model and a Generic Mumford-Shah Inspired Outside Model , 2010, DAGM-Symposium.

[15]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[16]  Laurent Najman,et al.  Watershed of a continuous function , 1994, Signal Process..

[17]  Vladimir Pekar,et al.  Automated model-based organ delineation for radiotherapy planning in prostatic region. , 2004, International journal of radiation oncology, biology, physics.

[18]  Meritxell Bach Cuadra,et al.  A review of atlas-based segmentation for magnetic resonance brain images , 2011, Comput. Methods Programs Biomed..

[19]  J J Vaquero,et al.  Applying watershed algorithms to the segmentation of clustered nuclei. , 1998, Cytometry.

[20]  Paolo Zaffino,et al.  Automatic segmentation of head and neck CT images for radiotherapy treatment planning using multiple atlases, statistical appearance models, and geodesic active contours. , 2014, Medical physics.

[21]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[22]  Jean-François Daisne,et al.  Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation , 2013, Radiation oncology.

[23]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[24]  Françoise Peyrin,et al.  Automated 3D region growing algorithm based on an assessment function , 2002, Pattern Recognit. Lett..

[25]  Xiao Han,et al.  Clinical validation of atlas-based auto-segmentation of multiple target volumes and normal tissue (swallowing/mastication) structures in the head and neck. , 2011, International journal of radiation oncology, biology, physics.

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[28]  Vladimir Pekar,et al.  Auto-segmentation of normal and target structures in head and neck CT images: a feature-driven model-based approach. , 2011, Medical physics.

[29]  Francesco Lagona,et al.  Model-based segmentation of spatial cylindrical data , 2016 .

[30]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[31]  G. Sharp,et al.  Vision 20/20: perspectives on automated image segmentation for radiotherapy. , 2014, Medical physics.

[32]  N. Ayache,et al.  Atlas-based automatic segmentation of MR images: validation study on the brainstem in radiotherapy context. , 2005, International journal of radiation oncology, biology, physics.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .