Ensemble Learning and Tensor Regularization for Cone-Beam Computed Tomography-Based Pelvic Organ Segmentation

Cone-beam computed tomography (CBCT) is a widely accessible low-dose imaging approach. However, its use in comprehensive anatomy monitoring is hindered by low contrast and artifacts, resulting in difficulty in identifying structure boundaries. In this study, we propose an ensemble deep-learning model to segment post-prostatectomy organs automatically. We utilize the ensemble logic in various modules during the segmentation process to alleviate the impact of low image quality. Specifically, (1) semantic attention was obtained from an ensemble 2.5D You-only-look-once detector to consistently define regions of interest, (2) multiple view-specific two-stream 2.5D segmentation networks were developed, using auxiliary high-quality CT data to aid CBCT segmentation, and (3) a novel tensor-regularized ensemble scheme was proposed to aggregate the estimates from multiple views and regularize the spatial integrity of the final segmentation. A cross validation study achieved Dice similarity coefficient and mean surface distance of 0.779 ± 0.069 and 2.895 ± 1.496 mm for the rectum, and 0.915 ± 0.055 and 1.675 ± 1.311 mm for the bladder, which are comparable to human observer variation.

[1]  Hongfei Sun,et al.  Imaging Study of Pseudo-CT Synthesized From Cone-Beam CT Based on 3D CycleGAN in Radiotherapy , 2021, Frontiers in Oncology.

[2]  O. Gurjar,et al.  A study on prostate movement and dosimetric variation because of bladder and rectum volumes changes during the course of image-guided radiotherapy in prostate cancer , 2020, Prostate international.

[3]  Abbas Shirinifard,et al.  A 2.5d Yolo-Based Fusion Algorithm for 3d Localization Of Cells , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[4]  Tianye Niu,et al.  Image-domain multimaterial decomposition for dual-energy computed tomography with nonconvex sparsity regularization , 2019, Journal of medical imaging.

[5]  Ben Glocker,et al.  Multi-modal Learning from Unpaired Images: Application to Multi-organ Segmentation in CT and MRI , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Suvrit Sra,et al.  Modular Proximal Optimization for Multidimensional Total-Variation Regularization , 2014, J. Mach. Learn. Res..

[9]  I. Chetty,et al.  A novel approach for establishing benchmark CBCT/CT deformable image registrations in prostate cancer radiotherapy , 2013, Physics in medicine and biology.

[10]  Miguel Á. Carreira-Perpiñán,et al.  Projection onto the probability simplex: An efficient algorithm with a simple proof, and an application , 2013, ArXiv.

[11]  Jing Yuan,et al.  Convex Multi-class Image Labeling by Simplex-Constrained Total Variation , 2009, SSVM.

[12]  J. P. McKelvey,et al.  Simple transcendental expressions for the roots of cubic equations , 1984 .