A 3D CNN with a Learnable Adaptive Shape Prior for Accurate Segmentation of Bladder Wall Using MR Images

A 3D deep learning-based convolution neural network (CNN) is developed for accurate segmentation of pathological bladder (both wall border and pathology) using T2-weighted magnetic resonance imaging (T2W-MRI). Our system starts with a preprocessing step for data normalization to a unique space and extraction of a region-of-interest (ROI). The major stage utilizes a 3D CNN for pathological bladder segmentation, which contains a network, called CNN1, that aims to segment the bladder wall (BW) with pathology. However, due to the similar visual appearance of BW and pathology, the CNN1 can not separate them. Thus, we developed another network (CNN2) with an additional pathway to extract BW only. The second pathway in CNN2 is fed with a 3D learnable adaptive shape prior model. To remove noisy and scattered predictions, the networks' soft outputs are refined using a fully connected conditional random field. Our framework achieved accurate segmentation results for the BW and tumor as documented by the Dice similarity coefficient and Hausdorff distance. Moreover, comparative results against the other segmentation approach documented the superiority of our framework to provide accurate results for pathological BW segmentation.

[1]  Ayman El-Baz,et al.  Predictive Biomarkers for Neoadjuvant Chemotherapy Response in Muscle-Invasive Bladder Cancer: A survey , 2018, 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[2]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[3]  Zhengrong Liang,et al.  A Coupled Level Set Framework for Bladder Wall Segmentation With Application to MR Cystography , 2010, IEEE Transactions on Medical Imaging.

[4]  Jing Yuan,et al.  Simultaneous Segmentation of Multiple Regions in 3D Bladder MRI by Efficient Convex Optimization of Coupled Surfaces , 2017, ICIG.

[5]  Jing Yuan,et al.  Multiregion segmentation of bladder cancer structures in MRI with progressive dilated convolutional networks , 2018, Medical physics.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  U. G. Dailey Cancer,Facts and Figures about. , 2022, Journal of the National Medical Association.

[8]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[9]  Ayman El-Baz,et al.  Accurate Lungs Segmentation on CT Chest Images by Adaptive Appearance-Guided Shape Modeling , 2017, IEEE Transactions on Medical Imaging.

[10]  Bo Du,et al.  Shape prior constrained PSO model for bladder wall MRI segmentation , 2017, Neurocomputing.

[11]  Ayman El-Baz,et al.  MRI Markers for Early Assessment of Bladder Cancer: A Review , 2018, 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[12]  Hongbing Lu,et al.  Partial sparse shape constrained sector-driven bladder wall segmentation , 2015, Machine Vision and Applications.

[13]  Ben Glocker,et al.  Deformable medical image registration: setting the state of the art with discrete methods. , 2011, Annual review of biomedical engineering.

[14]  Chronic Disease Division Cancer facts and figures , 2010 .

[15]  Ayman El-Baz,et al.  State-of-the-Art Medical Image Registration Methodologies: A Survey , 2011 .

[16]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[17]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[18]  Zhengrong Liang,et al.  A unified EM approach to bladder wall segmentation with coupled level-set constraints , 2013, Medical Image Anal..

[19]  Adel Said Elmaghraby,et al.  A CNN-Based Framework for Bladder Wall Segmentation Using MRI , 2019, 2019 Fifth International Conference on Advances in Biomedical Engineering (ICABME).

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.