Prostate MRI Segmentation Using Learned Semantic Knowledge and Graph Cuts

We propose a fully automated method for prostate segmentation using random forests (RFs) and graph cuts. A volume of interest (VOI) is automatically selected using supervoxel segmentation, and its subsequent classification using image features and RF classifiers. The VOIs probability map is generated using image and context features, and a second set of RF classifiers. The negative log-likelihood of the probability maps acts as the penalty cost in a second-order Markov random field cost function. Semantic information from the second set of RF classifiers is an important measure of each feature to the classification task, which contributes to formulating the smoothness cost. The cost function is optimized using graph cuts to get the final segmentation of the prostate. With average dice metric (DM) (on the training set) and DM (on the test set), our experimental results show that inclusion of the context and semantic information contributes to higher segmentation accuracy than other methods.

[1]  Jocelyne Troccaz,et al.  Automated segmentation of the prostate in 3D MR images using a probabilistic atlas and a spatially constrained deformable model. , 2010, Medical physics.

[2]  Olivier Colot,et al.  Combining a deformable model and a probabilistic framework for an automatic 3D segmentation of prostate on MRI , 2009, International Journal of Computer Assisted Radiology and Surgery.

[3]  Zezhi Chen,et al.  Detecting and Classifying Linear Structures in Mammograms Using Random Forests , 2011, IPMI.

[4]  Joachim M. Buhmann,et al.  Computational modeling for assessment of IBD: To be or not to be? , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Antonio Criminisi,et al.  Regression forests for efficient anatomy detection and localization in computed tomography scans , 2013, Medical Image Anal..

[6]  Joachim M. Buhmann,et al.  Automatic Detection and Segmentation of Crohn's Disease Tissues From Abdominal MRI , 2013, IEEE Transactions on Medical Imaging.

[7]  Stefan Klein,et al.  Automatic segmentation of the prostate in 3D MR images by atlas matching using localized mutual information. , 2008, Medical physics.

[8]  Dimitris N. Metaxas,et al.  Entangled Decision Forests and Their Application for Semantic Segmentation of CT Images , 2011, IPMI.

[9]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  C. Davatzikos,et al.  Multi-Atlas Segmentation of the Prostate: A Zooming Process with Robust Registration and Atlas Selection , 2012 .

[11]  Dwarikanath Mahapatra,et al.  Orientation Histograms as Shape Priors for Left Ventricle Segmentation Using Graph Cuts , 2011, MICCAI.

[12]  Joachim M. Buhmann,et al.  A Supervised Learning Based Approach to Detect Crohn's Disease in Abdominal MR Volumes , 2012, Abdominal Imaging.

[13]  M. Bowes,et al.  Fully Automatic Segmentation of the Prostate using Active Appearance Models , 2012 .

[14]  Dwarikanath Mahapatra,et al.  MRF-Based Intensity Invariant Elastic Registration of Cardiac Perfusion Images Using Saliency Information , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Wei Li,et al.  Learning Image Context for Segmentation of Prostate in CT-Guided Radiotherapy , 2011, MICCAI.

[16]  B Julesz,et al.  Inability of Humans to Discriminate between Visual Textures That Agree in Second-Order Statistics—Revisited , 1973, Perception.

[17]  Joachim M. Buhmann,et al.  Crohn's disease tissue segmentation from abdominal MRI using semantic information and graph cuts , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[18]  Emmanouil Moschidis,et al.  Automatic differential segmentation of the prostate in 3-D MRI using Random Forest classification and graph-cuts optimization , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[19]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[21]  Nico Karssemeijer,et al.  A multi-atlas approach for prostate segmentation in MR images , 2012 .

[22]  M. Kirschner,et al.  Automatic Prostate Segmentation in MR Images with a Probabilistic Active Shape Model , 2012 .

[23]  Dwarikanath Mahapatra,et al.  Integrating Segmentation Information for Improved MRF-Based Elastic Image Registration , 2012, IEEE Transactions on Image Processing.

[24]  Anant Madabhushi,et al.  Multifeature Landmark-Free Active Appearance Models: Application to Prostate MRI Segmentation , 2012, IEEE Transactions on Medical Imaging.

[25]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Soumya Ghose,et al.  A Random Forest Based Classification Approach to Prostate Segmentation in MRI , 2012 .

[27]  Maximilien Vermandel,et al.  Automatic segmentation of pelvic structures from magnetic resonance images for prostate cancer radiotherapy. , 2007, International journal of radiation oncology, biology, physics.

[28]  L G Nyúl,et al.  On standardizing the MR image intensity scale , 1999, Magnetic resonance in medicine.

[29]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[30]  Daniel Rueckert,et al.  An automatic multi-atlas based prostate segmentation using local appearance-speci c atlases and patch-based voxel weighting , 2012 .

[31]  Jagath Samarabandu,et al.  Prostate Segmentation from 2-D Ultrasound Images Using Graph Cuts and Domain Knowledge , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[32]  Ferdinand van der Heijden,et al.  Prostate MR image segmentation using 3D active appearance models , 2012 .

[33]  Neil Birkbeck,et al.  Region-Specific Hierarchical Segmentation of MR Prostate Using Discriminative Learning , 2012 .

[34]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[35]  Joachim M. Buhmann,et al.  Localizing and segmenting Crohn's disease affected regions in abdominal MRI using novel context features , 2013, Medical Imaging.