Enhancing Medical Imaging Semantic Segmentation Using the Digital Annealer

Deep convolutional neural networks (DCNNs) are demonstrating their strong capability in solving computer vision problems. As for medical imaging semantic segmentation, DCNN models have become one of the most fundamental constituent. However, high-quality semantic segmentation requires pixel-wise prediction with high precision, which usually cannot be achieved only by DCNNs due to their lack of representation of pixel interactions. In this work, we propose a novel method based on conditional random fields (CRFs) and Ising model. It applies the Digital Annealer (DA) as a complement to traditional methods that only employ DCNNs. Our experiment results manifest that the use of DA can enhance the segmentation accuracy on BRATS2012 data set by over 8%. Our work potentially builds a new pathway in this realm.

[1]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[2]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Carsten Rother,et al.  Conditional Random Fields Meet Deep Neural Networks for Semantic Segmentation: Combining Probabilistic Graphical Models with Deep Learning for Structured Prediction , 2018, IEEE Signal Processing Magazine.

[5]  R. Glauber.  Time‐Dependent Statistics of the Ising Model , 1963 .

[6]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[7]  Seungmin Rho,et al.  Medical image semantic segmentation based on deep learning , 2017, Neural Computing and Applications.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Jonathan T. Barron,et al.  Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  T. Hotta.  Mean-Field Approximation , 2003 .

[12]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Xiaoxiao Li,et al.  Deep Learning Markov Random Field for Semantic Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Sanroku Tsukamoto,et al.  Ising-Model Optimizer with Parallel-Trial Bit-Sieve Engine , 2017, CISIS.

[16]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).