Using deep image prior to assist variational selective segmentation deep learning algorithms

Variational segmentation algorithms require a prior imposed in the form of a regularisation term to enforce smoothness of the solution. Recently, it was shown in the Deep Image Prior work that the explicit regularisation in a model can be removed and replaced by the implicit regularisation captured by the architecture of a neural network. The Deep Image Prior approach is competitive, but is only tailored to one specific image and does not allow us to predict future images. We propose to incorporate the ideas from Deep Image Prior into a more traditional learning algorithm to allow us to use the implicit regularisation offered by the Deep Image Prior, but still be able to predict future images.

[1]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[2]  Yukun Cao,et al.  Learning Directional Feature Maps for Cardiac MRI Segmentation , 2020, MICCAI.

[3]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method Using a Convex Variant of the Mumford-Shah Model and Thresholding , 2013, SIAM J. Imaging Sci..

[4]  K. Murphy,et al.  Learn2Reg Challenge: CT Lung Registration - Training Data , 2020 .

[5]  Hao Chen,et al.  The Liver Tumor Segmentation Benchmark (LiTS) , 2019, Medical Image Anal..

[6]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[7]  Shuai Chen,et al.  Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentation , 2019, MICCAI.

[8]  Alexandros G. Dimakis,et al.  Compressed Sensing with Deep Image Prior and Learned Regularization , 2018, ArXiv.

[9]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[10]  Michael Roberts,et al.  A Convex Geodesic Selective Model for Image Segmentation , 2018, Journal of Mathematical Imaging and Vision.

[11]  Michael Elad,et al.  DeepRED: Deep Image Prior Powered by RED , 2019, ICCV 2019.

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Dwarikanath Mahapatra,et al.  Semi-supervised Segmentation of Optic Cup in Retinal Fundus Images Using Variational Autoencoder , 2017, MICCAI.

[14]  Xiahai Zhuang,et al.  Joint Left Atrial Segmentation and Scar Quantification Based on a DNN with Spatial Encoding and Shape Attention , 2020, MICCAI.

[15]  Ke Chen,et al.  On New Convolutional Neural Network Based Algorithms for Selective Segmentation of Images , 2020, MIUA.

[16]  Brahim Ait Skourt,et al.  Lung CT Image Segmentation Using Deep Neural Networks , 2018 .

[17]  Jack A. Spencer,et al.  A CONVEX AND SELECTIVE VARIATIONAL MODEL FOR IMAGE SEGMENTATION , 2015 .

[18]  Li Bai,et al.  New second order Mumford–Shah model based on Γ-convergence approximation for image processing , 2016 .

[19]  Xue-Cheng Tai,et al.  Image Segmentation Using Euler’s Elastica as the Regularization , 2013, J. Sci. Comput..

[20]  Michael Roberts,et al.  Chan–Vese Reformulation for Selective Image Segmentation , 2018, Journal of Mathematical Imaging and Vision.

[21]  Ulugbek Kamilov,et al.  Image Restoration Using Total Variation Regularized Deep Image Prior , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Meritxell Bach Cuadra,et al.  Automated Detection of Cortical Lesions in Multiple Sclerosis Patients with 7T MRI , 2020, MICCAI.

[25]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[26]  C. V. Jawahar,et al.  Universal Semi-Supervised Semantic Segmentation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).