Accelerated sparse optimization for missing data completion

In this paper, we propose an algorithm for missing value recovery of visual data such as image or video. These missing values may result from the corruption in acquisition process, or user-specified unexpected outliers. This problem exists in wide range of applications. We use the nuclear norm (NN) regularization to enforce the global consistency of the image, while the total variation (TV) regularization is used to encourage the locally consistent in image intensity domain. This model can be applied in very challenging scenarios, where only very small amount of data is available. However, it is very difficult to efficiently solve these two regularizations simultaneously by convex programming due to its composite structure and non-smoothness. To this end, we propose an efficient proximal-splitting algorithm for joint NN/TV minimization. The proposed algorithm is theoretically guaranteed to achieve a convergence rate of O(1/N) for N iterations, which is much faster than O(1/√N) by the black-box first-order method for solving the non-smooth optimization problem. In our experiments, we demonstrate the superior performance of our algorithm on image completion compared with seven state-of-the-art algorithms.

[1]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[2]  Daniel K Sodickson,et al.  Low‐rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components , 2015, Magnetic resonance in medicine.

[3]  Emmanuel J. Candès,et al.  Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements , 2011, IEEE Transactions on Information Theory.

[4]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[5]  Deanna Needell,et al.  Stable Image Reconstruction Using Total Variation Minimization , 2012, SIAM J. Imaging Sci..

[6]  Junzhou Huang,et al.  Preconditioning for Accelerated Iteratively Reweighted Least Squares in Structured Sparsity Reconstruction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[8]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[9]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[10]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[11]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Dinggang Shen,et al.  Low-Rank Total Variation for Image Super-Resolution , 2013, MICCAI.

[13]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[14]  Anders P. Eriksson,et al.  Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L1 norm , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Tsuhan Chen,et al.  Tensor Total-Variation Regularized Deconvolution for Efficient Low-Dose CT Perfusion , 2014, MICCAI.

[16]  Shuicheng Yan,et al.  Generalized Nonconvex Nonsmooth Low-Rank Minimization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Junzhou Huang,et al.  RSPIRIT: Robust self-consistent parallel imaging reconstruction based on generalized Lasso , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[18]  Takayuki Okatani,et al.  Efficient algorithm for low-rank matrix factorization with missing components and performance comparison of latest algorithms , 2011, 2011 International Conference on Computer Vision.

[19]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[20]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[21]  Junzhou Huang,et al.  Accelerated Dynamic MRI Reconstruction with Total Variation and Nuclear Norm Regularization , 2015, MICCAI.

[22]  Junzhou Huang,et al.  Efficient Preconditioning in Joint Total Variation Regularized Parallel MRI Reconstruction , 2015, MICCAI.

[23]  Junzhou Huang,et al.  Fast Optimization for Mixture Prior Models , 2010, ECCV.

[24]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[25]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[26]  Xuelong Li,et al.  Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[28]  Bingsheng He,et al.  Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective , 2012, SIAM J. Imaging Sci..

[29]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Junzhou Huang,et al.  Efficient Lung Cancer Cell Detection with Deep Convolution Neural Network , 2015, Patch-MI@MICCAI.

[31]  Jian Sun,et al.  Image Completion Approaches Using the Statistics of Similar Patches , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Junzhou Huang,et al.  Composite splitting algorithms for convex optimization , 2011, Comput. Vis. Image Underst..

[33]  Pierre Vandergheynst,et al.  Joint trace/TV norm minimization: A new efficient approach for spectral compressive imaging , 2012, 2012 19th IEEE International Conference on Image Processing.

[34]  Misha Elena Kilmer,et al.  Novel Methods for Multilinear Data Completion and De-noising Based on Tensor-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.