Functional Lifting for Variational Problems with Higher-Order Regularization

Variational approaches are an established paradigm in the field of image processing. The non-convexity of the functional can be addressed by functional lifting and convex relaxation techniques, which aim to solve a convex approximation of the original energy on a larger space. However, so far these approaches have been limited to first-order , gradient-based regularizers such as the total variation . In this work, we propose a way to extend functional lifting to a second-order regularizer derived from the Laplacian. We prove that it can be represented efficiently and thus allows numerical optimization. We experimentally demonstrate the usefulness on a synthetic convex denoising problem and on synthetic as well as real-world image registration problems.

[1]  Daniel Cremers,et al.  Total Variation Regularization for Functions with Values in a Manifold , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  E. Haber,et al.  Numerical methods for volume preserving image registration , 2004 .

[3]  Daniel Cremers,et al.  A Convex Approach to Minimal Partitions , 2012, SIAM J. Imaging Sci..

[4]  Michael Möller,et al.  Sublabel-Accurate Convex Relaxation of Vectorial Multilabel Energies , 2016, ECCV.

[5]  Mila Nikolova,et al.  Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares , 2005, Multiscale Model. Simul..

[6]  Xue-Cheng Tai,et al.  Iterative Image Restoration Combining Total Variation Minimization and a Second-Order Functional , 2005, International Journal of Computer Vision.

[7]  Andy M. Yip,et al.  Total Variation Image Restoration: Overview and Recent Developments , 2006, Handbook of Mathematical Models in Computer Vision.

[8]  Arvid Lundervold,et al.  Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time , 2003, IEEE Trans. Image Process..

[9]  Jing Yuan,et al.  Convex Multi-class Image Labeling by Simplex-Constrained Total Variation , 2009, SSVM.

[10]  S. Setzer,et al.  Infimal convolution regularizations with discrete ℓ1-type functionals , 2011 .

[11]  Jan-Michael Frahm,et al.  Fast Global Labeling for Real-Time Stereo Using Multiple Plane Sweeps , 2008, VMV.

[12]  Michael Möller,et al.  Low Rank Priors for Color Image Regularization , 2015, EMMCVPR.

[13]  Jan Modersitzki,et al.  FAIR: Flexible Algorithms for Image Registration , 2009 .

[14]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[15]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[16]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[17]  Marc Pollefeys,et al.  What Is Optimized in Convex Relaxations for Multilabel Problems: Connecting Discrete and Continuously Inspired MAP Inference , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Françoise Demengel,et al.  Fonctions à hessien borné , 1984 .

[19]  Daniel Cremers,et al.  Global Solutions of Variational Models with Convex Regularization , 2010, SIAM J. Imaging Sci..

[20]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[21]  Wenjiang J. Fu Penalized Regressions: The Bridge versus the Lasso , 1998 .

[22]  Michael Möller,et al.  The Primal-Dual Hybrid Gradient Method for Semiconvex Splittings , 2014, SIAM J. Imaging Sci..

[23]  Carola-Bibiane Schönlieb,et al.  A Combined First and Second Order Variational Approach for Image Reconstruction , 2012, Journal of Mathematical Imaging and Vision.

[24]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[25]  Otmar Scherzer,et al.  Variational Methods on the Space of Functions of Bounded Hessian for Convexification and Denoising , 2005, Computing.

[26]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[27]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, CVPR.

[28]  Christoph Schnörr,et al.  Continuous Multiclass Labeling Approaches and Algorithms , 2011, SIAM J. Imaging Sci..

[29]  Stefan Henn,et al.  A Full Curvature Based Algorithm for Image Registration , 2006, Journal of Mathematical Imaging and Vision.

[30]  Michael Möller,et al.  Sublabel–Accurate Relaxation of Nonconvex Energies , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004 .

[32]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[33]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  R. Rockafellar Convex Analysis: (pms-28) , 1970 .

[35]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[36]  W. Ziemer Weakly differentiable functions , 1989 .

[37]  Jan Modersitzki,et al.  Curvature Based Image Registration , 2004, Journal of Mathematical Imaging and Vision.

[38]  Xue-Cheng Tai,et al.  A Continuous Max-Flow Approach to Potts Model , 2010, ECCV.

[39]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .