Lifting methods for manifold-valued variational problems

Lifting methods allow to transform hard variational problems such as segmentation and optical flow estimation into convex problems in a suitable higher-dimensional space. The lifted models can then be efficiently solved to a global optimum, which allows to find approximate global minimizers of the original problem. Recently, these techniques have also been applied to problems with values in a manifold. We provide a review of such methods in a refined framework based on a finite element discretization of the range, which extends the concept of sublabel-accurate lifting to manifolds. We also generalize existing methods for total variation regularization to support general convex regularization.

[1]  Andreas Weinmann,et al.  Wavelet Sparse Regularization for Manifold-Valued Data , 2018, Multiscale Model. Simul..

[2]  Ronny Bergmann,et al.  A Graph Framework for Manifold-Valued Data , 2017, SIAM J. Imaging Sci..

[3]  Anders Heyden,et al.  Convex multi-region segmentation on manifolds , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Jan Lellmann,et al.  Functional Liftings of Vectorial Variational Problems with Laplacian Regularization , 2019, SSVM.

[5]  H. Fédérer,et al.  Real Flat Chains, Cochains and Variational Problems , 1974 .

[6]  Daniel Cremers,et al.  Total Cyclic Variation and Generalizations , 2013, Journal of Mathematical Imaging and Vision.

[7]  Daniel Cremers,et al.  Tight Convex Relaxations for Vector-Valued Labeling , 2013, SIAM J. Imaging Sci..

[8]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[9]  Horst Bischof,et al.  Minimizing TGV-Based Variational Models with Non-convex Data Terms , 2013, SSVM.

[10]  G. Bouchitté,et al.  A Duality Theory for Non-convex Problems in the Calculus of Variations , 2016, 1607.02878.

[11]  Gabriele Steidl,et al.  Recent advances in denoising of manifold-valued images , 2018, Handbook of Numerical Analysis.

[12]  Andreas Weinmann,et al.  Total Variation Regularization for Manifold-Valued Data , 2013, SIAM J. Imaging Sci..

[13]  Michael Möller,et al.  Sublabel-Accurate Convex Relaxation of Vectorial Multilabel Energies , 2016, ECCV.

[14]  Christoph Schnörr,et al.  Convex optimization for multi-class image labeling with a novel family of total variation based regularizers , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  M. Bacák Convex Analysis and Optimization in Hadamard Spaces , 2014 .

[16]  Helmut Schaeben,et al.  Grain detection from 2d and 3d EBSD data--specification of the MTEX algorithm. , 2011, Ultramicroscopy.

[17]  Jan-Michael Frahm,et al.  Fast Global Labeling for Real-Time Stereo Using Multiple Plane Sweeps , 2008, VMV.

[18]  Daniel Cremers,et al.  Lifting Vectorial Variational Problems: A Natural Formulation Based on Geometric Measure Theory and Discrete Exterior Calculus , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Daniel Cremers,et al.  Global Solutions of Variational Models with Convex Regularization , 2010, SIAM J. Imaging Sci..

[20]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[21]  Christoph Schnörr,et al.  Discrete and Continuous Models for Partitioning Problems , 2013, International Journal of Computer Vision.

[22]  Evgeny Strekalovskiy,et al.  Convex Relaxation of Variational Models with Applications in Image Analysis , 2015 .

[23]  Hiroshi Ishikawa,et al.  Exact Optimization for Markov Random Fields with Convex Priors , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Tony F. Chan,et al.  Total Variation Denoising and Enhancement of Color Images Based on the CB and HSV Color Models , 2001, J. Vis. Commun. Image Represent..

[25]  Daniel Cremers,et al.  Convex Relaxation for Multilabel Problems with Product Label Spaces , 2010, ECCV.

[26]  Alon Wolf,et al.  Group-Valued Regularization Framework for Motion Segmentation of Dynamic Non-rigid Shapes , 2011, SSVM.

[27]  Nassir Navab,et al.  Combined Tensor Fitting and TV Regularization in Diffusion Tensor Imaging Based on a Riemannian Manifold Approach , 2016, IEEE Transactions on Medical Imaging.

[28]  Daniel Cremers,et al.  Tight convex relaxations for vector-valued labeling problems , 2011, 2011 International Conference on Computer Vision.

[29]  Bastian Goldlücke,et al.  Sublabel-Accurate Convex Relaxation with Total Generalized Variation Regularization , 2018, GCPR.

[30]  Hugo Lavenant Harmonic mappings valued in the Wasserstein space , 2017, Journal of Functional Analysis.

[31]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[32]  Éva Tardos,et al.  Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[33]  Christoph Schnörr,et al.  Optimality Bounds for a Variational Relaxation of the Image Partitioning Problem , 2012, Journal of Mathematical Imaging and Vision.

[34]  Michael Möller,et al.  Sublabel–Accurate Relaxation of Nonconvex Energies , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Kristian Bredies,et al.  Total Generalized Variation for Manifold-Valued Data , 2017, SIAM J. Imaging Sci..

[36]  Gabriele Steidl,et al.  Priors with Coupled First and Second Order Differences for Manifold-Valued Image Processing , 2017, Journal of Mathematical Imaging and Vision.

[37]  Charles M. Elliott,et al.  Finite element methods for surface PDEs* , 2013, Acta Numerica.

[38]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[39]  Yuval Rabani,et al.  An improved approximation algorithm for multiway cut , 1998, STOC '98.

[40]  Daniel Cremers,et al.  Total variation for cyclic structures: Convex relaxation and efficient minimization , 2011, CVPR 2011.

[41]  Daniel Cremers,et al.  Sublabel-Accurate Discretization of Nonconvex Free-Discontinuity Problems , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[42]  A. Hero,et al.  A Fast Spectral Method for Active 3D Shape Reconstruction , 2004 .

[43]  G. Bouchitté,et al.  The calibration method for the Mumford-Shah functional and free-discontinuity problems , 2001, math/0105013.

[44]  Gabriele Steidl,et al.  A Parallel Douglas-Rachford Algorithm for Minimizing ROF-like Functionals on Images with Values in Symmetric Hadamard Manifolds , 2015, SIAM J. Imaging Sci..

[45]  Jan Lellmann,et al.  Functional Lifting for Variational Problems with Higher-Order Regularization , 2016 .

[46]  Gabriele Steidl,et al.  A Second Order Nonsmooth Variational Model for Restoring Manifold-Valued Images , 2015, SIAM J. Sci. Comput..

[47]  Daniel Cremers,et al.  An Experimental Comparison of Discrete and Continuous Shape Optimization Methods , 2008, ECCV.

[48]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[49]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[50]  Mila Nikolova,et al.  A Nonlocal Denoising Algorithm for Manifold-Valued Images Using Second Order Statistics , 2016, SIAM J. Imaging Sci..

[51]  Xue-Cheng Tai,et al.  A Fast Continuous Max-Flow Approach to Non-convex Multi-labeling Problems , 2011, Efficient Algorithms for Global Optimization Methods in Computer Vision.

[52]  K. Feigl,et al.  Radar interferometry and its application to changes in the Earth's surface , 1998 .

[53]  Christoph Schnörr,et al.  Continuous Multiclass Labeling Approaches and Algorithms , 2011, SIAM J. Imaging Sci..

[54]  Daniel Cremers,et al.  An algorithm for minimizing the Mumford-Shah functional , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[55]  T. Goldstein Adaptive Primal Dual Optimization for Image Processing and Learning , 2013 .

[56]  Dean B. Gesch,et al.  The National Map - Elevation , 2009 .

[57]  Daniel Cremers,et al.  A Convex Solution to Spatially-Regularized Correspondence Problems , 2016, ECCV.

[58]  Pierre-Yves Gousenbourger,et al.  Differentiable Piecewise-Bézier Surfaces on Riemannian Manifolds , 2016, SIAM J. Imaging Sci..

[59]  M. Giaquinta Cartesian currents in the calculus of variations , 1983 .

[60]  Jan Lellmann Nonsmooth convex variational approaches to image analysis , 2011 .

[61]  Daniel Cremers,et al.  A Convex Formulation of Continuous Multi-label Problems , 2008, ECCV.

[62]  Jan Lellmann,et al.  Measure-Valued Variational Models with Applications to Diffusion-Weighted Imaging , 2017, Journal of Mathematical Imaging and Vision.

[63]  Daniel Cremers,et al.  A Combinatorial Solution to Non-Rigid 3D Shape-to-Image Matching , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Daniel Cremers,et al.  Total Variation Regularization for Functions with Values in a Manifold , 2013, 2013 IEEE International Conference on Computer Vision.

[65]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[66]  Andreas Weinmann,et al.  Mumford–Shah and Potts Regularization for Manifold-Valued Data , 2014, Journal of Mathematical Imaging and Vision.

[67]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[68]  Daniel Cremers,et al.  Nonmetric Priors for Continuous Multilabel Optimization , 2012, ECCV.

[69]  Pushmeet Kohli,et al.  A Convex Discrete-Continuous Approach for Markov Random Fields , 2012, ECCV.

[70]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[71]  Daniel Cremers,et al.  A Convex Approach to Minimal Partitions , 2012, SIAM J. Imaging Sci..