Learning parametrised regularisation functions via quotient minimisation

We propose a novel strategy for the computation of adaptive regularisation functions. The general strategy consists of minimising the ratio of a parametrised regularisation function; the numerator contains the regulariser with a desirable training signal as its argument, whereas the denominator contains the same regulariser but with its argument being a training signal one wants to avoid. The rationale behind this is to adapt parametric regularisations to given training data that contain both wanted and unwanted outcomes. We discuss the numerical implementation of this minimisation problem for a specific parametrisation, and present preliminary numerical results which demonstrate that this approach is able to recover total variation as well as second‐order total variation regularisation from suitable training data. (© 2016 Wiley‐VCH Verlag GmbH & Co. KGaA, Weinheim)

[1]  Michael Möller,et al.  Learning Nonlinear Spectral Filters for Color Image Reconstruction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Michael Möller,et al.  Spectral Representations of One-Homogeneous Functionals , 2015, SSVM.

[3]  Guy Gilboa,et al.  A Total Variation Spectral Framework for Scale and Texture Analysis , 2014, SIAM J. Imaging Sci..

[4]  Horst Bischof,et al.  Learning ℓ1-based analysis and synthesis sparsity priors using bi-level optimization , 2014, NIPS 2014.

[5]  C. Schönlieb,et al.  Image denoising: Learning the noise model via nonsmooth PDE-constrained optimization , 2013 .

[6]  Karl Kunisch,et al.  A Bilevel Optimization Approach for Parameter Learning in Variational Models , 2013, SIAM J. Imaging Sci..

[7]  M. Burger,et al.  Higher-Order TV Methods—Enhancement via Bregman Iteration , 2013, J. Sci. Comput..

[8]  Xavier Bresson,et al.  Convergence and Energy Landscape for Cheeger Cut Clustering , 2012, NIPS.

[9]  Martin Burger,et al.  Ground States and Singular Vectors of Convex Variational Regularization Methods , 2012, 1211.2057.

[10]  Dianne P. O'Leary,et al.  Designing Optimal Spectral Filters for Inverse Problems , 2011, SIAM J. Sci. Comput..

[11]  Matthias Hein,et al.  An Inverse Power Method for Nonlinear Eigenproblems with Applications in 1-Spectral Clustering and Sparse PCA , 2010, NIPS.

[12]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  E. Haber,et al.  Learning regularization functionals—a supervised training approach , 2003 .

[14]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[15]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[16]  V. Morozov.  On the solution of functional equations by the method of regularization , 1966 .