A conjugate gradient like method for p-norm minimization in functional spaces

We develop an iterative algorithm to recover the minimum p-norm solution of the functional linear equation $$Ax = b,$$Ax=b, where $$A: \mathcal {X}\longrightarrow \mathcal {Y}\,$$A:X⟶Y is a continuous linear operator between the two Banach spaces $$\mathcal {X}= L^p$$X=Lp, $$1< p < 2$$1 1$$r>1, with $$x \in \mathcal {X}$$x∈X and $$b \in \mathcal {Y}$$b∈Y. The algorithm is conceived within the same framework of the Landweber method for functional linear equations in Banach spaces proposed by Schöpfer et al. (Inverse Probl 22:311–329, 2006). Indeed, the algorithm is based on using, at the n-th iteration, a linear combination of the steepest current “descent functional” $$A^* J \left( b - A x_n \right) $$A∗Jb-Axn and the previous descent functional, where J denotes a duality map of the Banach space $$\mathcal {Y}$$Y. In this regard, the algorithm can be viewed as a generalization of the classical conjugate gradient method on the normal equations in Hilbert spaces. We demonstrate that the proposed iterative algorithm converges strongly to the minimum p-norm solution of the functional linear equation $$Ax = b$$Ax=b and that it is also a regularization method, by applying the discrepancy principle as stopping rule. According to the geometrical properties of $$L^p$$Lp spaces, numerical experiments show that the method is fast, robust in terms of both restoration accuracy and stability, promotes sparsity and reduces the over-smoothness in reconstructing edges and abrupt intensity changes.

[1]  BUI TRONG,et al.  THE NORMALIZED DUALITY MAPPING AND TWO RELATED CHARACTERISTIC PROPERTIES OF A UNIFORMLY CONVEX BANACH SPACE , 2008 .

[2]  Katya Scheinberg,et al.  Self-Correcting Geometry in Model-Based Algorithms for Derivative-Free Unconstrained Optimization , 2010, SIAM J. Optim..

[3]  E. Resmerita Regularization of ill-posed problems in Banach spaces: convergence rates , 2005 .

[4]  F. Schöpfer,et al.  Fast regularizing sequential subspace optimization in Banach spaces , 2008 .

[5]  Claudio Estatico,et al.  Analysis of Reconstructions Obtained Solving $l^p$-Penalized Minimization Problems , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Dan Butnariu,et al.  Bregman distances, totally convex functions, and a method for solving operator equations in Banach spaces , 2006 .

[7]  Pavle M. Mili ON MODULI OF EXPANSION OF THE DUALITY MAPPING OF SMOOTH BANACH SPACES , 2002 .

[8]  Serge Gratton,et al.  An active-set trust-region method for derivative-free nonlinear bound-constrained optimization , 2011, Optim. Methods Softw..

[9]  Claudio Estatico,et al.  Conjugate Gradient Method in Hilbert and Banach Spaces to Enhance the Spatial Resolution of Radiometer Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Claudio Estatico,et al.  Preconditioned iterative regularization in Banach spaces , 2013, Comput. Optim. Appl..

[11]  I. Ciorǎnescu Geometry of banach spaces, duality mappings, and nonlinear problems , 1990 .

[12]  Per Christian Hansen,et al.  Rank-Deficient and Discrete Ill-Posed Problems , 1996 .

[13]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[14]  M. Grasmair Generalized Bregman distances and convergence rates for non-convex regularization methods , 2010 .

[15]  Roland Herzog,et al.  A conjugate direction method for linear systems in Banach spaces , 2016 .

[16]  P. Maass,et al.  Minimization of Tikhonov Functionals in Banach Spaces , 2008 .

[17]  Barbara Kaltenbacher,et al.  Regularization Methods in Banach Spaces , 2012, Radon Series on Computational and Applied Mathematics.

[18]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[19]  F. Schöpfer,et al.  An iterative regularization method for the solution of the split feasibility problem in Banach spaces , 2008 .

[20]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[21]  E. Asplund,et al.  Positivity of duality mappings , 1967 .

[22]  Alfred K. Louis,et al.  Metric and Bregman projections onto affine subspaces and their computation via sequential subspace optimization methods , 2008 .

[23]  Joram Lindenstrauss,et al.  Classical Banach spaces , 1973 .

[24]  Tal Schuster,et al.  Nonlinear iterative methods for linear ill-posed problems in Banach spaces , 2006 .

[25]  Zongben Xu,et al.  Characteristic inequalities of uniformly convex and uniformly smooth Banach spaces , 1991 .

[26]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .