Block-iterative interior point optimization methods for image reconstruction from limited data

Iterative algorithms for image reconstruction often involve minimizing some cost function h(x) that measures the degree of agreement between the measured data and a theoretical parametrized model. In addition, one may wish to have x satisfy certain constraints. It is usually the case that the cost function is the sum of simpler functions: h(x) = ∑i = 1Ihi(x). Partitioning the set {i = 1,...,I} as the union of the disjoint sets Bn,n = 1,...,N, we let hn(x) = ∑iBnhi(x). The method presented here is block iterative, in the sense that at each step only the gradient of a single hn(x) is employed. Convergence can be significantly accelerated, compared to that of the single-block (N = 1) method, through the use of appropriately chosen scaling factors. The algorithm is an interior point method, in the sense that the images xk + 1 obtained at each step of the iteration satisfy the desired constraints. Here the constraints are imposed by having the next iterate xk + 1 satisfy the gradient equation ∇F(xk + 1) = ∇F(xk)-tn∇hn(xk), for appropriate scalars tn, where the convex function F is defined and differentiable only on vectors satisfying the constraints. Special cases of the algorithm that apply to tomographic image reconstruction, and permit inclusion of upper and lower bounds on individual pixels, are presented. The focus here is on the development of the underlying convergence theory of the algorithm. Behaviour of special cases has been considered elsewhere.

[1]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[2]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[3]  Y. Censor,et al.  Strong underrelaxation in Kaczmarz's method for inconsistent systems , 1983 .

[4]  K. Lange,et al.  A Theoretical Study of Some Maximum Likelihood Algorithms for Emission and Transmission Tomography , 1987, IEEE Transactions on Medical Imaging.

[5]  Eric C. Frey,et al.  Comparison between ML-EM and WLS-CG algorithms for SPECT image reconstruction , 1991 .

[6]  Charles L. Byrne,et al.  Iterative image reconstruction algorithms based on cross-entropy minimization , 1992, Optics & Photonics.

[7]  Gabor T. Herman,et al.  Algebraic reconstruction techniques can be made computationally efficient [positron emission tomography application] , 1993, IEEE Trans. Medical Imaging.

[8]  Charles L. Byrne,et al.  Block-iterative methods for image reconstruction from projections , 1996, IEEE Trans. Image Process..

[9]  Heinz H. Bauschke,et al.  Legendre functions and the method of random Bregman projections , 1997 .

[10]  Dimitri P. Bertsekas,et al.  A New Class of Incremental Gradient Methods for Least Squares Problems , 1997, SIAM J. Optim..

[11]  Alfredo N. Iusem,et al.  An interior point method with Bregman functions for the variational inequality problem with paramonotone operators , 1998, Math. Program..

[12]  C. Byrne Iterative algorithms for deblurring and deconvolution with constraints , 1998 .

[13]  C. Byrne Iterative projection onto convex sets using multiple Bregman distances , 1999 .

[14]  C. Byrne Bregman-Legendre Multidistance Projection Algorithms for Convex Feasibility and Optimization , 2001 .