Block-Iterative Algorithms with Diagonally Scaled Oblique Projections for the Linear Feasibility Problem

We formulate a block-iterative algorithmic scheme for the solution of systems of linear inequalities and/or equations and analyze its convergence. This study provides as special cases proofs of convergence of (i) the recently proposed component averaging (CAV) method of Censor, Gordon, and Gordon [Parallel Comput., 27 (2001), pp. 777--808], (ii) the recently proposed block-iterative CAV (BICAV) method of the same authors [IEEE Trans. Medical Imaging, 20 (2001), pp. 1050--1060], and (iii) the simultaneous algebraic reconstruction technique (SART) of Andersen and Kak [ Ultrasonic Imaging, 6 (1984), pp. 81--94] and generalizes them to linear inequalities. The first two algorithms are projection algorithms which use certain generalized oblique projections and diagonal weighting matrices which reflect the sparsity of the underlying matrix of the linear system. The previously reported experimental acceleration of the initial behavior of CAV and BICAV is thus complemented here by a mathematical study of the convergence of the algorithms.

[1]  A. Lent,et al.  Iterative algorithms for large partitioned linear systems, with applications to image reconstruction , 1981 .

[2]  Yair Censor,et al.  Component averaging: An efficient iterative parallel algorithm for large and sparse unstructured problems , 2001, Parallel Comput..

[3]  James Demmel,et al.  Applied Numerical Linear Algebra , 1997 .

[4]  Alfredo N. Iusem,et al.  Convergence results for an accelerated nonlinear cimmino algorithm , 1986 .

[5]  Patrick L. Combettes,et al.  Inconsistent signal feasibility problems: least-squares solutions in a product space , 1994, IEEE Trans. Signal Process..

[6]  Y. Censor,et al.  New methods for linear inequalities , 1982 .

[7]  Y. Censor,et al.  Parallel Optimization: Theory, Algorithms, and Applications , 1997 .

[8]  G. Golub,et al.  Iterative solution of linear systems , 1991, Acta Numerica.

[9]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[10]  Yair Censor,et al.  BICAV: An Inherently Parallel Algorithm for Sparse Systems with Pixel-Dependent Weighting , 2001, IEEE Trans. Medical Imaging.

[11]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[12]  T. Elfving.  Block-iterative methods for consistent and inconsistent linear equations , 1980 .

[13]  Boris Polyak,et al.  The method of projections for finding the common point of convex sets , 1967 .

[14]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[15]  Ming Jiang,et al.  Convergence of the simultaneous algebraic reconstruction technique (SART) (invited talk , 2001 .

[16]  Y. Censor,et al.  Parallel Optimization:theory , 1997 .

[17]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[18]  Gabor T. Herman,et al.  Image reconstruction from projections : the fundamentals of computerized tomography , 1980 .

[19]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[20]  Klaus Mueller,et al.  Anti-Aliased 3D Cone-Beam Reconstruction of Low-Contrast Objects with Algebraic Methods , 1999, IEEE Trans. Medical Imaging.