On the convergence of asynchronous parallel algorithm for large-scale linearly constrained minimization problem

As a synchronization parallel framework, the parallel variable transformation (PVT) algorithm is effective to solve unconstrained optimization problems. In this paper, based on the idea that a constrained optimization problem is equivalent to a differentiable unconstrained optimization problem by introducing the Fischer Function, we propose an asynchronous PVT algorithm for solving large-scale linearly constrained convex minimization problems. This new algorithm can terminate when some processor satisfies terminal condition without waiting for other processors. Meanwhile, it can enhances practical efficiency for large-scale optimization problem. Global convergence of the new algorithm is established under suitable assumptions. And in particular, the linear rate of convergence does not depend on the number of processors.

[1]  Masao Fukushima,et al.  Testing Parallel Variable Transformation , 1999, Comput. Optim. Appl..

[2]  J. Miller.  Numerical Analysis , 1966, Nature.

[3]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[5]  Chin-Sung Liu,et al.  Parallel Synchronous and Asynchronous Space-Decomposition Algorithms for Large-Scale Minimization Problems , 2000, Comput. Optim. Appl..

[6]  Claudia A. Sagastizábal,et al.  Parallel Variable Distribution for Constrained Optimization , 2002, Comput. Optim. Appl..

[7]  Mikhail V. Solodov,et al.  On the Convergence of Constrained Parallel Variable Distribution Algorithms , 1998, SIAM J. Optim..

[8]  Masao Fukushima,et al.  Parallel Variable Transformation in Unconstrained Optimization , 1998, SIAM J. Optim..

[9]  M. Solodov.  New Inexact Parallel Variable Distribution Algorithms , 1997, Comput. Optim. Appl..

[10]  A. Fischer.  A special newton-type optimization method , 1992 .

[11]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[12]  Shih-Ping Han.  A parallel algorithm for a class of convex programs , 1988 .

[13]  Christian Kanzow,et al.  An unconstrained optimization technique for large-scale linearly constrained convex minimization problems , 1994, Computing.

[14]  Philip E. Gill,et al.  Practical optimization , 1981 .

[15]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[16]  Michael C. Ferris,et al.  Parallel Variable Distribution , 1994, SIAM J. Optim..

[17]  José Mario Martínez,et al.  On the Resolution of Linearly Constrained Convex Minimization Problems , 1994, SIAM J. Optim..