Shrinking Projection Methods for Accelerating Relaxed Inertial Tseng-Type Algorithm with Applications

Our main goal in this manuscript is to accelerate the relaxed inertial Tseng-type (RITT) algorithm by adding a shrinking projection (SP) term to the algorithm. Hence, strong convergence results were obtained in a real Hilbert space (RHS). A novel structure was used to solve an inclusion and a minimization problem under proper hypotheses. Finally, numerical experiments to elucidate the applications, performance, quickness, and effectiveness of our procedure are discussed.

[1]  Duong Viet Thong,et al.  Tseng type methods for solving inclusion problems and its applications , 2018, Calcolo.

[2]  Jonathan Eckstein,et al.  Relative-error inertial-relaxed inexact versions of Douglas-Rachford and ADMM splitting algorithms , 2020, Comput. Optim. Appl..

[3]  Poom Kumam,et al.  A new hybrid extragradient algorithm for solving the equilibrium and variational inequality problems , 2015 .

[4]  Yair Censor,et al.  A multiprojection algorithm using Bregman projections in a product space , 1994, Numerical Algorithms.

[5]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[6]  Suthep Suantai,et al.  A Fast Image Restoration Algorithm Based on a Fixed Point and Optimization Method , 2020, Mathematics.

[7]  Hedy Attouch,et al.  Convergence of a relaxed inertial proximal algorithm for maximally monotone operators , 2019, Mathematical Programming.

[8]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[9]  Heinz H. Bauschke,et al.  A Weak-to-Strong Convergence Principle for Fejé-Monotone Methods in Hilbert Spaces , 2001, Math. Oper. Res..

[10]  Wu Jigang,et al.  A Regularized Gradient Projection Method for the Minimization Problem , 2012, J. Appl. Math..

[11]  Kong,et al.  A NOTE ON THE GRADIENT PROJECTION METHOD WITH EXACT STEPSIZE RULE *1) , 2007 .

[12]  Hongwei Liu,et al.  Strong convergence result for solving monotone variational inequalities in Hilbert space , 2018, Numerical Algorithms.

[13]  I. Konnov.  Combined Relaxation Methods for Variational Inequalities , 2000 .

[14]  Dirk A. Lorenz,et al.  An Inertial Forward-Backward Algorithm for Monotone Inclusions , 2014, Journal of Mathematical Imaging and Vision.

[15]  Huanhuan Cui,et al.  On the contraction-proximal point algorithms with multi-parameters , 2012, J. Glob. Optim..

[16]  Boris Polyak.  Some methods of speeding up the convergence of iteration methods , 1964 .

[17]  H. H. Rachford,et al.  The Numerical Solution of Parabolic and Elliptic Differential Equations , 1955 .

[18]  Jie Sun,et al.  Inertial accelerated algorithms for solving a split feasibility problem , 2016 .

[19]  Poom Kumam,et al.  A new Hybrid Projection Algorithm for Solving the Split Generalized Equilibrium Problems and the System of Variational Inequality Problems , 2014, J. Math. Model. Algorithms Oper. Res..

[20]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[21]  C. Byrne,et al.  Iterative oblique projection onto convex sets and the split feasibility problem , 2002 .

[22]  Hong-Kun Xu,et al.  Forward-Backward Splitting Methods for Accretive Operators in Banach Spaces , 2012 .

[23]  R. Glowinski,et al.  Numerical Analysis of Variational Inequalities , 1981 .

[24]  Y. Censor,et al.  The multiple-sets split feasibility problem and its applications for inverse problems , 2005 .

[25]  H. Attouch,et al.  Convergence of a Relaxed Inertial Forward–Backward Algorithm for Structured Monotone Inclusions , 2019, Applied Mathematics & Optimization.

[26]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[27]  Y. J. Cho,et al.  Modified inertial Mann algorithm and inertial CQ-algorithm for nonexpansive mappings , 2018, Optim. Lett..

[28]  H. Attouch,et al.  An Inertial Proximal Method for Maximal Monotone Operators via Discretization of a Nonlinear Oscillator with Damping , 2001 .

[29]  Y. Shehu.  Iterative Approximations for Zeros of Sum of Accretive Operators in Banach Spaces , 2016 .

[30]  Gregory B. Passty.  Ergodic convergence to a zero of the sum of monotone operators in Hilbert space , 1979 .

[31]  W. R. Mann,et al.  Mean value methods in iteration , 1953 .

[32]  E. Khobotov.  Modification of the extra-gradient method for solving variational inequalities and certain optimization problems , 1989 .

[33]  Hong-Kun Xu,et al.  Strong convergence of the CQ method for fixed point iteration processes , 2006 .

[34]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[35]  Xiaolong Qin,et al.  Convergence of splitting algorithms for the sum of two accretive operators with applications , 2014 .

[36]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[37]  M. Alves,et al.  On Inexact Relative-Error Hybrid Proximal Extragradient, Forward-Backward and Tseng’s Modified Forward-Backward Methods with Inertial Effects , 2018, Set-Valued and Variational Analysis.

[38]  Hedy Attouch,et al.  Convergence rate of a relaxed inertial proximal algorithm for convex minimization , 2019, Optimization.

[39]  Poom Kumam,et al.  Solutions of system of equilibrium and variational inequality problems on fixed points of infinite family of nonexpansive mappings , 2014, Appl. Math. Comput..

[40]  Y. Shehu,et al.  A strong convergence result involving an inertial forward–backward algorithm for monotone inclusions , 2017 .

[41]  P. Marcotte.  APPLICATION OF KHOBOTOVS ALGORITHM TO VARIATIONAL INEQUALITIES ANT) NETWORK EQUILIBRIUM PROBLEMS , 1991 .

[42]  C. Byrne,et al.  A unified treatment of some iterative algorithms in signal processing and image reconstruction , 2003 .

[43]  Wataru Takahashi,et al.  Strong convergence theorems by hybrid methods for families of nonexpansive mappings in Hilbert spaces , 2008 .

[44]  Y. Nesterov.  A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[45]  Y. Censor,et al.  A unified approach for inversion problems in intensity-modulated radiation therapy , 2006, Physics in medicine and biology.

[46]  H. H. Rachford,et al.  On the numerical solution of heat conduction problems in two and three space variables , 1956 .

[47]  A. Moudafi,et al.  Convergence of a splitting inertial proximal method for monotone operators , 2003 .

[48]  Hong-Kun Xu,et al.  Averaged Mappings and the Gradient-Projection Algorithm , 2011, J. Optim. Theory Appl..

[49]  Julien M. Hendrickx,et al.  A generic online acceleration scheme for optimization algorithms via relaxation and inertia , 2016, Optim. Methods Softw..

[50]  Duong Viet Thong,et al.  Strong convergence of a forward–backward splitting method with a new step size for solving monotone inclusions , 2019, Comput. Appl. Math..

[51]  Manuel de la Sen,et al.  Advanced Algorithms and Common Solutions to Variational Inequalities , 2020, Symmetry.

[52]  P. Kumam,et al.  Relaxed Inertial Tseng’s Type Method for Solving the Inclusion Problem with Application to Image Restoration , 2020, Mathematics.