An efficient method for solving a matrix least squares problem over a matrix inequality constraint

In this paper, we consider solving a class of matrix inequality constrained matrix least squares problems of the form $$\begin{aligned} \begin{array}{rl} \text {min}&{}\dfrac{1}{2}\Vert \sum \limits _{i=1}^{t}A_iXB_i-C\Vert^2\\ \text {subject}\ \text {to}&{} L \le EXF\le U, \ \ X\in \mathcal {S}, \end{array} \end{aligned}$$min12‖∑i=1tAiXBi-C‖2subjecttoL≤EXF≤U,X∈S,where $$\Vert {\cdot } \Vert $$‖·‖ is the Frobenius norm, matrices $$A_i\in \mathbb {R}^{l\times m}, B_i\in \mathbb {R}^{n\times s}$$Ai∈Rl×m,Bi∈Rn×s$$(i=1,\ldots , t), C\in \mathbb {R}^{l\times s}, E\in \mathbb {R}^{p\times m}, F\in \mathbb {R}^{n\times q}$$(i=1,…,t),C∈Rl×s,E∈Rp×m,F∈Rn×q and $$L, U\in \mathbb {R}^{p\times q}$$L,U∈Rp×q are given. An inexact version of alternating direction method (ADM) with truly implementable inexactness criteria is proposed for solving this problem and its several reduced versions which are applicable in image restoration. Numerical experiments are performed to illustrate the feasibility and efficiency of the proposed algorithm, including when the algorithm is tested with randomly generated data and on some image restoration problems. Comparisons with some existing methods (with necessary modifications) are also given.

[1]  Michael K. Ng,et al.  Inexact Alternating Direction Methods for Image Recovery , 2011, SIAM J. Sci. Comput..

[2]  Yun-Hai Xiao,et al.  An Inexact Alternating Directions Algorithm for Constrained Total Variation Regularized Compressive Sensing Problems , 2011, Journal of Mathematical Imaging and Vision.

[3]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[4]  Abderrahman Bouhamidi,et al.  Conditional gradient Tikhonov method for a convex optimization problem in image restoration , 2014, J. Comput. Appl. Math..

[5]  Bingsheng He,et al.  A new inexact alternating directions method for monotone variational inequalities , 2002, Math. Program..

[6]  Zhi Zhao,et al.  On the alternating direction method of multipliers for nonnegative inverse eigenvalue problems with partial eigendata , 2013, J. Comput. Appl. Math..

[7]  Abderrahman Bouhamidi,et al.  A Kronecker approximation with a convex constrained optimization method for blind image restoration , 2012, Optim. Lett..

[8]  Zhen-yun Peng,et al.  The Solutions of Matrix Equation AX=B Over a Matrix Inequality Constraint , 2012, SIAM J. Matrix Anal. Appl..

[9]  José Mario Martínez,et al.  The boundedness of penalty parameters in an augmented Lagrangian method with constrained subproblems , 2012, Optim. Methods Softw..

[10]  José Mario Martínez,et al.  Augmented Lagrangian method with nonmonotone penalty parameters for constrained optimization , 2011, Computational Optimization and Applications.

[11]  Lei Wu,et al.  The Re-positive definite solutions to the matrix inverse problem AX=B , 1992 .

[12]  William F. Trench,et al.  Minimization problems for (R,S)-symmetric and (R,S)-skew symmetric matrices , 2004 .

[13]  F. Don On the symmetric solutions of a linear matrix equation , 1987 .

[14]  Yuan Lei,et al.  Least‐squares solutions of matrix inverse problem for bi‐symmetric matrices with a submatrix constraint , 2007, Numer. Linear Algebra Appl..

[15]  Dai Hua On the symmetric solutions of linear matrix equations , 1990 .

[16]  Xiaoming Yuan,et al.  Alternating Direction Method for Covariance Selection Models , 2011, Journal of Scientific Computing.

[17]  Zhen-Yun Peng Solutions of symmetry-constrained least-squares problems , 2008, Numer. Linear Algebra Appl..

[18]  Bingsheng He,et al.  Inexact Alternating-Direction-Based Contraction Methods for Separable Linearly Constrained Convex Optimization , 2014, J. Optim. Theory Appl..

[19]  W. F. Trench,et al.  Inverse Eigenproblems and Associated Approximation Problems for Matrices with Generalized Symmetry or Skew Symmetry , 2003 .

[20]  Bingsheng He,et al.  Inexact implicit methods for monotone general variational inequalities , 1999, Math. Program..

[21]  Tommy Elfving,et al.  A Constrained Procrustes Problem , 1997, SIAM J. Matrix Anal. Appl..

[22]  Ting-Zhu Huang,et al.  LSQR iterative method for generalized coupled Sylvester matrix equations , 2012 .

[23]  Nicholas J. Higham,et al.  The symmetric procrustes problem , 1988 .

[24]  Xi-Yan Hu,et al.  The reflexive and anti-reflexive solutions of the matrix equation AX = B , 2003 .

[25]  Zhen-yun Peng,et al.  A hybrid algorithm for solving minimization problem over (R,S)-symmetric matrices with the matrix inequality constraint , 2015 .

[26]  Raymond H. Chan,et al.  Alternating Direction Method for Image Inpainting in Wavelet Domains , 2011, SIAM J. Imaging Sci..

[27]  Xiaoming Yuan,et al.  Applications of the alternating direction method of multipliers to the semidefinite inverse quadratic eigenvalue problem with a partial eigenstructure , 2013 .

[28]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[29]  Abderrahman Bouhamidi,et al.  Convex constrained optimization for large-scale generalized Sylvester equations , 2011, Comput. Optim. Appl..

[30]  Xi-Yan Hu,et al.  The skew-symmetric orthogonal solutions of the matrix equation AX=B☆ , 2005 .

[31]  Zheng-Jian Bai,et al.  The Inverse Eigenproblem of Centrosymmetric Matrices with a Submatrix Constraint and Its Approximation , 2005, SIAM J. Matrix Anal. Appl..

[32]  M. Raydan,et al.  Dykstra's algorithm for constrained least-squares rectangular matrix problems , 1998 .

[33]  Abdellah Bnouhachem,et al.  An inexact alternating direction method for solving a class of structured variational inequalities , 2013, Appl. Math. Comput..