Approximate 1-Norm Minimization and Minimum-Rank Structured Sparsity for Various Generalized Inverses via Local Search

Fundamental in matrix algebra and its applications, a generalized inverse of a real matrix $A$ is a matrix $H$ that satisfies the Moore-Penrose (M-P) property $AHA=A$. If $H$ also satisfies the additional M-P property, $HAH=H$, it is called reflexive. Reflexivity is equivalent to minimum rank, so we are particularly interested in reflexive generalized inverses. We consider aspects of symmetry related to the calculation of a sparse reflexive generalized inverse of $A$. As is common, we use (vector) 1-norm minimization for inducing sparsity and for keeping the magnitude of entries under control. When $A$ is symmetric, we may seek a symmetric $H$; while generally such a restriction on $H$ may not lead to a 1-norm minimizing reflexive generalized inverse. We investigate a block construction method to produce a symmetric reflexive generalized inverse that is structured and has guaranteed sparsity, and we provided an approximation algorithm based on it. Another aspect of symmetry that we consider relates to another M-P property: $H$ is ah-symmetric if $AH$ is symmetric. The ah-symmetry property is the key one for solving least-squares problems using $H$. We investigate a column block construction method to produce an ah-symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. Importantly, we provide a theoretically-efficient and practical local-search algorithm to column block construct an approximate 1-norm minimizing ah-symmetric reflexive generalized inverse.