Inverse problems for regularization matrices