A Joint Least Squares and Least Absolute Deviation Model

We propose a joint least squares and least absolute deviations (JOLESALAD) model, show that the proposed model can cover least absolute shrinkage and selection operator (LASSO) and two of its variants, namely the generalized LASSO (gLASSO) and the constrained LASSO (cLASSO), and prove that under a full rank condition, the JOLESALAD can be transformed into cLASSO. Based on this equivalency, rich tools currently available for LASSO models can be applied to solve gLASSO and cLASSO. As an example of illustration, we demonstrate an application of the proposed model to the restoration of a noisy ramp signal that needs proper use of penalty term.

[1]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[2]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[3]  Dmitry M. Malioutov,et al.  Homotopy continuation for sparse signal representation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[4]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[5]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[6]  Concha Bielza,et al.  A survey on multi‐output regression , 2015, WIREs Data Mining Knowl. Discov..

[7]  Steven Kay,et al.  On Bayesian Exponentially Embedded Family for Model Order Selection , 2017, IEEE Transactions on Signal Processing.

[8]  Howard D. Bondell,et al.  Solution paths for the generalized lasso with applications to spatially varying coefficients regression , 2020, Comput. Stat. Data Anal..

[9]  Stephen P. Boyd,et al.  1 Trend Filtering , 2009, SIAM Rev..

[10]  S. Bickel,et al.  Deconvolution of band-limited signals , 1983, ICASSP.

[11]  R. Tibshirani,et al.  The solution path of the generalized lasso , 2010, 1005.1971.

[12]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[13]  Y. Selen,et al.  Model-order selection: a review of information criterion rules , 2004, IEEE Signal Processing Magazine.

[14]  J. Idier.  Bayesian Approach to Inverse Problems: Idier/Bayesian , 2010 .

[15]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[16]  Gareth M. James,et al.  The Constrained Lasso , 2012 .

[17]  T. Matsuoka,et al.  Band limited ridge regression deconvolution of vibroseis data , 1990 .

[18]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[19]  M. R. Osborne,et al.  A new approach to variable selection in least squares problems , 2000 .

[20]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[21]  Zhengchun Zhou,et al.  Sharp Sufficient Conditions for Stable Recovery of Block Sparse Signals by Block Orthogonal Matching Pursuit , 2016, Applied and Computational Harmonic Analysis.

[22]  Charles Soussen,et al.  Generalized LASSO with under-determined regularization matrices , 2016, Signal Process..

[23]  D. Brie,et al.  Generalized LASSO with underdetermined regularization matrices , 2016 .