Solution uniqueness of convex piecewise affine functions based optimization with applications to constrained ℓ1 minimization

In this paper, we study the solution uniqueness of an individual feasible vector of a class of convex optimization problems involving convex piecewise affine functions and subject to general polyhedral constraints. This class of problems incorporates many important polyhedral constrained ℓ1 recovery problems arising from sparse optimization, such as basis pursuit, LASSO, and basis pursuit denoising, as well as polyhedral gauge recovery. By leveraging the max-formulation of convex piecewise affine functions and convex analysis tools, we develop dual variables based necessary and sufficient uniqueness conditions via simple and yet unifying approaches; these conditions are applied to a wide range of ℓ1 minimization problems under possible polyhedral constraints. An effective linear program based scheme is proposed to verify solution uniqueness conditions. The results obtained in this paper not only recover the known solution uniqueness conditions in the literature by removing restrictive assumptions but also yield new uniqueness conditions for much broader constrained ℓ1-minimization problems.

[1]  A. Rinaldo Properties and refinements of the fused lasso , 2008, 0805.0234.

[2]  Yun-Bin Zhao,et al.  Sparse Optimization Theory and Methods , 2018 .

[3]  R. Tibshirani,et al.  Degrees of freedom in lasso problems , 2011, 1111.0653.

[4]  Jean Charles Gilbert On the Solution Uniqueness Characterization in the L1 Norm and Polyhedral Gauge Recovery , 2017, J. Optim. Theory Appl..

[5]  Jean-Jacques Fuchs,et al.  On sparse representations in arbitrary redundant bases , 2004, IEEE Transactions on Information Theory.

[6]  Yun-Bin Zhao,et al.  Equivalence and Strong Equivalence Between the Sparsest and Least $$\ell _1$$ℓ1-Norm Nonnegative Solutions of Linear Systems and Their Applications , 2013, 1312.4163.

[7]  Jinglai Shen,et al.  Robust Non-Zenoness of Piecewise Affine Systems with Applications to Linear Complementarity Systems , 2014, SIAM J. Optim..

[8]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[9]  Ying Xiong Nonlinear Optimization , 2014 .

[10]  O. Mangasarian Uniqueness of solution in linear programming , 1979 .

[11]  R. Rockafellar Convex Analysis: (pms-28) , 1970 .

[12]  R. Tibshirani The Lasso Problem and Uniqueness , 2012, 1206.0313.

[13]  Ming Yan,et al.  One condition for solution uniqueness and robustness of both l1-synthesis and l1-analysis minimizations , 2013, Adv. Comput. Math..

[14]  Ao Tang,et al.  A Unique “Nonnegative” Solution to an Underdetermined System: From Vectors to Matrices , 2010, IEEE Transactions on Signal Processing.

[15]  Hui Zhang,et al.  Necessary and Sufficient Conditions of Solution Uniqueness in 1-Norm Minimization , 2012, Journal of Optimization Theory and Applications.

[16]  Jong-Shi Pang,et al.  Switching and stability properties of conewise linear systems , 2010 .

[17]  Jinglai Shen,et al.  Shape restricted smoothing splines via constrained optimal control and nonsmooth Newton's methods , 2015, Autom..

[18]  R. Tibshirani,et al.  The solution path of the generalized lasso , 2010, 1005.1971.

[19]  Emmanuel J. Candès,et al.  A Probabilistic and RIPless Theory of Compressed Sensing , 2010, IEEE Transactions on Information Theory.

[20]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[21]  S. Scholtes Introduction to Piecewise Differentiable Equations , 2012 .

[22]  Kurt M. Anstreicher,et al.  Linear Programming in O([n3/ln n]L) Operations , 1999, SIAM J. Optim..

[23]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[24]  Simon Foucart,et al.  Sparse Recovery by Means of Nonnegative Least Squares , 2014, IEEE Signal Processing Letters.

[25]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[26]  Marco F. Duarte,et al.  Perfect Recovery Conditions for Non-negative Sparse Modeling , 2015, IEEE Transactions on Signal Processing.

[27]  Stephen P. Boyd,et al.  1 Trend Filtering , 2009, SIAM Rev..

[28]  Panos M. Pardalos,et al.  Convex optimization theory , 2010, Optim. Methods Softw..

[29]  Jinglai Shen,et al.  Least Sparsity of p-Norm Based Optimization Problems with p>1 , 2017, SIAM J. Optim..

[30]  Yun-Bin Zhao,et al.  RSP-Based Analysis for Sparsest and Least $\ell_1$-Norm Solutions to Underdetermined Linear Systems , 2013, IEEE Transactions on Signal Processing.

[31]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[32]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[33]  Chunlei Xu,et al.  1-Bit compressive sensing: Reformulation and RRSP-based sign recovery theory , 2014, Science China Mathematics.

[34]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[35]  Xiao Wang,et al.  Estimation of Monotone Functions via P-Splines: A Constrained Dynamical Optimization Approach , 2011, SIAM J. Control. Optim..