Linear programming and l 1 regression: A geometric interpretation

Approaches to the solution of the l1 estimation problem have a long history, going back to at least Edgeworth in the nineteenth century. Modern solution approaches have been of two types: (i) descent methods and (ii) primal or dual LP methods. Simplex based algorithms have a standard geometric interpretation, but occasionally much more tangible geometric insights are available. For example, in the capacitated transhipment problem the workings of the LP solution algorithms can be interpreted on the underlying network. In this paper we develop geometric insight into the solution process directly in the space where the problem originates - the space of observations.

[1]  John S. Chipman,et al.  On Least Squares with Insufficient Observations , 1964 .

[2]  S. R. Searle Linear Models , 1971 .

[3]  Abraham Charnes,et al.  Optimal Estimation of Executive Compensation by Linear Programming , 1955 .

[4]  Edward L. Frome,et al.  A revised simplex algorithm for the absolute deviation curve fitting problem , 1979 .

[5]  R. Koenker,et al.  Asymptotic Theory of Least Absolute Error Regression , 1978 .

[6]  I. Barrodale,et al.  An Improved Algorithm for Discrete $l_1 $ Linear Approximation , 1973 .

[7]  A. Conn,et al.  Minimization Techniques for Piecewise Differentiable Functions: The l_1 Solution to an Overdetermined Linear System , 1978 .

[8]  W. Steiger,et al.  Least Absolute Deviations Curve-Fitting , 1980 .

[9]  Generalized Network Approaches for Solving Least Absolute Value and Tchebycheff Regression Problems , 1979 .

[10]  Pseudo-Inverses in the Analysis of Variance , 1964 .

[11]  R. Plackett Some theorems in least squares. , 1950, Biometrika.

[12]  G. O. Wesolowsky A new descent algorithm for the least absolute value regression problem , 1981 .

[13]  Ronald D. Armstrong,et al.  An Algorithm for a Restricted Discrete Approximation Problem in the $L_1 $ Norm , 1977 .

[14]  H. H. Turner M.A. B.Sc. LX. On Mr. Edgeworth's method of reducing observations relating to several quantities , 1887 .

[15]  R. Armstrong,et al.  Two linear programming algorithms for the linear discrete ₁ norm problem , 1979 .

[16]  Nabih N. Abdelmalek An efficient method for the discrete linear ₁ approximation problem , 1975 .