Multicategory discrimination via linear programming

A single linear program is proposed for discriminating between the elements of κ disjoint point sets in the n-dimensional real space Rn . When the conical hulls of the κ sets are (κ−1)-point disjoint in Rn +1, a κ-piece piecewise-linear surface generated by the linear program completely separates the κ sets. This improves on a previous linear programming approach which required that each set be linearly separable from the remaining κ−1 sets. When the conical hulls of the κ sets are not (κ;−1)-point disjoint, the proposed linear program generates an error-minimizing piecewise-linear separator for the κ Sets. For this case it is shown that the null solution is never a unique solver of the linear program and occurs only under the rather rare condition when the mean of each point set equals the mean of the means of the other κ−l sets. This makes the proposed linear computational programming formulation useful for approximately discriminating between κ sets that are not piecewise-linear separable. Computationa...

[1]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[2]  I. J. Schoenberg,et al.  The Relaxation Method for Linear Inequalities , 1954, Canadian Journal of Mathematics.

[3]  Wilbur H. Highleyman,et al.  A Note on Linear Separation , 1961, IRE Trans. Electron. Comput..

[4]  O. Mangasarian Linear and Nonlinear Separation of Patterns by Linear Programming , 1965 .

[5]  Richard O. Duda,et al.  Pattern Classification by Iteratively Determined Linear and Piecewise Linear Discriminant Functions , 1966, IEEE Trans. Electron. Comput..

[6]  M. R. Mickey,et al.  Estimation of Error Rates in Discriminant Analysis , 1968 .

[7]  Olvi L. Mangasarian,et al.  Multisurface method of pattern separation , 1968, IEEE Trans. Inf. Theory.

[8]  Fred W. Smith Design of Multicategory Pattern Classifiers with Two-Category Classifier Design Procedures , 1969, IEEE Transactions on Computers.

[9]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[12]  Michael A. Saunders,et al.  MINOS 5. 0 user's guide , 1983 .

[13]  O. Mangasarian,et al.  Robust linear programming discrimination of two linearly inseparable sets , 1992 .

[14]  Kristin P. Bennett,et al.  Decision Tree Construction Via Linear Programming , 1992 .

[15]  Jancik,et al.  Multisurface Method of Pattern Separation , 1993 .