A Linear Programming Approach to Discriminant Analysis with a Reserved-Judgment Region

A linear-programming model is proposed for deriving discriminant rules that allow allocation of entities to a reserved-judgment region. The size of the reserved-judgment region, which can be controlled by varying parameters within the model, dictates the level of aggressiveness (cautiousness) of allocating (misallocating) entities to groups. Results of simulation experiments for various configurations of normal and contaminated normal three-group populations are reported for a variety of parameter selections. Results of cross-validation experiments using real data sets are also reported. Both the simulation and cross-validation experiments include comparison with other discriminant analysis techniques. The results demonstrate that the proposed model is useful for deriving discriminant rules that reduce the chances of misclassification, while maintaining a reasonable level of correct classification.

[1]  David A. Patterson,et al.  Constrained discriminant analysis via 0/1 mixed integer programming , 1997, Ann. Oper. Res..

[2]  Fred Glover,et al.  A NEW CLASS OF MODELS FOR THE DISCRIMINANT PROBLEM , 1988 .

[3]  Ned Freed,et al.  EVALUATING ALTERNATIVE LINEAR PROGRAMMING MODELS TO SOLVE THE TWO-GROUP DISCRIMINANT PROBLEM , 1986 .

[4]  J. Anderson,et al.  Constrained Discrimination between K Populations , 1969 .

[5]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[6]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[7]  Olvi L. Mangasarian,et al.  Mathematical Programming in Neural Networks , 1993, INFORMS J. Comput..

[8]  Fred Glover,et al.  Applications and Implementation , 1981 .

[9]  James P. Ignizio,et al.  Discriminant analysis via mathematical programming: Certain problems and their causes , 1989, Comput. Oper. Res..

[10]  J. Habbema,et al.  Cases of doubt in allocation problems , 1974 .

[11]  Eva K. Lee,et al.  Automated planning volume definition in soft-tissue sarcoma adjuvant brachytherapy. , 2002, Physics in medicine and biology.

[12]  M. Gessaman,et al.  A Comparison of Some Multivariate Discrimination Procedures , 1972 .

[13]  Robert V. Hogg,et al.  Distribution-Free Partial Discriminant Analysis , 1976 .

[14]  W. Gehrlein.  General mathematical programming formulations for the statistical classification problem , 1986 .

[15]  Kristin P. Bennett,et al.  A Parametric Optimization Method for Machine Learning , 1997, INFORMS J. Comput..

[16]  John M. Liittschwager,et al.  Integer Programming Solution of a Classification Problem , 1978 .

[17]  M. Gessaman,et al.  Nonparametric Discrimination Using Tolerance Regions , 1968 .

[18]  Gary J. Koehler,et al.  Minimizing Misclassifications in Linear Discriminant Analysis , 1990 .

[19]  S. M. Bajgier,et al.  AN EXPERIMENTAL COMPARISON OF STATISTICAL AND LINEAR PROGRAMMING APPROACHES TO THE DISCRIMINANT PROBLEM , 1982 .

[20]  Cliff T. Ragsdale,et al.  On the classification gap in mathematical programming-based approaches to the discriminant problem , 1992 .

[21]  O. Mangasarian,et al.  Multicategory discrimination via linear programming , 1994 .

[22]  Constantine Loucopoulos,et al.  Examining Optimal Criterion Weights in Mixed Integer Programming Approaches to the Multiple-group Classification Problem , 1995 .

[23]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[24]  Eva K. Lee,et al.  Prediction of ultrasound-mediated disruption of cell membranes using machine learning techniques and statistical analysis of acoustic spectra , 2004, IEEE Transactions on Biomedical Engineering.

[25]  Fred Glover,et al.  IMPROVED LINEAR PROGRAMMING MODELS FOR DISCRIMINANT ANALYSIS , 1990 .

[26]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[27]  Eva K. Lee,et al.  Automated planning volume contouring in soft-tissue sarcoma adjuvant brachytherapy treatment , 2001 .

[28]  E. Joachimsthaler,et al.  Solving the Classification Problem in Discriminant Analysis Via Linear and Nonlinear Programming Methods , 1989 .

[29]  Ronald H. Randles,et al.  Distribution-free partial discrimination procedures , 1986 .

[30]  V. Srinivasan,et al.  Multigroup Discriminant Analysis Using Linear Programming , 1997, Oper. Res..