Modeling languages and Condor: metacomputing for optimization

Abstract.A generic framework is postulated for utilizing the computational resources provided by a metacomputer to concurrently solve a large number of optimization problems generated by a modeling language. An example of the framework using the Condor resource manager and the AMPL and GAMS modeling languages is provided. A mixed integer programming formulation of a feature selection problem from machine learning is used to test the mechanism developed. Due to this application’s computational requirements, the ability to perform optimizations in parallel is necessary in order to obtain results within a reasonable amount of time. Details about the simple and easy to use tool and implementation are presented so that other modelers with applications generating many independent mathematical programs can take advantage of it to significantly reduce solution times.

[1]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[2]  Qun Chen,et al.  FATCOP: A Fault Tolerant Condor-PVM Mixed Integer Programming Solver , 2000, SIAM J. Optim..

[3]  O. Mangasarian.  Linear and Nonlinear Separation of Patterns by Linear Programming , 1965 .

[4]  J. Meeraus A. Bisschop,et al.  ON THE DEVELOPMENT OF A GENERAL ALGEBRAIC MODELING SYSTEM IN A STRATEGIC PLANNING ENVIRONMENT , 1982 .

[5]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[6]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[7]  Paul S. Bradley,et al.  Feature Selection via Mathematical Programming , 1997, INFORMS J. Comput..

[8]  Kristin P. Bennett,et al.  On support vector decision trees for database marketing , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[9]  Michael C. Ferris,et al.  NEOS and Condor: solving optimization problems over the Internet , 2000, TOMS.

[10]  Miron Livny,et al.  A worldwide flock of Condors: Load sharing among workstation clusters , 1996, Future Gener. Comput. Syst..

[11]  Stephen I. Gallant,et al.  Neural network learning and expert systems , 1993 .

[12]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[13]  S. Odewahn,et al.  Automated star/galaxy discrimination with neural networks , 1992 .

[14]  Paul S. Bradley,et al.  Feature Selection via Concave Minimization and Support Vector Machines , 1998, ICML.

[15]  J. Kittler.  Feature selection and extraction , 1978 .

[16]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[17]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[18]  Mary K. Vernon,et al.  Optimized regional caching for on-demand data delivery , 1998, Electronic Imaging.

[19]  Jack Sklansky,et al.  On Automatic Feature Selection , 1988, Int. J. Pattern Recognit. Artif. Intell..

[20]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[21]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.

[22]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[23]  O. Mangasarian,et al.  Robust linear programming discrimination of two linearly inseparable sets , 1992 .

[24]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[25]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[26]  Kristin P. Bennett,et al.  Feature minimization within decision trees , 1998 .