Pure Categorical Optimization - a Global Descent Approach

In this article we introduce and study the pure categorical optimization problem. This is a problem in discrete variables, but where the discrete variables have no natural ordering in the decision space. It is argued that such a problem is a natural framework for the study of, e.g., the problem of finding the right configuration for a customer for certain types of platform-based products. It is shown that the problem can be reformulated into several different nonlinear integer programming models that all are equivalent from a categorical point of view. We investigate its mathematical properties; in particular we establish properties corresponding to those of continuity and convexity for numerical optimization problems. For the solution of the problems we propose to extend the discrete global descent method from the area of (numerical) nonlinear integer programming. We suggest extensions of the principal algorithmic steps within these methods in order to adapt it to categorical problems, utilizing the fact that there are many equivalent problem formulations. Numerical results are provided when applying the proposed methods both to some standard test problems from the literature, and to real-world problems concerning the configuration of heavy-duty trucks. It is concluded that problems in this class can be solved using mathematical techniques. In particular, it is possible to utilize the discrete global descent method, and it is concluded that the extensions added in order to adapt it to categorical problems also improve its performance.

[1]  Wen-xing Zhu,et al.  An approximate algorithm for nonlinear integer programming , 1998, Appl. Math. Comput..

[2]  YangYongjian,et al.  A new discrete filled function algorithm for discrete global optimization , 2007 .

[3]  You-lin Shang,et al.  Finding discrete global minima with a filled function for integer programming , 2008, Eur. J. Oper. Res..

[4]  M. W. Cooper A Survey of Methods for Pure Nonlinear Integer Programming , 1981 .

[5]  Kazuo Murota,et al.  Discrete convex analysis , 1998, Math. Program..

[6]  J. Dennis,et al.  Pattern search algorithms for mixed variable general constrained optimization problems , 2003 .

[7]  J. F. Price,et al.  On descent from local minima , 1971 .

[8]  H. Zimmermann Towards global optimization 2: L.C.W. DIXON and G.P. SZEGÖ (eds.) North-Holland, Amsterdam, 1978, viii + 364 pages, US $ 44.50, Dfl. 100,-. , 1979 .

[9]  P. Favati Convexity in nonlinear integer programming , 1990 .

[10]  Don R. Brown,et al.  Solving fixed configuration problems with genetic search , 1993 .

[11]  W. Marsden I and J , 2012 .

[12]  Timothy W. Simpson,et al.  Product platform design and customization: Status and promise , 2004, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[13]  Susan Carlson-Skalak,et al.  Using an evolutionary algorithm for catalog design , 1998 .

[14]  K. Murota Discrete Convex Analysis: Monographs on Discrete Mathematics and Applications 10 , 2003 .

[15]  Volker Rehbock,et al.  A critical review of discrete filled function methods in solving nonlinear discrete optimization problems , 2010, Appl. Math. Comput..

[16]  J. Meza,et al.  Using pattern search methods for surface structure determination of nanomaterials , 2006 .

[17]  Javier P. Gonzalez-Zugasti,et al.  A Method for Architecting Product Platforms , 2000 .

[18]  Susan E. Carlson,et al.  Genetic algorithm attributes for component selection , 1996 .

[19]  Yongjian Yang,et al.  A filled function method for constrained nonlinear integer programming , 2008 .

[20]  Arnold Neumaier,et al.  A splitting technique for discrete search based on convex relaxation , 2009 .

[21]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[22]  Kazuo Murota,et al.  Relationship of M-/L-convex functions with discrete convex functions by Miller and Favati-Tardella , 2001, Discret. Appl. Math..

[23]  Charles Audet,et al.  Mesh adaptive direct search algorithms for mixed variable optimization , 2007, Optim. Lett..

[24]  Duan Li,et al.  Discrete Filled Function Method for Discrete Global Optimization , 2005, Comput. Optim. Appl..

[25]  Y. Yongjian,et al.  A new discrete filled function algorithm for discrete global optimization , 2007 .

[26]  Roger Jianxin Jiao,et al.  Integrated Vehicle Configuration System - Connecting the domains of mass customization , 2010, Comput. Ind..

[27]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[28]  Farrokh Mistree,et al.  Product platform design: method and application , 2001 .

[29]  Mark A. Abramson,et al.  Optimal sensor placement for enhancing sensitivity to change in stiffness for structural health monitoring , 2008 .

[30]  Roger Jianxin Jiao,et al.  A generic genetic algorithm for product family design , 2007, J. Intell. Manuf..

[31]  Jennifer G. Walston,et al.  Search Techniques for Multi-Objective Optimization of Mixed-Variable Systems Having Stochastic Responses , 2007 .

[32]  Marco Sciandrone,et al.  An Algorithm Model for Mixed Variable Programming , 2005, SIAM J. Optim..

[33]  S. E. Carlson,et al.  Comparison of Three Non-derivative Optimization Methods with a Genetic Algorithm for Component Selection , 1994 .

[34]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[35]  Arnold Neumaier,et al.  Discrete Search in Design Optimization , 2010, CSDM.

[36]  J. Dennis,et al.  Mixed Variable Optimization of the Number and Composition of Heat Intercepts in a Thermal Insulation System , 2001 .

[37]  Roger Jianxin Jiao,et al.  Product family design and platform-based product development: a state-of-the-art review , 2007, J. Intell. Manuf..

[38]  Kazuo Murota,et al.  Notes on L-/M-convex functions and the separation theorems , 2000, Math. Program..

[39]  Duan Li,et al.  Discrete global descent method for discrete global optimization and nonlinear integer programming , 2007, J. Glob. Optim..

[40]  Kazuo Murota,et al.  M-Convex Function on Generalized Polymatroid , 1999, Math. Oper. Res..

[41]  Sven Leyffer,et al.  Modeling without categorical variables: a mixed-integer nonlinear program for the optimization of thermal insulation systems , 2010 .

[42]  Renpu Ge,et al.  A Filled Function Method for Finding a Global Minimizer of a Function of Several Variables , 1990, Math. Program..

[43]  Mark A. Abramson,et al.  Pattern search ranking and selection algorithms for mixed variable simulation-based optimization , 2009, Eur. J. Oper. Res..

[44]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[45]  R. Ge,et al.  A continuous approach to nonlinear integer programming , 1989 .

[46]  Michel Hecquet,et al.  Mixed-variable optimal design of induction motors including efficiency, noise and thermal criteria , 2011 .

[47]  B. L. Miller On Minimizing Nonseparable Functions Defined on the Integers with an Inventory Application , 1971 .

[48]  Charles Audet,et al.  Pattern Search Algorithms for Mixed Variable Programming , 2000, SIAM J. Optim..