Improving case-based reasoning in solving optimization problems using Bayesian optimization algorithm

The Case-Based Reasoning CBR solves problems by using the past problem solving experiences. How to apply these experiences depends on the type of the problem. The method presented in this paper tries to overcome this difficulty in CBR for optimization problems, using Bayesian Optimization Algorithm BOA. BOA evolves a population of candidate solutions through constructing Bayesian networks and sampling them. After solving the problems through BOA, Bayesian networks describing solutions features are obtained. In our method, these Bayesian networks are stored in a case-base. For solving a new problem, the Bayesian networks of those problems which are similar to the new problem, are retrieved and combined. This compound Bayesian network is used for generating the initial population and constructing the probabilistic models of BOA in solving the new problem. Our method improves CBR in two ways: first, in our method, how to use the knowledge stored in the case-base is disregarding the problem itself and is universally; second, this method stores the probabilistic descriptions of the previous solutions in order to make the stored knowledge more flexible. Experimental results showed that in addition to the mentioned advantages, our method improved the solutions quality.

[1]  Serafín Moral,et al.  Qualitative combination of Bayesian networks , 2003, Int. J. Intell. Syst..

[2]  Bruce Abramson,et al.  The Topological Fusion of Bayes Nets , 1992, UAI.

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Simon C. K. Shiu,et al.  Soft computing techniques for case knowledge extraction in cbr system development , 2006 .

[5]  David E. Goldberg,et al.  Bayesian Optimization Algorithm: From Single Level to Hierarchy , 2002 .

[6]  Panagiotis Stamatopoulos,et al.  Combinatorial optimization through statistical instance-based learning , 2001, Proceedings 13th IEEE International Conference on Tools with Artificial Intelligence. ICTAI 2001.

[7]  Paul W. H. Chung,et al.  Incorporating domain-specific knowledge into a genetic algorithm to implement case-based reasoning adaptation , 2006, Knowl. Based Syst..

[8]  Shengxiang Yang,et al.  Genetic Algorithms with Self-Organizing Behaviour in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[9]  Adel W. Sadek,et al.  Hybrid Simulated Annealing and Case-Based Reasoning Approach for Computationally Intensive Transportation Problems: Rationale and Design Issues , 2001 .

[10]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[11]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[12]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[13]  Kim-Leng Poh,et al.  Constructing Bayesian Network in a Changing World , 2005, AAAI Spring Symposium: Challenges to Decision Support in a Changing World.

[14]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[15]  Patrick T. Harker,et al.  Case-based reasoning for repetitive combinatorial optimization problems, part I: Framework , 1996, J. Heuristics.

[16]  Fernando Díaz,et al.  Automatic parameter tuning with a Bayesian case-based reasoning system. A case of study , 2009, Expert Syst. Appl..

[17]  David E. Goldberg,et al.  Using Previous Models to Bias Structural Learning in the Hierarchical BOA , 2008, Evolutionary Computation.

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  Pedrito Maynard-Reid,et al.  Aggregating Learned Probabilistic Beliefs , 2001, UAI.

[20]  Patrick T. Harker,et al.  Case-Based Reasoning for Repetitive Combinatorial Optimization Problems, Part II: Numerical Results , 1997, J. Heuristics.

[21]  Med Tayeb Laskri,et al.  Applying Evolutionary Computing in Case Retrieval Stage , 2005 .

[22]  Bruce Abramson,et al.  Some Complexity Considerations in the Combination of Belief Networks , 1993, UAI.

[23]  Tze-Yun Leong,et al.  Pgmc: a Framework for Probabilistic Graphical Model Combination , 2005, AMIA.

[24]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[25]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.