A New Hybrid GA-MDP Algorithm For The Frequency Assignment Problem

We propose a novel algorithm called GA-MDP for solving the frequency assignment problem. GA-MDP inherits the spirit of genetic algorithms with an adaptation of Markov decision processes (MDPs). More precisely policy iteration (PI) and value iteration (VI) are used as mutation operators. Experimental results show that for our application, GA-MDP that uses PI as a mutation operator improves the quality and time performances of the hybrid algorithms and hybrid MDP designed previously by the authors for solving the same problem

[1]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[2]  J. Gaspard.  Deterministic and Stochastic Models , 1991 .

[3]  Fred W. Glover,et al.  A user's guide to tabu search , 1993, Ann. Oper. Res..

[4]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[5]  F. Comellas,et al.  An Ant Algorithm for the Graph Colouring Problem , 1998 .

[6]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[7]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[8]  Robert Givan,et al.  Bounded-parameter Markov decision processes , 2000, Artif. Intell..

[9]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  R. Bellman.  Dynamic programming. , 1957, Science.

[12]  H. Chang,et al.  An ant system approach to Markov decision processes , 2004, Proceedings of the 2004 American Control Conference.

[13]  René Schott,et al.  APPLICATION OF MARKOV DECISION PROCESSES TO THE FREQUENCY ASSIGNMENT PROBLEM , 2004, Appl. Artif. Intell..

[14]  Lhassane Idoumghar,et al.  New modeling approach to the frequency assignment problem in broadcasting , 2002, IEEE Trans. Broadcast..

[15]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[16]  Leslie Pack Kaelbling,et al.  On the Complexity of Solving Markov Decision Problems , 1995, UAI.

[17]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[18]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[19]  René Schott,et al.  New hybrid genetic algorithms for the frequency assignment problem , 2002, IEEE Trans. Broadcast..

[20]  Michael C. Fu,et al.  Evolutionary policy iteration for solving Markov decision processes , 2005, IEEE Transactions on Automatic Control.