Multi-sensor fusion: an Evolutionary algorithm approach

Modern decision-making processes rely on data coming from different sources. Intelligent integration and fusion of information from distributed multi-source, multi-sensor network requires an optimization-centered approach. Traditional optimization techniques often fail to meet the demands and challenges of highly dynamic and volatile information flow. New methods are required, which are capable of fully automated adjustment and self-adaptation to fluctuating inputs and tasks. One such method is Evolutionary algorithms (EA), a generic, flexible, and versatile framework for solving complex problems of global optimization and search in real world applications. The evolutionary approach provides a valuable alternative to traditional methods used in information fusion, due to its inherent parallel nature and its ability to deal with difficult problems. However, the application of the algorithm to a particular problem is often more an art than science. Choosing the right model and parameters requires an in-depth understanding of the morphological development of the algorithm, as well as its recent advances and trends. This paper attempts to give a compact overview of both basic and advanced concepts, models, and variants of Evolutionary algorithms in various implementations and applications particularly those in information fusion. We have brought together material scattered throughout numerous books, journal papers, and conference proceedings. Strong emphasis is made on the practical aspects of the EA implementation, including specific and detailed recommendations drawn from these various sources. However, the practical aspects are discussed from the standpoint of concepts and models, rather than from applications in specific problem domains, which emphasize the generality of the provided recommendations across different applications including information fusion.

[1]  K. S. Tang,et al.  Genetic Algorithms: Concepts and Designs with Disk , 1999 .

[2]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[3]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[4]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[5]  Randy L. Haupt,et al.  Practical Genetic Algorithms , 1998 .

[6]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[7]  Lashon B. Booker,et al.  Proceedings of the fourth international conference on Genetic algorithms , 1991 .

[8]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[11]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[12]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[13]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[14]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[15]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[16]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[17]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[18]  M. El-Sharkawi,et al.  Introduction to Evolutionary Computation , 2008 .

[19]  David E. Goldberg,et al.  The compact genetic algorithm , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[20]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[21]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[22]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[23]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[24]  Zbigniew Michalewicz,et al.  The Significance of the Evaluation Function in Evolutionary Algorithms , 1999 .

[25]  Mitsuo Gen,et al.  Genetic Algorithms , 1999, Wiley Encyclopedia of Computer Science and Engineering.

[26]  Jae C. Oh,et al.  Image learning classifier system using genetic algorithms , 1989, Proceedings of the IEEE National Aerospace and Electronics Conference.

[27]  Tarek A. El-Ghazawi,et al.  GA-Based Parallel Image Registration on Parallel Clusters , 1999, IPPS/SPDP Workshops.

[28]  David B. Fogel,et al.  Evolution-ary Computation 1: Basic Algorithms and Operators , 2000 .

[29]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[30]  Zbigniew Michalewicz,et al.  A PATCHWORK model for evolutionary algorithms with structured and variable size populations , 1999 .

[31]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[32]  Lawrence Davis,et al.  Adapting Operator Probabilities in Genetic Algorithms , 1989, ICGA.

[33]  Worthy N. Martin,et al.  Foundations of Genetic Algorithms 6 (Foga-6) , 2001 .

[34]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[35]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[36]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[37]  Frederick E. Petry,et al.  Genetic algorithms for scene interpretation from prototypical semantic description , 2000 .

[38]  D. H. Horrocks,et al.  A hardware architecture for a parallel genetic algorithm for image registration , 1994 .

[39]  G. Harik Learning gene linkage to efficiently solve problems of bounded difficulty using genetic algorithms , 1997 .

[40]  D. E. Goldberg,et al.  Simple Genetic Algorithms and the Minimal, Deceptive Problem , 1987 .

[41]  Pedro Larrañaga,et al.  A Review on Estimation of Distribution Algorithms , 2002, Estimation of Distribution Algorithms.

[42]  J. Fitzpatrick,et al.  Adaptive search space scaling in digital image registration. , 1989, IEEE transactions on medical imaging.

[43]  Patrick D. Surry,et al.  Formal Memetic Algorithms , 1994, Evolutionary Computing, AISB Workshop.

[44]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[45]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[46]  Toshio Fukuda,et al.  Virus-Evolutionary Genetic Algorithm and Its Application to Traveling Salesman Problem , 1999 .

[47]  David B. Fogel,et al.  A note on representations and variation operators , 1997, IEEE Trans. Evol. Comput..

[48]  S. Iyengar,et al.  Multi-Sensor Fusion: Fundamentals and Applications With Software , 1997 .

[49]  John J. Grefenstette,et al.  Genetic Search with Approximate Function Evaluation , 1985, ICGA.

[50]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[51]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[52]  Xin Yao,et al.  Evolutionary computation : theory and applications , 1999 .

[53]  Kenneth DeJong,et al.  Robust feature selection algorithms , 1993, Proceedings of 1993 IEEE Conference on Tools with Al (TAI-93).

[54]  Tino Gramß Non-standard Computation - Molecular Computation, Cellular Automata, Evolutionary Algorithms, Quantum Computers , 2005, Non-standard Computation.

[55]  M.J. Martin-Bautista,et al.  A survey of genetic feature selection in mining issues , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[56]  John M. Trenkle,et al.  Morphological feature-set optimization using the genetic algorithm , 1991, Optics & Photonics.

[57]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[58]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[59]  Kalyanmoy Deb,et al.  RapidAccurate Optimization of Difficult Problems Using Fast Messy Genetic Algorithms , 1993, ICGA.

[60]  Mitsuo Gen,et al.  Genetic algorithms and engineering optimization , 1999 .

[61]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[62]  A. E. Eiben,et al.  Genetic algorithms with multi-parent recombination , 1994, PPSN.

[63]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[64]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[65]  John R. Koza,et al.  Hierarchical Genetic Algorithms Operating on Populations of Computer Programs , 1989, IJCAI.

[66]  E. Thorndike On the Organization of Intellect. , 1921 .

[67]  Christopher J. Taylor,et al.  Model-based image interpretation using genetic algorithms , 1992, Image Vis. Comput..

[68]  W. Spears,et al.  On the Virtues of Parameterized Uniform Crossover , 1995 .

[69]  Adam Prügel-Bennett,et al.  The Mixing Rate of Different Crossover Operators , 2000, FOGA.

[70]  Zbigniew Michalewicz,et al.  Evolutionary algorithms , 1997, Emerging Evolutionary Algorithms for Antennas and Wireless Communications.

[71]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[72]  Gunar E. Liepins,et al.  Punctuated Equilibria in Genetic Search , 1991, Complex Syst..

[73]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[74]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[75]  Filippo Menczer,et al.  Feature selection in unsupervised learning via evolutionary search , 2000, KDD '00.

[76]  Jeffrey A. Joines,et al.  Utilizing Hybrid Genetic Algorithms , 2003 .

[77]  Frederick E. Petry,et al.  Scene recognition using genetic algorithms with semantic nets , 1990, Pattern Recognit. Lett..

[78]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[79]  J. Ghaboussi,et al.  Chapter 9 Applying the Implicit Redundant Representation Genetic Algorithm in an Unstructured Problem Domain , 2001 .

[80]  Dirk Thierens,et al.  Toward a Better Understanding of Mixing in Genetic Algorithms , 1993 .

[81]  T. M. English Proceedings of the third annual conference on evolutionary programming: A.V. Sebald and L.J. Fogel, River Edge, NJ: World Scientific, ISBN 981-02-1810-9, 371 pages, hardbound, $78 , 1995 .

[82]  Masatoshi Sakawa,et al.  Genetic Algorithms and Fuzzy Multiobjective Optimization , 2001 .

[83]  Michael D. Vose,et al.  The simple genetic algorithm - foundations and theory , 1999, Complex adaptive systems.

[84]  Reinhard Männer,et al.  Towards an Optimal Mutation Probability for Genetic Algorithms , 1990, PPSN.

[85]  Xin Yao,et al.  Evolutionary Optimization , 2002 .

[86]  James E. Baker,et al.  Adaptive Selection Methods for Genetic Algorithms , 1985, International Conference on Genetic Algorithms.

[87]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[88]  John M. Trenkle,et al.  Feature set optimization for the recognition of Arabic characters using genetic algorithms , 1993, Other Conferences.

[89]  R. Boggia,et al.  Genetic algorithms as a strategy for feature selection , 1992 .

[90]  John J. Grefenstette,et al.  Genetic algorithms in noisy environments , 1988, Machine Learning.

[91]  Hillol Kargupta Gene expression: The missing link in evolutionary computation , 1997 .

[92]  Azriel Rosenfeld,et al.  If we use 4- or 8-connectedness for both the objects and the background, the Euler characteristics is not locally computable , 1990, Pattern Recognition Letters.

[93]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..