Algorithmes de fourmis artificielles : applications à la classification et à l'optimisation. (Artificial ant based algorithms applied to clustering and optimization problems)

Dans ce travail de these, nous presentons les travaux s'inspirant des fourmis reelles pour la resolution de problemes en informatique. Nous proposons deux approches supplementaires de ces nouvelles inspirations biomimetiques. La premiere reprend certains travaux en classification non supervisee et etend ces principes dans plusieurs directions. L'algorithme AntClass developpe a cette occasion, est hybride dans le sens ou la recherche du nombre de classes est effectue par des fourmis artificielles et qu'un algorithme classique en classification, les centres mobiles, est utilise pour gommer les erreurs de classification inherentes a une methode stochastique telle que les fourmis artificielles. Apres avoir souligne les ressemblances et differences entre les approches evolutionnaires et celles a base de population de fourmis et propose un modele commun, nous nous inspirons de la strategie de recherche de nourriture d'une espece de fourmis (Pachycondyla apicalis) pour resoudre des problemes d'optimisation globale. L'apport de cette adaptation reside principalement dans sa simplicite. Nous appliquons l'algorithme qui en decoule, appele API, a des problemes varies tels que l'optimisation de fonctions numeriques, l'apprentissage de chaines de Markov cachees ou des poids d'un reseau de neurones artificiels, ou encore a un probleme d'optimisation combinatoire classique : le probleme du voyageur de commerce.

[1]  Alex M. Andrew,et al.  Artificial Intelligence and Mobile Robots , 1999 .

[2]  A. M. Assad,et al.  Emergent colonization in an artificial ecology , 1992 .

[3]  Richard F. Hartl,et al.  Applying the ANT System to the Vehicle Routing Problem , 1999 .

[4]  Dominique Fresneau Biologie et comportement social d'une fourmi ponérine néotropicale (Pachycondyla Apicalis) , 1994 .

[5]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[6]  Richard F. Hartl,et al.  An improved Ant System algorithm for theVehicle Routing Problem , 1999, Ann. Oper. Res..

[7]  Christine Solnon,et al.  Solving Permutation Constraint Satisfaction Problems with Artificial Ants , 2000, ECAI.

[8]  A. Wren,et al.  An Ant System for Bus Driver Scheduling 1 , 1997 .

[9]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[10]  Thomas Stützle,et al.  An Ant Approach to the Flow Shop Problem , 1998 .

[11]  Corso Elvezia Ant Colonies for the QAP , 1997 .

[12]  Nicolas Monmarché,et al.  On how the ants Pachycondyla Apicalis are suggesting a new search algorithm , 1999 .

[13]  Mohamed Slimane,et al.  Optimizing Hidden Markov Models with a Genetic Algorithm , 1995, Artificial Evolution.

[14]  Ian C. Parmee,et al.  The Ant Colony Metaphor for Searching Continuous Design Spaces , 1995, Evolutionary Computing, AISB Workshop.

[15]  M. Dorigo,et al.  Aco Algorithms for the Traveling Salesman Problem , 1999 .

[16]  Vasant Honavar,et al.  Proceedings of the Genetic and Evolutionary Computation Conference , 2021, GECCO.

[17]  P. W. Grant,et al.  Using Competing Ant Colonies to Solve k-way Partitioning Problems with Foraging and Raiding Strategies , 1999, ECAL.

[18]  M. C. Sinclair,et al.  Ant colony optimisation for virtual-wavelength-path routing and wavelength allocation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[19]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[20]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[21]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[22]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[23]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[24]  Richard F. Hartl,et al.  An ant colony optimization approach for the single machine total tardiness problem , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[25]  Thomas Stützle,et al.  Parallelization Strategies for Ant Colony Optimization , 1998, PPSN.

[26]  Luca Maria Gambardella,et al.  A Probabilistic Model for Understanding and Comparing Collective Aggregation Mechansims , 1999, ECAL.

[27]  Israel A. Wagner,et al.  ANTS: Agents on Networks, Trees, and Subgraphs , 2000, Future Gener. Comput. Syst..

[28]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[29]  E. D. Taillard,et al.  Ant Systems , 1999 .

[30]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[31]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[32]  Michael J. B. Krieger,et al.  The call of duty: Self-organised task allocation in a population of up to twelve mobile robots , 2000, Robotics Auton. Syst..

[33]  Israel A. Wagner,et al.  Distributed covering by ant-robots using evaporating traces , 1999, IEEE Trans. Robotics Autom..

[34]  Luca Maria Gambardella,et al.  HAS-SOP: Hybrid Ant System for the Sequential Ordering Problem , 1997 .

[35]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[36]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[37]  Slimane,et al.  5 - Apprentissage non-supervisé d'images par hybridation génétique d'une chaîne de Markov cachée , 1999 .

[38]  Nicolas Monmarche,et al.  On Data Clustering With Artificial Ants , 1999 .

[39]  Jacques Ferber,et al.  Les Systèmes multi-agents: vers une intelligence collective , 1995 .

[40]  Marco Dorigo,et al.  Two Ant Colony Algorithms for Best-Effort Routing in Datagram Networks , 1998 .

[41]  E. Bonabeau,et al.  Routing in Telecommunications Networks with “ Smart ” Ant-Like Agents , 1998 .

[42]  Nicolas Monmarché,et al.  On how Pachycondyla apicalis ants suggest a new search algorithm , 2000, Future Gener. Comput. Syst..

[43]  E. Bonabeau,et al.  Fixed response thresholds and the regulation of division of labor in insect societies , 1998 .

[44]  J. Deneubourg,et al.  Self-organization mechanisms in ant societies. II: Learning in foraging and division of labor , 1987 .

[45]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[46]  Philip W. Grant,et al.  A multilevel k–way partitioning algorithm for finite element meshes using competing ant colonies , 1999 .

[47]  Fatima-Zohra Kettaf Contribution des algorithmes évolutionnaires au partitionnement des données , 1997 .

[48]  Mohamed Slimane,et al.  Hybrid Genetic Learning of Hidden Markov Models for Time Series Prediction , 1998 .

[49]  M. Dorigo,et al.  1 Positive Feedback as a Search Strategy , 1991 .

[50]  Antonella Carbonaro,et al.  An ANTS heuristic for the frequency assignment problem , 2000, Future Gener. Comput. Syst..

[51]  David V. Thiel,et al.  Sensing odour trails for mobile robot navigation , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[52]  Vittorio Maniezzo,et al.  Exact and Approximate Nondeterministic Tree-Search Procedures for the Quadratic Assignment Problem , 1999, INFORMS J. Comput..

[53]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[54]  Vittorio Maniezzo,et al.  The Ant System Applied to the Quadratic Assignment Problem , 1999, IEEE Trans. Knowl. Data Eng..

[55]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[56]  Hiroshi Kobayashi,et al.  An Autonomous Agent Navigating with a Polarized Light Compass , 1997, Adapt. Behav..

[57]  Eric Bonabeau,et al.  Evolving Ant Colony Optimization , 1998, Adv. Complex Syst..

[58]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[59]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[60]  Gianni A. Di Caro,et al.  AntNet: A Mobile Agents Approach to Adaptive Routing , 1999 .

[61]  Thomas Stützle,et al.  Improvements on the Ant-System: Introducing the MAX-MIN Ant System , 1997, ICANNGA.

[62]  Pascale Kuntz,et al.  A Stochastic Heuristic for Visualising Graph Clusters in a Bi-Dimensional Space Prior to Partitioning , 1999, J. Heuristics.

[63]  John R. Koza,et al.  Genetic evolution and co-evolution of computer programs , 1991 .

[64]  Marco Dorigo,et al.  New Results of an Ant System Approach Applied to the Asymmetric TSP , 1995 .

[65]  L. Darrell Whitley,et al.  Delta Coding: An Iterative Search Strategy for Genetic Algorithms , 1991, ICGA.

[66]  Michel Bierlaire,et al.  Introduction à l"optimisation non linéaire , 2001 .

[67]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[68]  Michèle Sebag,et al.  Parametric and non-parametric identification of macro-mechanical models , 1997 .

[69]  Bruce Denby,et al.  Application of ant colony optimization to adaptive routing in aleo telecomunications satellite network , 2002, Ann. des Télécommunications.

[70]  E. Talbi,et al.  Antabu | Enhanced Version Lil-99-1 , 1999 .

[71]  Nicolas Monmarché,et al.  On Generating HTML Style Sheets with an Interactive Genetic Algorithm Based on Gene Frequencies , 1999, Artificial Evolution.

[72]  Chris Melhuish,et al.  Exploiting Domain Physics: Using Stigmergy to Control Cluster Building with Real Robots , 1999, ECAL.

[73]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[74]  Laura Caponetti,et al.  An evolutionary and cooperative agents model for optimization , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[75]  M. Dorigo,et al.  The Ant Colony Optimization MetaHeuristic 1 , 1999 .

[76]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[77]  A. M. Bruckstein,et al.  Hamiltonian(t)-an ant-inspired heuristic for recognizing Hamiltonian graphs , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[78]  G. Venturini Algorithmes génétiques et apprentissage , 1996 .

[79]  Rita Cucchiara,et al.  Analysis and Comparison of different Genetic Models for the Clustering problem in Image Analysis , 1993 .

[80]  Frédéric Geurts ANTS '98 - From Ant Colonies to Artificial Ants: First International Workshop on Ant Colony Optimization , 1998, AI Commun..

[81]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[82]  Éric D. Taillard,et al.  FANT: Fast ant system , 1998 .

[83]  Dominique Lavenier 8 - Parallélisation de l'algorithme du K-means sur un système reconfigurable : Application aux images hyper-spectrales , 2001 .

[84]  Gabriele Kotsis,et al.  Parallelization strategies for the ant system , 1998 .

[85]  Cyril Fonlupt,et al.  Parallel Ant Colonies for Combinatorial Optimization Problems , 1999, IPPS/SPDP Workshops.

[86]  N. Pierce Origin of Species , 1914, Nature.

[87]  Thierry Brouard Algorithmes hybrides d'apprentissage de chaines de Markov cachées : conception et applications à la reconnaissance des formes , 1999 .

[88]  Donald R. Jones,et al.  Solving Partitioning Problems with Genetic Algorithms , 1991, International Conference on Genetic Algorithms.

[89]  Chris Langton,et al.  Artificial Life , 2017, Encyclopedia of Machine Learning and Data Mining.

[90]  Jean-Louis Deneubourg,et al.  Harvesting by a group of robots , 1992 .

[91]  Luca Maria Gambardella,et al.  MACS-VRPTW: a multiple ant colony system for vehicle routing problems with time windows , 1999 .

[92]  S. Baluja An Empirical Comparison of Seven Iterative and Evolutionary Function Optimization Heuristics , 1995 .

[93]  M. Chapuisat,et al.  Les fourmis sont-elles encore en froid avec Darwin : De l'avantage d'avoir des frères et des soeurs quand on est stérile , 1997 .

[94]  Russell C. Eberhart,et al.  The particle swarm: social adaptation in information-processing systems , 1999 .

[95]  Luca Maria Gambardella,et al.  Ant-Q: A Reinforcement Learning Approach to the Traveling Salesman Problem , 1995, ICML.

[96]  Marco Dorigo,et al.  An Investigation of some Properties of an "Ant Algorithm" , 1992, PPSN.

[97]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[98]  Leslie Pack Kaelbling,et al.  Learning in embedded systems , 1993 .

[99]  Nicolas Monmarché,et al.  On the similarities between AS, BSC and PBIL: toward the birth of a new meta-heuristic , 1999 .

[100]  Martin Middendorf,et al.  An Island Model Based Ant System with Lookahead for the Shortest Supersequence Problem , 1998, PPSN.

[101]  Guy Theraulaz,et al.  Adaptive Task Allocation Inspired by a Model of Division of Labor in Social Insects , 1997, BCEC.

[102]  C. Mariano,et al.  MOAQ an Ant-Q algorithm for multiple objective optimization problems , 1999 .

[103]  Marco Dorigo,et al.  Mobile agents for adaptive routing , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[104]  Gregor von Laszewski,et al.  Intelligent Structural Operators for the k-way Graph Partitioning Problem , 1991, ICGA.

[105]  Nigel R. Franks,et al.  Task allocation in ant colonies within variable environments (A study of temporal polyethism: Experimental) , 1993 .

[106]  Joshua M. Epstein,et al.  Growing artificial societies , 1996 .

[107]  A. Bagnères,et al.  Artificial neural network modeling of caste odor discrimination based on cuticular hydrocarbons in termites , 1998, CHEMOECOLOGY.

[108]  M. Sebag,et al.  A society of hill-climbers , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[109]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[110]  W. Hamilton The genetical evolution of social behaviour. II. , 1964, Journal of theoretical biology.

[111]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[112]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[113]  B. Bullnheimer,et al.  A NEW RANK BASED VERSION OF THE ANT SYSTEM: A COMPUTATIONAL STUDY , 1997 .

[114]  Walter J. Gutjahr,et al.  A Graph-based Ant System and its convergence , 2000, Future Gener. Comput. Syst..

[115]  Martin Middendorf,et al.  An ACO algorithm for the shortest common supersequence problem , 1999 .

[116]  Geoffrey H. Ball,et al.  PROMENADE - AN IMPROVED INTERACTIVE-GRAPHICS MAN/MACHINE SYSTEM FOR PATTERN RECOGNITION. , 1968 .

[117]  Mohamed Slimane,et al.  Solving the Multiple Resource Constrained Project Scheduling Problem with a Hybrid Genetic Algorithm , 1997, ICGA.

[118]  R. Matthews,et al.  Ants. , 1898, Science.

[119]  Sing-Tze Bow,et al.  Pattern recognition. Applications to large data-set problems , 1984 .

[120]  Corso Elvezia,et al.  Ant colonies for the traveling salesman problem , 1997 .

[121]  Luca Maria Gambardella,et al.  A Study of Some Properties of Ant-Q , 1996, PPSN.

[122]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[123]  Luca Maria Gambardella,et al.  An ant approach for structured quadratic assignment problems , 1997 .

[124]  G. Reinelt The traveling salesman: computational solutions for TSP applications , 1994 .

[125]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[126]  J. Lachaud,et al.  Graded recruitment and hunting strategies linked to prey weight and size in the ponerine ant Ectatomma ruidum , 1997, Behavioral Ecology and Sociobiology.

[127]  Jean-Arcady Meyer,et al.  Collective sorting and segregation in robots with minimal sensing , 1998 .

[128]  Marco Dorigo,et al.  Ant system for Job-shop Scheduling , 1994 .

[129]  Masahito Yamamoto,et al.  Ants War with Evolutive Pheromone Style Communication , 1999, ECAL.

[130]  Guy Theraulaz,et al.  Response Threshold Reinforcement and Division of Labor in Insect Societies , 1998 .

[131]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[132]  L. Darrell Whitley,et al.  Island Model genetic Algorithms and Linearly Separable Problems , 1997, Evolutionary Computing, AISB Workshop.

[133]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[134]  Pascale Kuntz,et al.  Emergent colonization and graph partitioning , 1994 .

[135]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[136]  P. Sopp Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[137]  Z. Michalewicz,et al.  A new version of ant system for subset problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[138]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[139]  Thomas Stützle,et al.  The MAX–MIN Ant System and Local Search for Combinatorial Optimization Problems: Towards Adaptive Tools for Global Optimization , 1997 .

[140]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[141]  Franz Oppacher,et al.  Connection Management using Adaptive Mobile Agents , 1998 .

[142]  Robert Paul Byrne,et al.  Global optimisation in process design , 1997 .

[143]  Matthijs den Besten,et al.  Ant Colony Optimization for the Total Weighted Tardiness Problem , 2000, PPSN.

[144]  Léon J. M. Rothkrantz,et al.  Ant-Based Load Balancing in Telecommunications Networks , 1996, Adapt. Behav..

[145]  George Bilchev Evolutionary Metaphors for the Bin Packing Problem , 1996, Evolutionary Programming.

[146]  Nicolas Monmarché,et al.  On Improving Clustering in Numerical Databases with Artificial Ants , 1999, ECAL.

[147]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[148]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[149]  Masahito Yamamoto,et al.  Multiple Ant Colonies Algorithm Based on Colony Level Interactions , 2000 .

[150]  Roger D. Quinn,et al.  Control of a hexapod robot using a biologically inspired neural network , 1993 .

[151]  Gilbert Syswerda,et al.  Simulated Crossover in Genetic Algorithms , 1992, FOGA.

[152]  E. Wilson,et al.  Sociobiology: The New Synthesis , 1975 .

[153]  Thomas Stützle,et al.  ACO algorithms for the quadratic assignment problem , 1999 .

[154]  Christine Solnon,et al.  Ant-P-Solveur: un solveur de contraintes à base de fourmis artificielles , 2000, JFPLC.

[155]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[156]  Marco Dorigo,et al.  Ant Colonies for Adaptive Routing in Packet-Switched Communications Networks , 1998, PPSN.

[157]  Luca Maria Gambardella,et al.  Solving symmetric and asymmetric TSPs by ant colonies , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[158]  Martin Heusse,et al.  Adaptive Agent-Driven Routing and Load Balancing in Communication Networks , 1998, Adv. Complex Syst..

[159]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[160]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[161]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[162]  Alain Hertz,et al.  Ants can colour graphs , 1997 .

[163]  Nicolas Monmarché,et al.  AntClass: discovery of clusters in numeric data by an hybridization of an ant colony with the Kmeans , 1999 .

[164]  Geoffrey H. Ball,et al.  ISODATA, A NOVEL METHOD OF DATA ANALYSIS AND PATTERN CLASSIFICATION , 1965 .

[165]  L. Darrell Whitley,et al.  Building Better Test Functions , 1995, ICGA.

[166]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[167]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[168]  Eric Bonabeau,et al.  Cooperative transport by ants and robots , 2000, Robotics Auton. Syst..

[169]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[170]  Marco Dorigo,et al.  AntNet: Distributed Stigmergetic Control for Communications Networks , 1998, J. Artif. Intell. Res..

[171]  Hong Zhang,et al.  Collective Robotics: From Social Insects to Robots , 1993, Adapt. Behav..

[172]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[173]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[174]  Emanuel Falkenauer,et al.  A New Representation and Operators for Genetic Algorithms Applied to Grouping Problems , 1994, Evolutionary Computation.

[175]  M. Mandischer Evolving recurrent neural networks with non-binary encoding , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.