Dynamic Decentralized Any-Time Hierarchical Clustering

Hierarchical clustering is used widely to organize data and search for patterns. Previous algorithms assume that the body of data being clustered is fixed while the algorithm runs, and use centralized data representations that make it difficult to scale the process by distributing it across multiple processors. Self-Organizing Data and Search (SODAS) inspired by the decentralized algorithms that ants use to sort their nests, relaxes these constraints. SODAS can maintain a hierarchical structure over a continuously changing collection of leaves, requiring only local computations at the nodes of the hierarchy and thus permitting the system to scale arbitrarily by distributing nodes (and their processing) across multiple computers.

[1]  H. Van Dyke Parunak,et al.  "Go to the ant": Engineering principles from natural multi-agent systems , 1997, Ann. Oper. Res..

[2]  R. Sokal,et al.  THE COMPARISON OF DENDROGRAMS BY OBJECTIVE METHODS , 1962 .

[3]  George N. Reeke,et al.  BOOK REVIEW: "SELF-ORGANIZATION IN BIOLOGICAL SYSTEMS" BY S. CAMAZINE, J. DENEUBOURG, N. R. FRANKS, J. SNEYD, G. THERAULAZ AND E. BONABEAU , 2002 .

[4]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[5]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[6]  David Stuart Robertson,et al.  Dynamic and Distributed Interaction Protocols , 2004, Adaptive Agents and Multi-Agent Systems.

[7]  Chris Cornelis,et al.  Efficient clustering with fuzzy ants , 2004 .

[8]  Sorinel Adrian Oprisan,et al.  Task Oriented Functional Self-organization of Mobile Agents Team: Memory Optimization Based on Correlation Feature , 2004, ANTS Workshop.

[9]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[10]  G. De Soete,et al.  Clustering and Classification , 2019, Data-Driven Science and Engineering.

[11]  Yixin Chen,et al.  A novel ant clustering algorithm based on cellular automata , 2004 .

[12]  Jacob Beal.  Leaderless Distributed Hierarchy Formation , 2002 .

[13]  Marco Dorigo,et al.  Ant-based clustering: a comparative study of its relative performance with respect to k-means, average link and 1d-som , 2003 .

[14]  H. Van Dyke Parunak,et al.  Pheromone learning for self-organizing agents , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Ajith Abraham,et al.  Evolving a Stigmergic Self-Organized Data-Mining , 2004, ArXiv.

[16]  J. Price.  GO TO THE ANT...... , 1969, British Journal of Psychiatry.

[17]  Frances M. T. Brazier,et al.  A method for decentralized clustering in large multi-agent systems , 2003, AAMAS '03.

[18]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[19]  H. Van Dyke Parunak,et al.  Global convergence of local agent behaviors , 2005, AAMAS '05.

[20]  Ben Shneiderman,et al.  Ordered and quantum treemaps: Making effective use of 2D space to display hierarchies , 2002, TOGS.

[21]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[22]  Chris Cornelis,et al.  Fuzzy Ant Based Clustering , 2004, ANTS Workshop.

[23]  Julia Handl,et al.  Improved Ant-Based Clustering and Sorting , 2002, PPSN.

[24]  Inman Harvey,et al.  Fourth European Conference on Artificial Life , 1997 .

[25]  Thomas Stützle,et al.  Ant Colony Optimization and Swarm Intelligence , 2008 .

[26]  Clark F. Olson,et al.  Parallel Algorithms for Hierarchical Clustering , 1995, Parallel Comput..

[27]  Sven A. Brueckner,et al.  RETURN FROM THE ANT SYNTHETIC ECOSYSTEMS FOR MANUFACTURING CONTROL , 2000 .

[28]  Hua Li,et al.  Model-guided information discovery for intelligence analysis , 2005, CIKM '05.

[29]  Juan Julián Merelo Guervós,et al.  Parallel Problem Solving from Nature — PPSN VII , 2002, Lecture Notes in Computer Science.

[30]  Benjamin Walsham,et al.  Simplifled and Optimised Ant Sort for Complex Problems: Document Classiflcation , 2003 .

[31]  Guy Theraulaz,et al.  Phase-ordering kinetics of cemetery organization in ants , 1998 .

[32]  Parag M. Kanade,et al.  Fuzzy ants as a clustering concept , 2003, 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS 2003.

[33]  J. Hartigan.  REPRESENTATION OF SIMILARITY MATRICES BY TREES , 1967 .

[34]  Jean-Arcady Meyer,et al.  From Animals to Animats: Proceedings of The First International Conference on Simulation of Adaptive Behavior (Complex Adaptive Systems) , 1990 .

[35]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[36]  Weng-Kin Lai,et al.  Homogeneous Ants for Web Document Similarity Modeling and Categorization , 2002, Ant Algorithms.

[37]  Ling Chen,et al.  A novel ant clustering algorithm based on cellular automata , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..