LBMIC: communication-aware load balancing in distributed ASMs with evolving social networks

Multi-agent-based simulation for artificial stock market (ASM) is an important method in behavioural finance. The social network in ASM will influence the coordination and decision making of the intelligent agents. To improve the performance of an ASM with evolving social networks in a distributed computing environment, the computational load balancing and inter-nodes communication should be considered jointly. This paper proposes a scheduling algorithm called LBMIC to partition the agents onto different computing nodes while keeping the degree of load imbalance lower than a given threshold with minimized inter-nodes communication between agents. LBMIC models the scheduling into a graph partitioning problem and uses the multi-level graph partitioning algorithm to achieve an efficient scheduling. When the network evolves, LBMIC refines the partitioning by migrating parts of the agents. The experiments indicate that LBMIC can efficiently improve the performance of communication-intensive ASMs by both initial partitioning and refining partitioning.

[1]  Brian Logan,et al.  The distributed simulation of multiagent systems , 2001, Proc. IEEE.

[2]  Junling Ma,et al.  Network evolution by different rewiring schemes , 2009 .

[3]  Cheng-Zhong Xu,et al.  Iterative Dynamic Load Balancing in Multicomputers , 1994 .

[4]  Gennaro Cordasco,et al.  A Framework for Distributing Agent-Based Simulations , 2011, Euro-Par Workshops.

[5]  Horst D. Simon,et al.  Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems , 1994, Concurr. Pract. Exp..

[6]  William W. Hager,et al.  An exact algorithm for graph partitioning , 2013, Math. Program..

[7]  Franz Rendl,et al.  Solving Graph Bisection Problems with Semidefinite Programming , 2000, INFORMS J. Comput..

[8]  L Nyström,et al.  Statistical Analysis , 2008, Encyclopedia of Social Network Analysis and Mining.

[9]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[10]  Jordi Sabater-Mir,et al.  Reputation and social network analysis in multi-agent systems , 2002, AAMAS '02.

[11]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[12]  Fred W. Glover,et al.  Tabu search for graph partitioning , 1996, Ann. Oper. Res..

[13]  Franz Rendl,et al.  A projection technique for partitioning the nodes of a graph , 1995, Ann. Oper. Res..

[14]  B. LeBaron Building the Santa Fe Artificial Stock Market , 2002 .

[15]  Erlang Networks On Load Balancing in , 2022 .

[16]  Victor R. Lesser,et al.  Multiagent reinforcement learning and self-organization in a network of agents , 2007, AAMAS '07.

[17]  R. Karl Rethemeyer,et al.  Network analysis , 2011 .

[18]  Bruce Hendrickson,et al.  An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel Computations , 1995, SIAM J. Sci. Comput..

[19]  T. Snijders The statistical evaluation of social network dynamics , 2001 .

[20]  Yinyu Ye,et al.  A .699-Approximation Algorithm for Max-Bisection , 1999 .

[21]  Cecilia R. Aragon,et al.  Optimization by Simulated Annealing: An Experimental Evaluation; Part I, Graph Partitioning , 1989, Oper. Res..

[22]  R. M. Mattheyses,et al.  A Linear-Time Heuristic for Improving Network Partitions , 1982, 19th Design Automation Conference.

[23]  A. Hoffman,et al.  Lower bounds for the partitioning of graphs , 1973 .

[24]  Wanyuan Wang,et al.  Task Allocation for Undependable Multiagent Systems in Social Networks , 2013, IEEE Transactions on Parallel and Distributed Systems.

[25]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[26]  Konstantin Andreev,et al.  Balanced Graph Partitioning , 2004, SPAA '04.

[27]  Jing Hu,et al.  Decision Making of Networked Multiagent Systems for Interaction Structures , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Alan M. Frieze,et al.  Improved Approximation Algorithms for MAX k-CUT and MAX BISECTION , 1995, IPCO.

[29]  Ramon Sangüesa,et al.  Extracting reputation in multi agent systems by means of social network topology , 2002, AAMAS '02.

[30]  Gengbin Zheng,et al.  Achieving High Performance on Extremely Large Parallel Machines: Performance Prediction and Load Balancing , 2005 .

[31]  Gary L. Miller,et al.  A unified geometric approach to graph separators , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[32]  George L. Nemhauser,et al.  Min-cut clustering , 1993, Math. Program..

[33]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[34]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[35]  K. Kaski,et al.  Clustering and information in correlation based financial networks , 2003, cond-mat/0312682.

[36]  Kengo Katayama,et al.  Performance of a genetic algorithm for the graph partitioning problem , 2003 .

[37]  A. Louisa,et al.  コロイド混合体における有効力 空乏引力から集積斥力へ | 文献情報 | J-GLOBAL 科学技術総合リンクセンター , 2002 .

[38]  David S. Johnson,et al.  Some simplified NP-complete problems , 1974, STOC '74.

[39]  Siew Ann Cheong,et al.  Understanding agent-based models of financial markets: A bottom-up approach based on order parameters and phase diagrams , 2012, 1202.0606.

[40]  Philippe Mathieu,et al.  A Generic Architecture for Realistic Simulations of Complex Financial Dynamics , 2010, PAAMS.

[41]  Jaime Simão Sichman,et al.  Multi Agent Systems for design team assembly and knowledge exchange , 2008, 2008 12th International Conference on Computer Supported Cooperative Work in Design.

[42]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[43]  S. N. Dorogovtsev,et al.  Evolution of networks with aging of sites , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[44]  V. Eguíluz,et al.  Growing scale-free networks with small-world behavior. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[46]  Reda Alhajj,et al.  Stock Market Investment Advice: A Social Network Approach , 2012, 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining.

[47]  Zhen Li,et al.  Social Conformity and Price Fluctuation in Artificial Stock Market , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[48]  Mark E. McBride,et al.  Intraday trading patterns in an intelligent autonomous agent-based stock market , 2011 .

[49]  Panos M. Pardalos,et al.  Statistical analysis of financial networks , 2005, Comput. Stat. Data Anal..

[50]  Xintian Zhuang,et al.  A network analysis of the Chinese stock market , 2009 .

[51]  Michael J. North,et al.  Parallel agent-based simulation with Repast for High Performance Computing , 2013, Simul..

[52]  Stephen A. Jarvis,et al.  Grid load balancing using intelligent agents , 2005, Future Gener. Comput. Syst..

[53]  Xiang Chen,et al.  A Platform for Stock Market Simulation with Distributed Agent-Based Modeling , 2014, ICA3PP.

[54]  Wander Jager,et al.  Social Simulation of Stock Markets: Taking It to the Next Level , 2007, J. Artif. Soc. Soc. Simul..

[55]  Vipin Kumar,et al.  Parallel Multilevel series k-Way Partitioning Scheme for Irregular Graphs , 1999, SIAM Rev..

[56]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[57]  Yu-Kwong Kwok,et al.  On Load Balancing for Distributed Multiagent Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[58]  Shangkun Deng,et al.  Combining Technical Analysis with Sentiment Analysis for Stock Price Prediction , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[59]  Yingqian Zhang,et al.  Multiagent task allocation in social networks , 2011, Autonomous Agents and Multi-Agent Systems.

[60]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[61]  Jacques Ferber,et al.  A meta-model for the analysis and design of organizations in multi-agent systems , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[62]  Lie Wang,et al.  Towards a fast implementation of spectral nested dissection , 1992, Proceedings Supercomputing '92.

[63]  Vipin Kumar,et al.  Analysis of Multilevel Graph Partitioning , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[64]  Gary L. Miller,et al.  Automatic Mesh Partitioning , 1992 .

[65]  Shahid H. Bokhari,et al.  Dual Processor Scheduling with Dynamic Reassignment , 1979, IEEE Transactions on Software Engineering.

[66]  Moshe Tennenholtz,et al.  Adaptive Load Balancing: A Study in Multi-Agent Learning , 1994, J. Artif. Intell. Res..