A Multi-Agent System Approach to Load-Balancing and Resource Allocation for Distributed Computing

In this research we use a decentralized computing approach to allocate and schedule tasks on a massively distributed grid. Using emergent properties of multi-agent systems, the algorithm dynamically creates and dissociates clusters to serve the changing resource demands of a global task queue. The algorithm is compared to a standard first-in first-out (FIFO) scheduling algorithm. Experiments done on a simulator show that the distributed resource allocation protocol (dRAP) algorithm outperforms the FIFO scheduling algorithm on time to empty queue, average waiting time, and CPU utilization. Such a decentralized computing approach holds promise for massively distributed processing scenarios like SETI@home and Google MapReduce.

[1]  James H. Gerlach,et al.  Determining the cost of IT services , 2002, CACM.

[2]  Soumya Banerjee,et al.  Artificial Immune Systems, 8th International Conference, ICARIS 2009, York, UK, August 9-12, 2009. Proceedings , 2009, ICARIS.

[3]  Stefan Krawczyk,et al.  Grid Resource Allocation : Allocation Mechanisms and Utilisation Patterns , 2008, AusGrid.

[4]  Annie S. Wu,et al.  Team-based resource allocation using a decentralized social decision-making paradigm , 2008, SPIE Defense + Commercial Sensing.

[5]  Melanie E. Moses,et al.  An evolutionary approach for robust adaptation of robot behavior to sensor error , 2013, GECCO '13 Companion.

[6]  Soumya Banerjee,et al.  Modular RADAR: An Immune System Inspired Search and Response Strategy for Distributed Systems , 2010, ICARIS.

[7]  Melanie E. Moses,et al.  Formica ex Machina: Ant Swarm Foraging from Physical to Virtual and Back Again , 2012, ANTS.

[8]  Sean Luke,et al.  MASON: A New Multi-Agent Simulation Toolkit , 2004 .

[9]  Soumya Banerjee,et al.  Scale invariance of immune system response rates and times: perspectives on immune system architecture and implications for artificial immune systems , 2010, Swarm Intelligence.

[10]  Christian Jacob,et al.  Immunity Through Swarms: Agent-Based Simulations of the Human Immune System , 2004, ICARIS.

[11]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[12]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[13]  Soumya Banerjee,et al.  An Immune System Inspired Approach to Automated Program Verification , 2009, ArXiv.

[14]  Melanie E. Moses,et al.  Evolving Error Tolerance in Biologically-Inspired iAnt Robots , 2013, ECAL.

[15]  Soumya Banerjee,et al.  Biologically inspired design principles for Scalable, Robust, Adaptive, Decentralized search and automated response (RADAR) , 2010, 2011 IEEE Symposium on Artificial Life (ALIFE).

[16]  Soumya Banerjee,et al.  Scaling in the immune system , 2013 .

[17]  Andy B. Yoo,et al.  Approved for Public Release; Further Dissemination Unlimited X-ray Pulse Compression Using Strained Crystals X-ray Pulse Compression Using Strained Crystals , 2002 .

[18]  Stephanie Forrest,et al.  The Value of Inflammatory Signals in Adaptive Immune Responses , 2011, ICARIS.

[19]  Melanie E. Moses,et al.  Beyond pheromones: evolving error-tolerant, flexible, and scalable ant-inspired robot swarms , 2015, Swarm Intelligence.

[20]  Master Gardener,et al.  Mathematical games: the fantastic combinations of john conway's new solitaire game "life , 1970 .

[21]  Matthew Cook,et al.  Universality in Elementary Cellular Automata , 2004, Complex Syst..