Dynamic partner identification in mobile agent-based distributed job workflow execution

This paper is concerned with the design, implementation, and evaluation of algorithms for communication partner identification in mobile agent-based distributed job workflow execution. We first describe a framework for distributed job workflow execution over the Grid: the Mobile Code Collaboration Framework (MCCF). Based on the study of agent communications during a job workflow execution on MCCF, we identify the unnecessary agent communications that degrade the system performance. Then, we design a novel subjob grouping algorithm for preprocessing the job workflow's static specification in MCCF. The obtained information is used in both static and dynamic algorithms to identify partners for agent communication. The mobile agent dynamic location and communication based on this approach is expected to reduce the agent communication overhead by removing unnecessary communication partners during the dynamic job workflow execution. The proof of the dynamic algorithm's correctness and effectiveness are elaborated. Finally, the algorithms are evaluated through a comparison study using simulated job workflows executed on a prototype implementation of the MCCF on a LAN environment and an emulated WAN setup. The results show the scalability and efficiency of the algorithms as well as the advantages of the dynamic algorithm over the static one.

[1]  Frances M. T. Brazier,et al.  Agent factory: generative migration of mobile agents in heterogeneous environments , 2002, SAC '02.

[2]  Onn Shehory A Scalable Agent Location Mechanism , 1999, ATAL.

[3]  Jiannong Cao,et al.  Path Pruning in Mailbox-based Mobile Agent Communications , 2004, J. Inf. Sci. Eng..

[4]  Simon J. Cox Proceedings of the UK e-science All Hands Meeting , 2007 .

[5]  James Annis et al. Applying chimera virtual data concepts to cluster finding in the Sloan Sky Survey , 2002 .

[6]  Miron Livny,et al.  A fully automated fault-tolerant system for distributed video processing and off-site replication , 2004, NOSSDAV '04.

[7]  Wentong Cai,et al.  MCCF: A Distributed Grid Job Workflow Execution Framework , 2004, ISPA.

[8]  Franz J. Hauck,et al.  Locating objects in wide-area systems , 1998, IEEE Commun. Mag..

[9]  Niraj K. Jha,et al.  Safety and Reliability Driven Task Allocation in Distributed Systems , 1999, IEEE Trans. Parallel Distributed Syst..

[10]  Cho-Li Wang,et al.  A Component-based Software Architecture for Pervasive Computing , 2004 .

[11]  Helmut Reiser,et al.  Dynamic Adaptation of Mobile Agents in Heterogenous Environments , 2001, Mobile Agents.

[12]  Sumi Helal,et al.  An Ad-Hoc Workflow System Architecture Based on Mobile Agents and Rule-Based Processing , 2000 .

[13]  environmet.,et al.  JXTA : A Network Programming Environment , 2022 .

[14]  Nathalie Furmento,et al.  ICENI Dataflow and Workflow: Composition and Scheduling in Space and Time , 2003 .

[16]  Wentong Cai,et al.  A Simulation Study of Job Workflow Execution Models over the Grid , 2003, GCC.

[17]  Alfons Kemper,et al.  Flexible and Reliable Web Service Execution , 2002 .

[18]  Arkady B. Zaslavsky,et al.  Towards Distributed Workflow Enactment with Itineraries and Mobile Agent Management , 2001, E-Commerce Agents.

[19]  Giovanni Vigna,et al.  Understanding Code Mobility , 1998, IEEE Trans. Software Eng..

[20]  Qiming Chen,et al.  Inter-enterprise collaborative business process management , 2001, Proceedings 17th International Conference on Data Engineering.

[21]  Sugih Jamin,et al.  Inet-3.0: Internet Topology Generator , 2002 .

[22]  Leonardo Mariani,et al.  An Agent-Based Layered Middleware as Tool Integration , 2003, FSE 2003.

[23]  Donald D. Eisenstein,et al.  The maxBCG technique for finding galaxy clusters in SDSS data , 1999 .

[24]  Winfried Lamersdorf,et al.  Using Mobile Agents to Support Interorganizational Workflow Management , 1997, Appl. Artif. Intell..

[25]  Wayne H. Wolf,et al.  TGFF: task graphs for free , 1998, Proceedings of the Sixth International Workshop on Hardware/Software Codesign. (CODES/CASHE'98).

[26]  Chung-Ta King,et al.  Taking advantage of the overlay geometrical structures for mobile agent communications , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..