Scientific Workflow Composition in Heterogeneous Environments

Scientific workflows have become visible as a new method for scientists to develop and design complex and distributed scientific processes to enable and accelerate many scientific discoveries. Workflows are widely used in business for a long time. However, scientific workflows are emerging as an important technology for solving complex scientific problems and thereby contributing to scientific development. The advantages of high-performance grid-based computing for scientific workflows, and the problems noted with existing scientific workflow management software, provide the rationale for the development of new workflow processes for efficient use of heterogeneous scientific workflows system and utilizing grid computing. The main contributions of this paper are: 1) to propose a scientific workflow system to design, develop, and execute scientific workflows from heterogeneous scientific workflows; 2) to propose a scheduling technique for parallel executing of heterogeneous scientific workflows; and 3) to present a GENOEMFLOW based scientific workflow application to showcase the application of our system.

[1]  Cees T. A. M. de Laat,et al.  VLE-WFBus: A Scientific Workflow Bus for Multi e-Science Domains , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[2]  J. Darlington,et al.  Workflow Expression : Comparison of Spatial and Temporal Approaches , 2022 .

[3]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[4]  David Romero,et al.  Gene conversion and concerted evolution in bacterial genomes. , 2005, FEMS microbiology reviews.

[5]  Shiyong Lu,et al.  VIEW: a VIsual sciEntificWorkflow management system , 2007, 2007 IEEE Congress on Services (Services 2007).

[6]  Shiyong Lu,et al.  RECOMBFLOW: a scientific workflow environment for Intragenomic Gene Conversion analysis in bacterial genomes, including the pathogen Streptococcus pyogenes , 2009, Int. J. Bioinform. Res. Appl..

[7]  Ian T. Foster,et al.  Building Scientific Workflow with Taverna and BPEL: A Comparative Study in caGrid , 2009, ICSOC Workshops.

[8]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[9]  Stephen A. Jarvis,et al.  Performance-Aware Workflow Management for Grid Computing , 2005, Comput. J..

[10]  Carole A. Goble,et al.  Scientific Workflows as Services in caGrid: A Taverna and gRAVI Approach , 2009, 2009 IEEE International Conference on Web Services.

[11]  Shiyong Lu,et al.  Storing and Querying Scientific Workflow Provenance Metadata Using an RDBMS , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).

[12]  Ann L. Chervenak,et al.  Data Management Challenges of Data-Intensive Scientific Workflows , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[13]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[14]  Ian J. Taylor,et al.  Visual Grid Workflow in Triana , 2005, Journal of Grid Computing.

[15]  Juliana Freire,et al.  Provenance and scientific workflows: challenges and opportunities , 2008, SIGMOD Conference.

[16]  Shiyong Lu,et al.  Simulation of genomic recombination and the influence of DNA sequence diversity on cluster formation and detectability of recombination: a scientific workflow method , 2009, Int. J. Comput. Biol. Drug Des..

[17]  Gregor von Laszewski,et al.  Swift: Fast, Reliable, Loosely Coupled Parallel Computation , 2007, 2007 IEEE Congress on Services (Services 2007).

[18]  Matthew R. Pocock,et al.  Taverna: a tool for the composition and enactment of bioinformatics workflows , 2004, Bioinform..

[19]  Ian T. Foster,et al.  Accelerating Medical Research using the Swift Workflow System , 2007, HealthGrid.

[20]  Shiyong Lu,et al.  A MapReduce-Enabled Scientific Workflow Composition Framework , 2009, 2009 IEEE International Conference on Web Services.

[21]  Bertram Ludäscher,et al.  Actor-Oriented Design of Scientific Workflows , 2005, ER.

[22]  Jing Hua,et al.  A Reference Architecture for Scientific Workflow Management Systems and the VIEW SOA Solution , 2009, IEEE Transactions on Services Computing.

[23]  Bertram Ludäscher,et al.  Scientific workflow management and the Kepler system: Research Articles , 2006 .

[24]  Jing Hua,et al.  A Task Abstraction and Mapping Approach to the Shimming Problem in Scientific Workflows , 2009, 2009 IEEE International Conference on Services Computing.

[25]  D. Hollingsworth.  The workflow Reference Model , 1994 .