The Research of Execute Unit's State Mechanism in Scientific Workflow System

Scientific workflow system (SWFs) is a tool which is used in scientific research. SWFs is a useful tool that brings remote data access and management under distributed infrastructures to the desktop. Because the Scientific workflow is highly data-centric naturally, it makes the scientific data management, analysis, simulation on distributed infrastructures challenging. When scientist use a SWFs to computation or to analysis large data sets, it is important that the SWFs can monitor the execution state on the distributed infrastructures. We first develop a prototype of light-weight SWFs, and implement a scientific workflow engine (SWFe) which implements the basic function of the SWFs. We design the monitor state mechanism as part of the SWFe. Through the state mechanism, scientist can easily know if the remote resources or data can be used. They can also validate the computation result by means of the state mechanism.

[1]  Pan Pan,et al.  Dynamic Workflow Management and Monitoring Using DDS , 2010, 2010 Seventh IEEE International Conference and Workshops on Engineering of Autonomic and Autonomous Systems.

[2]  Roger S. Barga,et al.  Capturing Workflow Event Data for Monitoring, Performance Analysis, and Management of Scientific Workflows , 2008, 2008 IEEE Fourth International Conference on eScience.

[3]  B. Balis,et al.  Monitoring infrastructure for Grid scientific workflows , 2008, 2008 Third Workshop on Workflows in Support of Large-Scale Science.

[4]  Bertram Ludäscher,et al.  Scientific Workflows: More e-Science Mileage from Cyberinfrastructure , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[5]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[6]  Hui Deng,et al.  The Key Techniques of Scientific Workflow System , 2010, 2010 International Forum on Information Technology and Applications.

[7]  Bartosz Balis,et al.  From Monitoring Data to Experiment Information – Monitoring of Grid Scientific Workflows , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).