Neural network workflow scheduling for large scale Utility Management Systems

Grid computing is the future computing paradigm for enterprise applications. It can be used for executing large scale workflow applications. This paper focuses on the workflow scheduling mechanism. Although there is much work on static scheduling approaches for workflow applications in parallel environments, little work has been done on a Grid environment for industrial systems. Utility Management Systems (UMS) are executing very large numbers of workflows with very high resource requirements. Unlike the grid approach for standard scientific workflows, UMS workflows have a different set of requirements and thereby optimization of resource usage has to be made in a different way. This paper proposes a novel scheduling architecture which dynamically executes a scheduling algorithm using near real-time feedback from the execution monitor. An Artificial Neural Network was used for workflow scheduling and performance tests show that significant improvement of overall execution time can be achieved by this soft-computing method.

[1]  Engin Ozdemir,et al.  Mobile phone based SCADA for industrial automation. , 2006, ISA transactions.

[2]  David Abramson,et al.  Deploying Scientific Applications to the PRAGMA Grid Testbed: Strategies and Lessons , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[3]  Francine Berman,et al.  New Grid Scheduling and Rescheduling Methods in the GrADS Project , 2004, IPDPS Next Generation Software Program - NSFNGS - PI Workshop.

[4]  Paul Roe,et al.  Bio-workflows with BizTalk: using a commercial workflow engine for eScience , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[5]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[6]  Timothy Masters,et al.  Practical neural network recipes in C , 1993 .

[7]  Zuyi Li,et al.  Adaptive short-term electricity price forecasting using artificial neural networks in the restructured power markets , 2004 .

[8]  Aleksandar Erdeljan,et al.  Software architecture for Smart Metering systems with Virtual Power Plant , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[9]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[10]  Hoay Beng Gooi,et al.  Web-based SCADA display systems (WSDS) for access via Internet , 2000 .

[11]  Yang Fengyu,et al.  Synchronization Schedule and Date Sharing of Activity Multi-Instance Based on Workflow , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[12]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[13]  Yang Zhang,et al.  Hybrid Re-scheduling Mechanisms for Workflow Applications on Multi-cluster Grid , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[14]  Aleksandar ERDELJAN,et al.  AN OPC DATA ACCESS SERVER DESIGNED FOR LARGE NUMBER OF ITEMS , 2005 .

[15]  John Shalf,et al.  GridLab: Enabling Applications on the Grid , 2002, GRID.

[16]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[17]  Daniel A. Menascé,et al.  A framework for resource allocation in grid computing , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[18]  R. K. Agrawal,et al.  SCADA FUNCTIONALITY FOR CONTROL OPERATIONS OF INDUS-2 , 2005 .