A Survey on Workflow Management and Scheduling in Cloud Computing

Workflow application can be executed in cloud computing environments in utility-based fashion. In our paper, we first give a survey of cloud workflow application and present the cloud-based workflow architecture for Smart City. Then a variety of workflow scheduling algorithms are reviewed. The purpose of this paper is to making taxonomy for workflow management and scheduling in cloud environment, and also applying this cloud-based workflow architecture to Smart City environments, further presenting several research challenges in this area.

[1]  Luiz Fernando Bittencourt,et al.  HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds , 2011, Journal of Internet Services and Applications.

[2]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[3]  Rajkumar Buyya,et al.  A novel architecture for realizing grid workflow using tuple spaces , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[4]  Won Ryu,et al.  Multi-objective Optimization Model for Partner Selection in a Market-Oriented Dynamic Collaborative Cloud Service Platform , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[5]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[6]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[7]  Poulami Dalapati.  A Survey on Cloud Computing , 2013 .

[8]  Frederick Reiss,et al.  Towards a Scalable Enterprise Content Analytics Platform , 2009, IEEE Data Eng. Bull..

[9]  Suraj Pandey,et al.  Scheduling and management of data intensive application workflows in grid and cloud computing environments , 2010 .

[10]  Ewa Deelman,et al.  Scientific workflows and clouds , 2010, ACM Crossroads.

[11]  G. Vassilacopoulos,et al.  Ubiquitous access to cloud emergency medical services , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[12]  Shailesh Sawant,et al.  A Genetic Algorithm Scheduling Approach for Virtual Machine Resources in a Cloud Computing Environment , 2011 .

[13]  Jens Dittrich,et al.  iMeMex: From Search to Information Integration and Back , 2009, IEEE Data Eng. Bull..

[14]  G. Nolan,et al.  Computational solutions to large-scale data management and analysis , 2010, Nature Reviews Genetics.

[15]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[16]  Richard McClatchey,et al.  An architecture for integrated intelligence in urban management using cloud computing , 2011, Journal of Cloud Computing: Advances, Systems and Applications.

[17]  Ju Wang,et al.  Windows Azure Storage: a highly available cloud storage service with strong consistency , 2011, SOSP.

[18]  Inderveer Chana,et al.  A Survey of Various Workflow Scheduling Algorithms in Cloud Environment , 2011 .

[19]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[20]  Xiao Liu,et al.  A market-oriented hierarchical scheduling strategy in cloud workflow systems , 2011, The Journal of Supercomputing.

[21]  Amit P. Sheth,et al.  WebWork: METEOR2's Web-Based Workflow Management System , 1998, Journal of Intelligent Information Systems.

[22]  Zaheer Abbas Khan,et al.  A Cloud-Based Architecture for Citizen Services in Smart Cities , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[23]  Rajkumar Buyya,et al.  Optimizing the makespan and reliability for workflow applications with reputation and a look-ahead genetic algorithm , 2011, Future Gener. Comput. Syst..

[24]  N. Venkateswara Rao,et al.  A Survey Of Cloud Computing: Cloud Computing Concerns And Issues , 2013 .

[25]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[26]  Zhiqiang Wei,et al.  Research and design of Cloud architecture for smart home , 2010, 2010 IEEE International Conference on Software Engineering and Service Sciences.

[27]  D. Hollingsworth.  The workflow Reference Model , 1994 .

[28]  Ke Liu,et al.  Scheduling algorithms for instance-intensive cloud workflows , 2009 .

[29]  G. Bruce Berriman,et al.  Scientific workflow applications on Amazon EC2 , 2010, 2009 5th IEEE International Conference on E-Science Workshops.

[30]  Matei Ripeanu,et al.  Amazon S3 for science grids: a viable solution? , 2008, DADC '08.

[31]  Mehmet Bayram Yildirim,et al.  An ant colony optimization algorithm for load balancing in parallel machines with sequence-dependent setup times , 2012, Comput. Oper. Res..

[32]  Sarbjeet Singh,et al.  Deadline and cost based workflow scheduling in hybrid cloud , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[33]  Youfu Li,et al.  Scientific-Workflow-Management-as-a-Service in the Cloud , 2012, 2012 Second International Conference on Cloud and Green Computing.

[34]  Wilson C. Hsieh,et al.  Bigtable: A Distributed Storage System for Structured Data , 2006, TOCS.

[35]  Andrew Y. C. Nee,et al.  An improved Intelligent Water Drops algorithm for achieving optimal job-shop scheduling solutions , 2012 .

[36]  Rajkumar Buyya,et al.  Aneka: a Software Platform for .NET based Cloud Computing , 2009, High Performance Computing Workshop.

[37]  A. Sheth,et al.  WebWork � METEOR � s Web Based Work ow Management System , 2005 .

[38]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[39]  Dimitrios Zissis,et al.  Securing e-Government and e-Voting with an open cloud computing architecture , 2011, Gov. Inf. Q..

[40]  GhemawatSanjay,et al.  The Google file system , 2003 .

[41]  Rajkumar Buyya,et al.  Adaptive workflow scheduling for dynamic grid and cloud computing environment , 2013, Concurr. Comput. Pract. Exp..

[42]  Yong Zhao,et al.  Opportunities and Challenges in Running Scientific Workflows on the Cloud , 2011, 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[43]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[44]  Cheng Xu,et al.  A Semantic E-Tourism Framework Based on Cloud-Computing , 2012 .

[45]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[46]  Xiao Liu,et al.  A Revised Discrete Particle Swarm Optimization for Cloud Workflow Scheduling , 2010, 2010 International Conference on Computational Intelligence and Security.

[47]  Mehdi Bahrami,et al.  Cloud Template, a Big Data Solution , 2013, ArXiv.

[48]  Dongning Jia,et al.  A Cloud Architecture Based on Smart Home , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[49]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[50]  Sudhir Shenai,et al.  Survey on Scheduling Issues in Cloud Computing , 2012 .

[51]  J. Li,et al.  Smart city and the applications , 2011, 2011 International Conference on Electronics, Communications and Control (ICECC).

[52]  Selim G. Akl,et al.  PFAS: A Resource-Performance-Fluctuation-Aware Workflow Scheduling Algorithm for Grid Computing , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[53]  Xiaojing Ye,et al.  A framework for Cloud-based Smart Home , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[54]  Luca Maria Gambardella,et al.  A survey on metaheuristics for stochastic combinatorial optimization , 2009, Natural Computing.

[55]  Sarbjeet Singh,et al.  A Survey of Workflow Scheduling Algorithms and Research Issues , 2013 .

[56]  Tamara Kulesa.  A Vision of Smarter Cities : How Cities Can Lead the Way into a Prosperous and Sustainable Future Moderator : , 2009 .

[57]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[58]  G. Bruce Berriman,et al.  On the Use of Cloud Computing for Scientific Workflows , 2008, 2008 IEEE Fourth International Conference on eScience.

[59]  Radu Prodan,et al.  A Multi-objective Approach for Workflow Scheduling in Heterogeneous Environments , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[60]  Ewa Deelman,et al.  Experiences using cloud computing for a scientific workflow application , 2011, ScienceCloud '11.

[61]  Rajkumar Buyya,et al.  Workflow Engine for Clouds , 2011, CloudCom 2011.