A novel directional and non-local-convergent particle swarm optimization based workflow scheduling in cloud-edge environment

Abstract With the increasing popularity of Internet of Things (IoT), edge computing has become the key driving force to provide computing resources, storage and network services closer to the edge on the basis of cloud computing. Workflow scheduling in such distributed environment is regarded as an NP-hard problem, and the existing approaches may not work well for task scheduling with multiple optimization goals in complex applications. As an intelligent algorithm, particle swarm optimization (PSO) has the advantages of fewer parameters, simpler algorithm and faster convergence speed, which is widely applied to workflow scheduling. However, there are also some shortcomings such as easy to fall into local optimum and sometimes difficult to obtain real optimal solution. To address this issue, first, the scheduling problem of workflow applications and objective function based on two optimized factors are clearly formalized, which can provide a theoretical foundation for workflow scheduling strategy. Then this paper proposes a novel directional and non-local-convergent particle swarm optimization (DNCPSO) that employs non-linear inertia weight with selection and mutation operations by directional search process, which can reduce the makespan and cost dramatically and obtain a compromising result. The results of simulation experiments based on various real and random workflow examples show that our DNCPSO can achieve better performance than other classical and improved algorithms, which sufficiently demonstrate the effectiveness and efficiency of DNCPSO.

[1]  Doan B. Hoang,et al.  FBRC: Optimization of task Scheduling in Fog-Based Region and Cloud , 2017, 2017 IEEE Trustcom/BigDataSE/ICESS.

[2]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[3]  Kai Ma,et al.  Appliances scheduling via cooperative multi-swarm PSO under day-ahead prices and photovoltaic generation , 2018, Appl. Soft Comput..

[4]  Rizos Sakellariou,et al.  DAG Scheduling Using a Lookahead Variant of the Heterogeneous Earliest Finish Time Algorithm , 2010, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing.

[5]  Yun Yang,et al.  Near‐optimal dynamic priority scheduling strategy for instance‐intensive business workflows in cloud computing , 2017, Concurr. Comput. Pract. Exp..

[6]  Ewa Deelman,et al.  The cost of doing science on the cloud: the Montage example , 2008, HiPC 2008.

[7]  Xiao Liu,et al.  A market-oriented hierarchical scheduling strategy in cloud workflow systems , 2011, The Journal of Supercomputing.

[8]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[9]  Florin Pop,et al.  Microservices Scheduling Model Over Heterogeneous Cloud-Edge Environments As Support for IoT Applications , 2018, IEEE Internet of Things Journal.

[10]  Junwei Cao,et al.  A Case Study on the Use of Workflow Technologies for Scientific Analysis: Gravitational Wave Data Analysis , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[11]  Ahmad Bagheri,et al.  HEPSO: High exploration particle swarm optimization , 2014, Inf. Sci..

[12]  LiGuo Huang,et al.  A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds , 2016, Future Gener. Comput. Syst..

[13]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[14]  Valentin Cristea,et al.  Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing , 2015, Future Gener. Comput. Syst..

[15]  Shafii Muhammad Abdulhamid,et al.  Fault tolerance aware scheduling technique for cloud computing environment using dynamic clustering algorithm , 2016, Neural Computing and Applications.

[16]  Esa Hyytiä,et al.  On Round-Robin routing with FCFS and LCFS scheduling , 2016, Perform. Evaluation.

[17]  Sakshi Kaushal,et al.  A hybrid multi-objective Particle Swarm Optimization for scientific workflow scheduling , 2017, Parallel Comput..

[18]  Ewa Deelman,et al.  WorkflowSim: A toolkit for simulating scientific workflows in distributed environments , 2012, 2012 IEEE 8th International Conference on E-Science.

[19]  Ahmad M. Manasrah,et al.  Workflow Scheduling Using Hybrid GA-PSO Algorithm in Cloud Computing , 2018, Wirel. Commun. Mob. Comput..

[20]  Fangfang Li,et al.  A new beetle antennae search algorithm for multi-objective energy management in microgrid , 2018, 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[21]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[22]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[23]  Giuseppe Anastasi,et al.  Fog Computing for the Internet of Mobile Things: Issues and Challenges , 2017, 2017 IEEE International Conference on Smart Computing (SMARTCOMP).

[24]  Radu Prodan,et al.  Low-time complexity budget-deadline constrained workflow scheduling on heterogeneous resources , 2016, Future Gener. Comput. Syst..

[25]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[26]  Mohammad Masdari,et al.  Towards workflow scheduling in cloud computing: A comprehensive analysis , 2016, J. Netw. Comput. Appl..

[27]  Sin-Chun Ng,et al.  Improved efficiency of MOPSO with adaptive inertia weight and dynamic search space , 2018, GECCO.

[28]  Xiao Liu,et al.  A sufficient and necessary temporal violation handling point selection strategy in cloud workflow , 2018, Future Gener. Comput. Syst..

[29]  Siba Sankar Mahapatra,et al.  A quantum behaved particle swarm optimization for flexible job shop scheduling , 2016, Comput. Ind. Eng..

[30]  Eui-nam Huh,et al.  Towards task scheduling in a cloud-fog computing system , 2016, 2016 18th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[31]  Ying Xie,et al.  Improved Particle Swarm Optimization Based Workflow Scheduling in Cloud-Fog Environment , 2018, Business Process Management Workshops.

[32]  Raj Kumari,et al.  A Review on Comparison of Workflow Scheduling Algorithms with Scientific Workflows , 2017 .

[33]  Matthias Troyer,et al.  Optimised simulated annealing for Ising spin glasses , 2014, Comput. Phys. Commun..

[34]  Arwa Alrawais,et al.  Fog Computing for the Internet of Things: Security and Privacy Issues , 2017, IEEE Internet Computing.

[35]  Jianmin Wang,et al.  Mining process models with prime invisible tasks , 2010, Data Knowl. Eng..

[36]  Miron Livny,et al.  Pegasus, a workflow management system for science automation , 2015, Future Gener. Comput. Syst..

[37]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[38]  Dario Pompili,et al.  Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges , 2016, IEEE Communications Magazine.

[39]  Robert W. Graves,et al.  The SCEC Southern California Reference Three-Dimensional Seismic Velocity Model Version 2 , 2000 .

[40]  Rubén Ruiz,et al.  Cloud Workflow Scheduling with Deadlines and Time Slot Availability , 2018, IEEE Transactions on Services Computing.

[41]  Sateesh Addepalli,et al.  Fog computing and its role in the internet of things , 2012, MCC '12.