Scheduling Parallel Intrusion Detecting Applications on Hybrid Clouds

Recently, Parallel Intrusion Detection (PID) becomes very popular and its procedure of the parallel processing is called a PID application (PIDA). This PIDA can be regarded as a Bag-of-Tasks (BoT) application, consisting of multiple tasks that can be processed in parallel. Given multiple PIDAs (i.e., BoT applications) to be handled, when the private cloud has insufficiently available resources to afford all tasks, some tasks have to be outsourced to public clouds with resource-used costs. The key challenge here is how to schedule tasks on hybrid clouds to minimize makespan given a limited budget. This problem can be formulated as an Integer Programming model, which is generally NP-Hard. Accordingly, in this paper, we construct an Iterated Local Search (ILS) algorithm, which employs an effective heuristic to obtain the initial task sequence and utilizes an insertion-neighbourhood-based local search method to explore better task sequences with lower makespans. A swap-based perturbation operator is adopted to avoid local optimum. With the objective of improving the proposal’s efficiency without loss of any effectiveness, to calculate task sequences’ objectives, we construct a Fast Task Assignment (FTA) method by integrating an existing Task Assignment (TA) method with an acceleration mechanism designed through theoretical analysis. Accordingly, the proposed ILS is named FILS. Experimental results show that FILS outperforms the existing best algorithm for the considered problem, considerably and significantly. More importantly, compared with TA, FTA achieves a 2.42x speedup, which verifies that the acceleration mechanism employed by FTA is able to remarkably improve the efficiency. Finally, impacts of key factors are also evaluated and analyzed, exhaustively.

[1]  Jin Sun,et al.  Novel efficient particle swarm optimization algorithms for solving QoS‐demanded bag‐of‐tasks scheduling problems with profit maximization on hybrid clouds , 2017, Concurr. Comput. Pract. Exp..

[2]  Joaquín Entrialgo,et al.  Autonomic scheduling of deadline-constrained bag of tasks in hybrid clouds , 2016, 2016 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS).

[3]  Francisco Vilar Brasileiro,et al.  Analyzing the impact of elasticity on the profit of cloud computing providers , 2013, Future Gener. Comput. Syst..

[4]  Jarek Nabrzyski,et al.  Cost minimization for computational applications on hybrid cloud infrastructures , 2013, Future Gener. Comput. Syst..

[5]  Valentin Cristea,et al.  HySARC2: Hybrid Scheduling Algorithm Based on Resource Clustering in Cloud Environments , 2013, ICA3PP.

[6]  Wei Tan,et al.  Self-Adaptive Learning PSO-Based Deadline Constrained Task Scheduling for Hybrid IaaS Cloud , 2014, IEEE Transactions on Automation Science and Engineering.

[7]  Cheng Hu,et al.  CloudFreq: Elastic Energy-Efficient Bag-of-Tasks Scheduling in DVFS-Enabled Clouds , 2015, 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS).

[8]  Blesson Varghese,et al.  Executing Bag of Distributed Tasks on the Cloud: Investigating the Trade-Offs between Performance and Cost , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[9]  Albert Y. Zomaya,et al.  Non-clairvoyant Assignment of Bag-of-Tasks Applications Across Multiple Clouds , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[10]  Helen D. Karatza,et al.  Multi-criteria scheduling of Bag-of-Tasks applications on heterogeneous interlinked clouds with simulated annealing , 2015, J. Syst. Softw..

[11]  Blesson Varghese,et al.  Budget Constrained Execution of Multiple Bag-of-Tasks Applications on the Cloud , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[12]  Helen D. Karatza,et al.  Bag-of-Task Scheduling on Power-Aware Clusters Using a DVFS-Based Mechanism , 2014, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops.

[13]  Kwang Mong Sim,et al.  A family of heuristics for agent-based elastic Cloud bag-of-tasks concurrent scheduling , 2013, Future Gener. Comput. Syst..

[14]  Qi Shi,et al.  A Deep Learning Approach to Network Intrusion Detection , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[15]  Mahmood Ahmadi,et al.  Cost minimization for deadline-constrained bag-of-tasks applications in federated hybrid clouds , 2017, Future Gener. Comput. Syst..

[16]  Zenbin Wu,et al.  An Heuristic for Bag-of-Tasks Scheduling Problems with Resource Demands and Budget Constraints to Minimize Makespan on Hybrid Clouds , 2017, 2017 Fifth International Conference on Advanced Cloud and Big Data (CBD).

[17]  Blesson Varghese,et al.  A survey and taxonomy of resource optimisation for executing bag-of-task applications on public clouds , 2017, Future Gener. Comput. Syst..

[18]  Jan Broeckhove,et al.  Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds , 2013, Future Gener. Comput. Syst..

[19]  Thilo Kielmann,et al.  Bag-of-Tasks Scheduling under Budget Constraints , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[20]  Vijay Varadharajan,et al.  Intrusion detection techniques in cloud environment: A survey , 2017, J. Netw. Comput. Appl..

[21]  Thilo Kielmann,et al.  Stochastic Tail-Phase Optimization for Bag-of-Tasks Execution in Clouds , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[22]  Jan Broeckhove,et al.  Cost-Efficient Scheduling Heuristics for Deadline Constrained Workloads on Hybrid Clouds , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[23]  Peter Brucker,et al.  Scheduling Algorithms , 1995 .

[24]  Jie Li,et al.  Cloud auto-scaling with deadline and budget constraints , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[25]  Muttukrishnan Rajarajan,et al.  A survey of intrusion detection techniques in Cloud , 2013, J. Netw. Comput. Appl..

[26]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[27]  Helen D. Karatza,et al.  A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs , 2015, Simul. Model. Pract. Theory.

[28]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[29]  Rajkumar Buyya,et al.  Energy-Efficient Scheduling of Urgent Bag-of-Tasks Applications in Clouds through DVFS , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[30]  Neil Genzlinger.  A. and Q , 2006 .

[31]  W. Marsden.  I and J , 2012 .

[32]  Jan Broeckhove,et al.  Cost-Optimal Scheduling in Hybrid IaaS Clouds for Deadline Constrained Workloads , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.