Service Composition Optimization Method Based on Parallel Particle Swarm Algorithm on Spark

Web service composition is one of the core technologies of realizing service-oriented computing. Web service composition satisfies the requirements of users to form new value-added services by composing existing services. As Cloud Computing develops, the emergence of Web services with different quality yet similar functionality has brought new challenges to service composition optimization problem. How to solve large-scale service composition in the Cloud Computing environment has become an urgent problem. To tackle this issue, this paper proposes a parallel optimization approach based on Spark distributed environment. Firstly, the parallel covering algorithm is used to cluster the Web services. Next, the multiple clustering centers obtained are used as the starting point of the particles to improve the diversity of the initial population. Then, according to the parallel data coding rules of resilient distributed dataset (RDD), the large-scale combination service is generated with the proposed algorithm named Spark Particle Swarm Optimization Algorithm (SPSO). Finally, the usage of particle elite selection strategy removes the inert particles to optimize the performance of the combination of service selection. This paper adopts real data set WS-Dream to prove the validity of the proposed method with a large number of experimental results.

[1]  Bo Zhang,et al.  A geometrical representation of McCulloch-Pitts neural model and its applications , 1999, IEEE Trans. Neural Networks.

[2]  Thomas Risse,et al.  Combining global optimization with local selection for efficient QoS-aware service composition , 2009, WWW '09.

[3]  Fateh Seghir,et al.  A hybrid approach using genetic and fruit fly optimization algorithms for QoS-aware cloud service composition , 2018, J. Intell. Manuf..

[4]  Christian Esposito,et al.  Smart Cloud Storage Service Selection Based on Fuzzy Logic, Theory of Evidence and Game Theory , 2016, IEEE Transactions on Computers.

[5]  M. Shamim Hossain,et al.  Big Data-Driven Service Composition Using Parallel Clustered Particle Swarm Optimization in Mobile Environment , 2016, IEEE Transactions on Services Computing.

[6]  Maude Manouvrier,et al.  TQoS: Transactional and QoS-Aware Selection Algorithm for Automatic Web Service Composition , 2010, IEEE Transactions on Services Computing.

[7]  Kai Hwang,et al.  Skyline Discovery and Composition of Multi-Cloud Mashup Services , 2016, IEEE Transactions on Services Computing.

[8]  Ying Chen,et al.  A Partial Selection Methodology for Efficient QoS-Aware Service Composition , 2015, IEEE Transactions on Services Computing.

[9]  Yiwen Zhang,et al.  MR-IDPSO: A Novel Algorithm for Large-Scale Dynamic Service Composition , 2015 .

[10]  Mihai Alexandru Suciu,et al.  QoS-based service optimization using differential evolution , 2011, GECCO '11.

[11]  Wolfgang Nejdl,et al.  A hybrid approach for efficient Web service composition with end-to-end QoS constraints , 2012, TWEB.

[12]  Shiyong Lu,et al.  A Service Framework for Scientific Workflow Management in the Cloud , 2015, IEEE Transactions on Services Computing.

[13]  Xin Zhao,et al.  Toward SLA-constrained service composition: An approach based on a fuzzy linguistic preference model and an evolutionary algorithm , 2015, Inf. Sci..

[14]  Jinjun Chen,et al.  Weighted principal component analysis-based service selection method for multimedia services in cloud , 2014, Computing.

[15]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[16]  Zibin Zheng,et al.  Investigating QoS of Real-World Web Services , 2014, IEEE Transactions on Services Computing.

[17]  Yu Xue,et al.  Discrete gbest-guided artificial bee colony algorithm for cloud service composition , 2014, Applied Intelligence.

[18]  Lei Wang,et al.  Two-stage approach for reliable dynamic Web service composition , 2016, Knowl. Based Syst..

[19]  Xifan Yao,et al.  Correlation-aware QoS modeling and manufacturing cloud service composition , 2017, J. Intell. Manuf..

[20]  Fei Tao,et al.  Resource Service Composition and Its Optimal-Selection Based on Particle Swarm Optimization in Manufacturing Grid System , 2008, IEEE Transactions on Industrial Informatics.

[21]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[22]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.