QoS-Based Service Selection Method for Big Data Service Composition

Different from the traditional web services, the big data services' execution duration vary from the input data volume, so the traditional Quality of Service (QoS) analysis model for traditional web services cannot be directly applied to big data services. Additionally, since many big data or web services provide overlapping or identical functionality, albeit with the description of different QoS, some methods should be taken to determine which service are to participate in a given composite service. To address the problems above, this paper proposes an expanded edition of QoS-based analysis model: (1) Use the linear regression model to estimate the execution duration of the big data services to support the QoS model. (2)Set the weight of QoS using AHP analysis. (3) Improve the service selection algorithm based on backtracking method and validate its effectiveness, which is proved more high-performance than the original backtracking method and Integer Programming method.

[1]  Jong Myoung Ko,et al.  Quality-of-service oriented web service composition algorithm and planning architecture , 2008, J. Syst. Softw..

[2]  Lei Wang,et al.  Two-stage approach for reliable dynamic Web service composition , 2016, Knowl. Based Syst..

[3]  Antonio Corradi,et al.  VM consolidation: A real case based on OpenStack Cloud , 2014, Future Gener. Comput. Syst..

[4]  Apostolos Papageorgiou,et al.  Decision support for Web service adaptation , 2014, Pervasive Mob. Comput..

[5]  Carlo Curino,et al.  Apache Hadoop YARN: yet another resource negotiator , 2013, SoCC.

[6]  Sergio Segura,et al.  Evolutionary composition of QoS-aware web services: A many-objective perspective , 2017, Expert Syst. Appl..

[7]  Al Harbi,et al.  APPLICATION OF THE AHP IN PROJECT MANAGEMENT , 2001 .

[8]  Eyhab Al-Masri,et al.  Investigating web services on the world wide web , 2008, WWW.

[9]  Ralf Steinmetz,et al.  Heuristics for QoS-aware Web Service Composition , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[10]  Filip De Turck,et al.  SALSA: QoS-aware load balancing for autonomous service brokering , 2010, J. Syst. Softw..

[11]  Kun Liu,et al.  Researching the Model of Semantic Web Service Composition Based on Qos , 2014 .

[12]  Khalil Drira,et al.  Automated and flexible composition based on abstract services for a better adaptation to user intentions , 2017, Future Gener. Comput. Syst..

[13]  Jinjun Chen,et al.  QoS-Aware Service Selection Using QDG for B2B Collaboration , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[14]  Jong Hyuk Park,et al.  A secure smart-work service model based OpenStack for Cloud computing , 2013, Cluster Computing.

[15]  Jinjun Chen,et al.  HireSome-II: Towards Privacy-Aware Cross-Cloud Service Composition for Big Data Applications , 2015, IEEE Transactions on Parallel and Distributed Systems.

[16]  Hongbing Wang,et al.  Combining quantitative constraints with qualitative preferences for effective non-functional properties-aware service composition , 2017, J. Parallel Distributed Comput..

[17]  Wei Jiang,et al.  Top K Query for QoS-Aware Automatic Service Composition , 2014, IEEE Transactions on Services Computing.

[18]  Kamal M. Al‐Subhi Al‐Harbi,et al.  Application of the AHP in project management , 2001 .

[19]  Hongbing Wang,et al.  A multi-agent reinforcement learning approach to dynamic service composition , 2016 .

[20]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.