Online Deployment Algorithms for Microservice Systems With Complex Dependencies

Cloud and edge computing have been widely adopted in many application scenarios. With the increasing demand of fast iteration and complexity of business logic, it is challenging to achieve rapid development and continuous delivery in such highly distributed cloud and edge computing environment. At present, microservice-based architecture has been the dominant deployment style, and a microservice system has to evolve agilely to offer stable Quality of Service (QoS) in the situation where user requirement changes frequently. Many research have been conducted to optimally re-deploy microservices to adapt to changing requirements. Nevertheless, complex dependencies between microservices and the existence of multiple instances of one single microservice in a microservice system have not been fully considered in existing works. This paper defines SPPMS, the Service Placement Problem in Microservice Systems that feature complex dependencies and multiple instances, as a Fractional Polynomial Problem (FPP) . Considering the high computation complexity of FPP, it is then transformed into a Quadratic Sum-of-Ratios Fractional Problem (QSRFP) which is further solved by the proposed greedy-based algorithms. Experiments demonstrate that our models and algorithms outperform existing approaches in both quality and computation speed.

[1]  Jamal Bentahar,et al.  Demand-Driven Deep Reinforcement Learning for Scalable Fog and Service Placement , 2021, IEEE Transactions on Services Computing.

[2]  Bukhary Ikhwan Ismail,et al.  Evaluation of Docker as Edge computing platform , 2015, 2015 IEEE Conference on Open Systems (ICOS).

[3]  Jason P. Jue,et al.  All One Needs to Know about Fog Computing and Related Edge Computing Paradigms , 2019 .

[4]  Pooyan Jamshidi,et al.  Microservices Architecture Enables DevOps: Migration to a Cloud-Native Architecture , 2016, IEEE Software.

[5]  Shang-Pin Ma,et al.  Using Service Dependency Graph to Analyze and Test Microservices , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[6]  Davide Taibi,et al.  On the Definition of Microservice Bad Smells , 2018, IEEE Software.

[7]  Daniel Grosu,et al.  Placement of Multi-Component Applications in Edge Computing Systems , 2017 .

[8]  Kin K. Leung,et al.  Online Placement of Multi-Component Applications in Edge Computing Environments , 2016, IEEE Access.

[9]  Hiroshi Konno,et al.  Optimization of Polynomial Fractional Functions , 2004, J. Glob. Optim..

[10]  Yun Yang,et al.  Dynamic User Allocation in Stochastic Mobile Edge Computing Systems* , 2022, 2022 IEEE World Congress on Services (SERVICES).

[11]  Carlos Juiz,et al.  A lightweight decentralized service placement policy for performance optimization in fog computing , 2018, Journal of Ambient Intelligence and Humanized Computing.

[12]  Rajiv Ranjan,et al.  Osmotic Computing: A New Paradigm for Edge/Cloud Integration , 2016, IEEE Cloud Computing.

[13]  Ram Mohana Reddy Guddeti,et al.  Adopting elitism-based Genetic Algorithm for minimizing multi-objective problems of IoT service placement in fog computing environment , 2021, J. Netw. Comput. Appl..

[14]  Chun-Feng Wang,et al.  Global Minimization for Generalized Polynomial Fractional Program , 2014 .

[15]  Hossein Badri,et al.  Energy-Aware Application Placement in Mobile Edge Computing: A Stochastic Optimization Approach , 2020, IEEE Transactions on Parallel and Distributed Systems.

[16]  Zhi Zhou,et al.  Predictive Service Placement in Mobile Edge Computing , 2019, 2019 IEEE/CIC International Conference on Communications in China (ICCC).

[17]  Albert Y. Zomaya,et al.  Optimal Application Deployment in Resource Constrained Distributed Edges , 2021, IEEE Transactions on Mobile Computing.

[18]  Shang-Pin Ma,et al.  Version-Based Microservice Analysis, Monitoring, and Visualization , 2019, 2019 26th Asia-Pacific Software Engineering Conference (APSEC).

[19]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[20]  Yixue Hao,et al.  Deep Reinforcement Learning for Edge Service Placement in Softwarized Industrial Cyber-Physical System , 2021, IEEE Transactions on Industrial Informatics.

[21]  Hamid Harroud,et al.  Mobile cloud computing for computation offloading: Issues and challenges , 2018 .

[22]  Claus Pahl,et al.  Microservices: The Journey So Far and Challenges Ahead , 2018, IEEE Softw..

[23]  Fei Xu,et al.  Winning at the Starting Line: Joint Network Selection and Service Placement for Mobile Edge Computing , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[24]  Tayebeh Bahreini,et al.  Efficient Algorithms for Multi-Component Application Placement in Mobile Edge Computing , 2022, IEEE Transactions on Cloud Computing.

[25]  Xiaoyu Xia,et al.  Optimal Application Deployment in Mobile Edge Computing Environment , 2020, 2020 IEEE 13th International Conference on Cloud Computing (CLOUD).

[26]  Claudia Canali,et al.  A Fog Computing Service Placement for Smart Cities based on Genetic Algorithms , 2019, CLOSER.

[27]  Jörg Liebeherr,et al.  Autonomic Service Placement in Fog Computing , 2019, 2019 IEEE 20th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[28]  Wolfgang Kellerer,et al.  Mobility-Aware Joint Service Placement and Routing in Space-Air-Ground Integrated Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[29]  Luca Sanguinetti,et al.  Solving Fractional Polynomial Problems by Polynomial Optimization Theory , 2018, IEEE Signal Processing Letters.

[30]  Francesca Arcelli Fontana,et al.  Automatic Detection of Instability Architectural Smells , 2016, 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[31]  Xu Chen,et al.  Follow Me at the Edge: Mobility-Aware Dynamic Service Placement for Mobile Edge Computing , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[32]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[33]  Ibrar Yaqoob,et al.  Big IoT Data Analytics: Architecture, Opportunities, and Open Research Challenges , 2017, IEEE Access.

[34]  Schahram Dustdar,et al.  Towards QoS-Aware Fog Service Placement , 2017, 2017 IEEE 1st International Conference on Fog and Edge Computing (ICFEC).

[35]  Amir Rajabzadeh,et al.  BADEP: Bandwidth and delay efficient application placement in fog‐based IoT systems , 2020, Trans. Emerg. Telecommun. Technol..

[36]  Harrison John Bhatti,et al.  An Introduction to Docker and Analysis of its Performance , 2017 .