How to Share: Balancing Layer and Chain Sharing in Industrial Microservice Deployment

—With the rapid development of smart manufacturing, edge computing-oriented microservice platforms are emerging as an important part of production control. In the containerized deployment of microservices, layer sharing can reduce the huge bandwidth consumption caused by image pulling, and chain sharing can reduce communication overhead caused by communication between microservices. The two sharing methods use the characteristics of each microservice to share resources during deployment. However, due to the limited resources of edge servers, it is difficult to meet the optimization goals of the two methods at the same time. Therefore, it is of critical importance to realize the improvement of service response efficiency by balancing the two sharing methods. This paper studies the optimal microservice deployment strategy that can balance layer sharing and chain sharing of microservices. We build a problem that minimizes microservice image pull delay and communication overhead and transform the problem into a linearly constrained integer quadratic programming problem through model reconstruction. A deployment strategy is obtained through the successive convex approximation (SCA) method. Experimental results show that the proposed deployment strategy can balance the two resource sharing methods. When the two sharing methods are equally considered, the average image pull delay can be reduced to 65% of the baseline, and the average communication overhead can be reduced to 30% of the baseline.

[1]  Weijia Jia,et al.  Efficient Container Assignment and Layer Sequencing in Edge Computing , 2023, IEEE Transactions on Services Computing.

[2]  Praveen Kumar Donta,et al.  Cooperative Transmission Scheduling and Computation Offloading With Collaboration of Fog and Cloud for Industrial IoT Applications , 2023, IEEE Internet of Things Journal.

[3]  Jiehan Zhou,et al.  Online Reconfiguration of Latency-Aware IoT Services in Edge Networks , 2022, IEEE Internet of Things Journal.

[4]  Kwang-Cheng Chen,et al.  Hypergraphical Real-Time Multirobot Task Allocation in a Smart Factory , 2022, IEEE Transactions on Industrial Informatics.

[5]  Yuanguo Bi,et al.  Dynamic Service Migration and Request Routing for Microservice in Multicell Mobile-Edge Computing , 2022, IEEE Internet of Things Journal.

[6]  P. Hung,et al.  A Resource Recommendation Model for Heterogeneous Workloads in Fog-Based Smart Factory Environment , 2022, IEEE Transactions on Automation Science and Engineering.

[7]  Deze Zeng,et al.  Layer-aware Collaborative Microservice Deployment toward Maximal Edge Throughput , 2022, IEEE INFOCOM 2022 - IEEE Conference on Computer Communications.

[8]  Pengfei Yang,et al.  Microservice Deployment in Edge Computing Based on Deep Q Learning , 2022, IEEE Transactions on Parallel and Distributed Systems.

[9]  Domenico Siracusa,et al.  A Cost-Effective Workload Allocation Strategy for Cloud-Native Edge Services , 2021, ArXiv.

[10]  Shusen Yang,et al.  MPCSM: Microservice Placement for Edge-Cloud Collaborative Smart Manufacturing , 2021, IEEE Transactions on Industrial Informatics.

[11]  Xiaolong Xu,et al.  DIMA: Distributed cooperative microservice caching for internet of things in edge computing by deep reinforcement learning , 2021, World Wide Web.

[12]  Deze Zeng,et al.  Layer Aware Microservice Placement and Request Scheduling at the Edge , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[13]  Albert Y. Zomaya,et al.  Exploring Layered Container Structure for Cost Efficient Microservice Deployment , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[14]  Albert Y. Zomaya,et al.  Optimal Application Deployment in Resource Constrained Distributed Edges , 2021, IEEE Transactions on Mobile Computing.

[15]  Juan Manuel Murillo,et al.  Optimizing the Response Time in SDN-Fog Environments for Time-Strict IoT Applications , 2021, IEEE Internet of Things Journal.

[16]  Masahiro Sasabe,et al.  Capacitated Shortest Path Tour Problem-Based Integer Linear Programming for Service Chaining and Function Placement in NFV Networks , 2021, IEEE Transactions on Network and Service Management.

[17]  Chengfeng Jian,et al.  A cloud edge-based two-level hybrid scheduling learning model in cloud manufacturing , 2020, Int. J. Prod. Res..

[18]  Ning Zhang,et al.  Delay-Aware Microservice Coordination in Mobile Edge Computing: A Reinforcement Learning Approach , 2019, IEEE Transactions on Mobile Computing.

[19]  D. Garlan,et al.  Developing Self-Adaptive Microservice Systems: Challenges and Directions , 2019, IEEE Software.

[20]  Edoardo Fadda,et al.  Monitoring-Aware Optimal Deployment for Applications Based on Microservices , 2019, IEEE Transactions on Services Computing.

[21]  Silvio Cretti,et al.  Throughput-Aware Partitioning and Placement of Applications in Fog Computing , 2020, IEEE Transactions on Network and Service Management.

[22]  Zhiguo Shi,et al.  A Low-latency and Interoperable Industrial Internet of Things Architecture for Manufacturing Systems , 2020, 2020 IEEE 18th International Conference on Industrial Informatics (INDIN).

[23]  Christina Terese Joseph,et al.  IntMA: Dynamic Interaction-aware resource allocation for containerized microservices in cloud environments , 2020, J. Syst. Archit..

[24]  Xi Zheng,et al.  FengHuoLun: A Federated Learning based Edge Computing Platform for Cyber-Physical Systems , 2020, 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[25]  Lei Zhang,et al.  Fast and Efficient Container Startup at the Edge via Dependency Scheduling , 2020, HotEdge.

[26]  Xinyu Yang,et al.  Towards Cost-Efficient Edge Intelligent Computing With Elastic Deployment of Container-Based Microservices , 2020, IEEE Access.

[27]  Chengcheng Guo,et al.  Joint optimization of service request routing and instance placement in the microservice system , 2019, J. Netw. Comput. Appl..

[28]  Tingyu Lin,et al.  N-Docker: A NVM-HDD Hybrid Docker Storage Framework to Improve Docker Performance , 2019, NPC.

[29]  Klara Nahrstedt,et al.  MIRAS: Model-based Reinforcement Learning for Microservice Resource Allocation over Scientific Workflows , 2019, 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS).

[30]  Liang Bao,et al.  Performance Modeling and Workflow Scheduling of Microservice-Based Applications in Clouds , 2019, IEEE Transactions on Parallel and Distributed Systems.

[31]  Kleanthis Thramboulidis,et al.  Cyber-physical microservices: An IoT-based framework for manufacturing systems , 2018, 2018 IEEE Industrial Cyber-Physical Systems (ICPS).

[32]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[33]  Eric A. Brewer,et al.  Borg, Omega, and Kubernetes , 2016, ACM Queue.

[34]  Meisam Razaviyayn,et al.  Successive Convex Approximation: Analysis and Applications , 2014 .

[35]  Dirk Merkel,et al.  Docker: lightweight Linux containers for consistent development and deployment , 2014 .