Hardware-assisted Service Live Migration in Resource-limited Edge Computing Systems

Service live migration means migrating the running services from one machine to another with negligible service downtime. It has been considered as a powerful mechanism to facilitate service management. However, conventional live migration methods always come with expensive cost of data transmission, and thus can hardly be applied to a real-world edge computing system directly due to the limited network bandwidth. To tackle this problem, some recent works present various techniques to reduce the data transmission.However, these techniques for data transmission reduction always introduce extra computational costs, which have a great impact on the quality of service (QoS), especially in edge systems containing lots of nodes with insufficient computational resources. To alleviate this issue, we propose an insight to offload data reduction computations to a specific hardware accelerator, thus reducing the burden of CPU cores. To this end, we present a novel hardware accelerator design to speed up the data transmission reduction computations to accelerate the service live migration. For evaluation, we implement a prototype on an FPGA platform. Compared to the normal CPU-based approaches, our specialized accelerator is 3.1× faster, 2.9× more-energy efficient, and can reduce 29%∼47% of total migrating time and 24%∼40% of service downtime in our cases. Furthermore, our architecture has great scalability and is easy-configurable to achieve a balance between cost and performance.

[1]  Kin K. Leung,et al.  Live Service Migration in Mobile Edge Clouds , 2017, IEEE Wireless Communications.

[2]  Khaled Ben Letaief,et al.  Joint Task Offloading Scheduling and Transmit Power Allocation for Mobile-Edge Computing Systems , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[3]  Tony Q. S. Quek,et al.  Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling , 2017, IEEE Transactions on Communications.

[4]  Antonio Puliafito,et al.  Container Migration in the Fog: A Performance Evaluation † , 2019, Sensors.

[5]  Hai Jin,et al.  FITDOC: fast virtual machines checkpointing with delta memory compression , 2014, 2014 IEEE 17th International Conference on Computational Science and Engineering.

[6]  Petter Svärd,et al.  Evaluation of delta compression techniques for efficient live migration of large virtual machines , 2011, VEE '11.

[7]  Zhan Qiang,et al.  Fog computing dynamic load balancing mechanism based on graph repartitioning , 2016, China Communications.

[8]  Antonio Puliafito,et al.  Exploring Container Virtualization in IoT Clouds , 2016, 2016 IEEE International Conference on Smart Computing (SMARTCOMP).

[9]  Kasidit Chanchio,et al.  Performance comparisons and data compression of time-bound live migration and pre-copy live migration of virtual machines , 2017, 2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[10]  Sherali Zeadally,et al.  Container-as-a-Service at the Edge: Trade-off between Energy Efficiency and Service Availability at Fog Nano Data Centers , 2017, IEEE Wireless Communications.

[11]  Dilawaer Duolikun,et al.  Fault-Tolerant Fog Computing Models in the IoT , 2018, 3PGCIC.

[12]  Yang Chen,et al.  Checkpoint and Restore of Micro-service in Docker Containers , 2015, ICM 2015.

[13]  Rajkumar Buyya,et al.  Mobility-Aware Application Scheduling in Fog Computing , 2017, IEEE Cloud Computing.

[14]  Andreas Komninos,et al.  Performance of Raspberry Pi microclusters for Edge Machine Learning in Tourism , 2019, AmI.

[15]  Qun Li,et al.  Efficient service handoff across edge servers via docker container migration , 2017, SEC.

[16]  Sven Ubik,et al.  LZ4 compression algorithm on FPGA , 2015, 2015 IEEE International Conference on Electronics, Circuits, and Systems (ICECS).

[17]  Jangwoo Kim,et al.  FIDR: A Scalable Storage System for Fine-Grain Inline Data Reduction with Efficient Memory Handling , 2019, MICRO.

[18]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[19]  Qing Yang,et al.  Embedded Deep Learning for Vehicular Edge Computing , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[20]  Peng Liu,et al.  ParaDrop: Enabling Lightweight Multi-tenancy at the Network’s Extreme Edge , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[21]  Umesh Deshpande,et al.  Post-copy live migration of virtual machines , 2009, OPSR.

[22]  Jangwoo Kim,et al.  CIDR: A Cost-Effective In-Line Data Reduction System for Terabit-Per-Second Scale SSD Arrays , 2019, 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[23]  Mohammad Saad Alam,et al.  Fog Computing Model for Evolving Smart Transportation Applications , 2019, Fog and Edge Computing.

[24]  Kirill Kolyshkin,et al.  VIRTUALIZATION IN LINUX , 2006 .

[25]  Mahadev Satyanarayanan,et al.  You can teach elephants to dance: agile VM handoff for edge computing , 2017, SEC.

[26]  Feng Xia,et al.  A survey on virtual machine migration and server consolidation frameworks for cloud data centers , 2015, J. Netw. Comput. Appl..

[27]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[28]  Vittorio Scarano,et al.  SEcS: scalable edge-computing services , 2005, SAC '05.

[29]  Yang Yu Os-level virtualization and its applications , 2007 .

[30]  Bapi Kar,et al.  ADEPOS: anomaly detection based power saving for predictive maintenance using edge computing , 2018, ASP-DAC.

[31]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[32]  Tom H. Luan,et al.  Content in Motion: An Edge Computing Based Relay Scheme for Content Dissemination in Urban Vehicular Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[33]  Xuanhua Shi,et al.  FITDOC: Fast Virtual Machines Checkpointing with Delta Memory Compression , 2014, CSE.