Delay-Aware Resource Allocation for Data Analysis in Cloud-Edge System

There is a strong need for data analysis in information systems to support various services. Traditional cloud data centers provide powerful ability to conduct data analysis jobs. However, the data transmission consumes a large amount of time and leads to a long service delay. The QoS (Quality of Service) caused by long service delay is unacceptable for real-time services or applications. The collaboration with edge computing is an opportunity for service delay reduction. In this paper, we investigate the task placement problem for reducing service delay in cloud-edge system. We use the W-DAG (Weighted Directed Acyclic Graph) to model the data-intensive service or business logic. We analyze the data and resource requirements for the tasks, which constitute the integrated service, and make resource allocation between cloud data center and edge nodes. Then, we propose the task placement algorithm to achieve shorter service delay. The core idea is to make a tradeoff between data transmission time and data analysis time. The simulation results show that our algorithm has significant performance improvement on service delay reduction.

[1]  T. V. Lakshman,et al.  Optimizing data access latencies in cloud systems by intelligent virtual machine placement , 2013, 2013 Proceedings IEEE INFOCOM.

[2]  Jesús Carretero,et al.  Different aspects of workflow scheduling in large-scale distributed systems , 2017, Simul. Model. Pract. Theory.

[3]  Jaime Llorca,et al.  Dynamic network service optimization in distributed cloud networks , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[4]  Jie Wu,et al.  Let's stay together: Towards traffic aware virtual machine placement in data centers , 2012, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[5]  Abdulsalam Yassine,et al.  Bandwidth On-Demand for Multimedia Big Data Transfer Across Geo-Distributed Cloud Data Centers , 2020, IEEE Transactions on Cloud Computing.

[6]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[7]  Logan Hall,et al.  Big Data Aware Virtual Machine Placement in Cloud Data Centers , 2017, BDCAT.

[8]  Jie Wu,et al.  QoS-Aware Service Selection in Geographically Distributed Clouds , 2013, 2013 22nd International Conference on Computer Communication and Networks (ICCCN).

[9]  Jie Wu,et al.  Virtual Network Embedding with Opportunistic Resource Sharing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[10]  Fang Hao,et al.  Online allocation of virtual machines in a distributed cloud , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[11]  T. V. Lakshman,et al.  Online Allocation of Virtual Machines in a Distributed Cloud , 2017, IEEE/ACM Transactions on Networking.

[12]  Khaled Ben Letaief,et al.  Delay-optimal computation task scheduling for mobile-edge computing systems , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[13]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[14]  Rajkumar Buyya,et al.  An Algorithm for Network and Data-aware Placement of Multi-Tier Applications in Cloud Data Centers , 2017, J. Netw. Comput. Appl..

[15]  Jie Wu,et al.  Efficient Cloudlet Deployment: Local Cooperation and Regional Proxy , 2018, 2018 International Conference on Computing, Networking and Communications (ICNC).

[16]  Nawel Zangar,et al.  Resources allocation trade-off between cost and delay over a distributed Cloud infrastructure , 2016, 2016 7th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT).

[17]  Jie Wu,et al.  Privacy-preserved data publishing of evolving online social networks , 2016 .

[18]  Zhisheng Niu,et al.  Tasks scheduling and resource allocation in heterogeneous cloud for delay-bounded mobile edge computing , 2017, 2017 IEEE International Conference on Communications (ICC).

[19]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[20]  Jie Wu,et al.  Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center , 2013, Math. Comput. Model..

[21]  T. V. Lakshman,et al.  Network aware resource allocation in distributed clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[22]  Jie Wu,et al.  Forming Opinions via Trusted Friends: Time-Evolving Rating Prediction Using Fluid Dynamics , 2016, IEEE Transactions on Computers.

[23]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.

[24]  Thanasis Loukopoulos,et al.  Data Replication and Virtual Machine Migrations to Mitigate Network Overhead in Edge Computing Systems , 2017, IEEE Transactions on Sustainable Computing.

[25]  Victor C. M. Leung,et al.  Toward Big Data in Green City , 2017, IEEE Communications Magazine.

[26]  Heng Zhang,et al.  Analysis of event-driven warning message propagation in Vehicular Ad Hoc Networks , 2017, Ad Hoc Networks.

[27]  Jie Wu,et al.  Towards location-aware joint job and data assignment in cloud data centers with NVM , 2017, 2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC).