Optimal Decision Making for Big Data Processing at Edge-Cloud Environment: An SDN Perspective

With the evolution of Internet and extensive usage of smart devices for computing and storage, cloud computing has become popular. It provides seamless services such as e-commerce, e-health, e-banking, etc., to the end users. These services are hosted on massive geodistributed data centers (DCs), which may be managed by different service providers. For faster response time, such a data explosion creates the need to expand DCs. So, to ease the load on DCs, some of the applications may be executed on the edge devices near to the proximity of the end users. However, such a multiedge-cloud environment involves huge data migrations across the underlying network infrastructure, which may generate long migration delay and cost. Hence, in this paper, an efficient workload slicing scheme is proposed for handling data-intensive applications in multiedge-cloud environment using software-defined networks (SDN). To handle the inter-DC migrations efficiently, an SDN-based control scheme is presented, which provides energy-aware network traffic flow scheduling. Finally, a multileader multifollower Stackelberg game is proposed to provide cost-effective inter-DC migrations. The efficacy of the proposed scheme is evaluated on Google workload traces using various parameters. The results obtained show the effectiveness of the proposed scheme.

[1]  Song Guo,et al.  Traffic-Aware Geo-Distributed Big Data Analytics with Predictable Job Completion Time , 2017, IEEE Transactions on Parallel and Distributed Systems.

[2]  Neeraj Kumar,et al.  SDN-Based Data Center Energy Management System Using RES and Electric Vehicles , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[3]  Tansu Alpcan,et al.  Fog Computing May Help to Save Energy in Cloud Computing , 2016, IEEE Journal on Selected Areas in Communications.

[4]  Patrick Th. Eugster,et al.  From the Cloud to the Atmosphere: Running MapReduce across Data Centers , 2014, IEEE Transactions on Computers.

[5]  Rong Yu,et al.  Decentralized and Optimal Resource Cooperation in Geo-Distributed Mobile Cloud Computing , 2018, IEEE Transactions on Emerging Topics in Computing.

[6]  Song Guo,et al.  A General Communication Cost Optimization Framework for Big Data Stream Processing in Geo-Distributed Data Centers , 2016, IEEE Transactions on Computers.

[7]  Wolfgang Kellerer,et al.  Survey on Network Virtualization Hypervisors for Software Defined Networking , 2015, IEEE Communications Surveys & Tutorials.

[8]  Li-Chun Wang,et al.  EQVMP: Energy-efficient and QoS-aware virtual machine placement for software defined datacenter networks , 2014, The International Conference on Information Networking 2014 (ICOIN2014).

[9]  Hao Liang,et al.  Optimal Workload Allocation in Fog-Cloud Computing Toward Balanced Delay and Power Consumption , 2016, IEEE Internet of Things Journal.

[10]  M. Vijaya Shanthi,et al.  COST MINIMIZATION FOR BIG DATA PROCESSING IN GEO DISTRIBUTED DATA CENTERS , 2016 .

[11]  Andrzej Jajszczyk,et al.  Energy-aware fog and cloud interplay supported by wide area software defined networking , 2016, 2016 IEEE International Conference on Communications (ICC).

[12]  P. Castoldi,et al.  Anycast-based optimizations for inter-data-center interconnections [Invited] , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[13]  Albert Y. Zomaya,et al.  Parallel Simulation of Complex Evacuation Scenarios with Adaptive Agent Models , 2015, IEEE Transactions on Parallel and Distributed Systems.

[14]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[15]  Haibing Guan,et al.  A survey on data center networking for cloud computing , 2015, Comput. Networks.

[16]  Zhenni Li,et al.  Cost-Aware Streaming Workflow Allocation on Geo-Distributed Data Centers , 2017, IEEE Transactions on Computers.

[17]  Jingjing Yao,et al.  Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks , 2015, IEEE Network.

[18]  Abdulsalam Yassine,et al.  Bandwidth On-Demand for Multimedia Big Data Transfer Across Geo-Distributed Cloud Data Centers , 2020, IEEE Transactions on Cloud Computing.

[19]  Benxiong Huang,et al.  Bandwidth-aware energy efficient flow scheduling with SDN in data center networks , 2017, Future Gener. Comput. Syst..

[20]  Albert Y. Zomaya,et al.  Stackelberg Game for Energy-Aware Resource Allocation to Sustain Data Centers Using RES , 2019, IEEE Transactions on Cloud Computing.

[21]  Yuguang Fang,et al.  Energy and Network Aware Workload Management for Sustainable Data Centers with Thermal Storage , 2014, IEEE Transactions on Parallel and Distributed Systems.

[22]  Joel J. P. C. Rodrigues,et al.  Data Offloading in 5G-Enabled Software-Defined Vehicular Networks: A Stackelberg-Game-Based Approach , 2017, IEEE Communications Magazine.