Optimization of Big Data Scheduling in Social Networks

In social network big data scheduling, it is easy for target data to conflict in the same data node. Of the different kinds of entropy measures, this paper focuses on the optimization of target entropy. Therefore, this paper presents an optimized method for the scheduling of big data in social networks and also takes into account each task’s amount of data communication during target data transmission to construct a big data scheduling model. Firstly, the task scheduling model is constructed to solve the problem of conflicting target data in the same data node. Next, the necessary conditions for the scheduling of tasks are analyzed. Then, the a periodic task distribution function is calculated. Finally, tasks are scheduled based on the minimum product of the corresponding resource level and the minimum execution time of each task is calculated. Experimental results show that our optimized scheduling model quickly optimizes the scheduling of social network data and solves the problem of strong data collision.

[1]  Giuseppe Caire,et al.  Massive-MIMO Meets HetNet: Interference Coordination Through Spatial Blanking , 2014, IEEE Journal on Selected Areas in Communications.

[2]  Chadi Assi,et al.  On the Interaction Between Scheduling and Compressive Data Gathering in Wireless Sensor Networks , 2016, IEEE Transactions on Wireless Communications.

[3]  Amir Masoud Rahmani,et al.  A multi-parameter scheduling method of dynamic workloads for big data calculation in cloud computing , 2017, The Journal of Supercomputing.

[4]  Junho Choi,et al.  Improved performance optimization for massive small files in cloud computing environment , 2018, Ann. Oper. Res..

[5]  Chadi Assi,et al.  Delay-Aware Flow Scheduling In Low Latency Enterprise Datacenter Networks: Modeling and Performance Analysis , 2017, IEEE Transactions on Communications.

[6]  Alex Thomo,et al.  Why Waldo befriended the dummy? k-Anonymization of social networks with pseudo-nodes , 2012, Social Network Analysis and Mining.

[7]  Gaochao Xu,et al.  SDN-Based Data Center Networking With Collaboration of Multipath TCP and Segment Routing , 2017, IEEE Access.

[8]  Bruce M. Kapron,et al.  Social Network Anonymization via Edge Addition , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[9]  Antonio Pescapè,et al.  Benchmarking big data architectures for social networks data processing using public cloud platforms , 2018, Future Gener. Comput. Syst..

[10]  Mihaela van der Schaar,et al.  Big-Data Streaming Applications Scheduling Based on Staged Multi-Armed Bandits , 2016, IEEE Transactions on Computers.

[11]  Mo Li,et al.  Fair QoS multi-resource allocation for uplink traffic in WLAN , 2017, Wirel. Networks.

[12]  Retsef Levi,et al.  Systematic OR Block Allocation at a Large Academic Medical Center: Comprehensive Review on a Data-driven Surgical Scheduling Strategy , 2016, Annals of surgery.

[13]  Peng Xu,et al.  Efficient algorithms for scheduling multiple bulk data transfers in inter‐datacenter networks , 2014, Int. J. Commun. Syst..

[14]  Shang Gao,et al.  Rethinking elastic online scheduling of big data streaming applications over high-velocity continuous data streams , 2018, The Journal of Supercomputing.

[15]  Hongbo Zhu,et al.  Multi-pair massive MIMO relay networks: power scaling laws and user scheduling strategy , 2017, IET Commun..

[16]  Weishan Zhang,et al.  A genetic algorithm-based job scheduling model for big data analytics , 2016, EURASIP Journal on Wireless Communications and Networking.

[17]  Sean Chester,et al.  Social Network Privacy for Attribute Disclosure Attacks , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[18]  Sean Chester,et al.  Complexity of social network anonymization , 2012, Social Network Analysis and Mining.

[19]  Hari M. Srivastava,et al.  Parallel Fractal Compression Method for Big Video Data , 2018, Complex..

[20]  Dong In Kim,et al.  Optimal Data Scheduling and Admission Control for Backscatter Sensor Networks , 2017, IEEE Transactions on Communications.

[21]  Lin Dai,et al.  Massive Random Access of Machine-to-Machine Communications in LTE Networks: Modeling and Throughput Optimization , 2018, IEEE Transactions on Wireless Communications.

[22]  Giuseppe Caire,et al.  WiFlix: Adaptive Video Streaming in Massive MU-MIMO Wireless Networks , 2015, IEEE Transactions on Wireless Communications.

[23]  Arun Kumar Sangaiah,et al.  Visual attention feature (VAF) : A novel strategy for visual tracking based on cloud platform in intelligent surveillance systems , 2018, J. Parallel Distributed Comput..

[24]  Huiyu Zhou,et al.  A Robust Parallel Object Tracking Method for Illumination Variations , 2018, Mobile Networks and Applications.

[25]  Laurence T. Yang,et al.  A nodes scheduling model based on Markov chain prediction for big streaming data analysis , 2015, Int. J. Commun. Syst..

[26]  Sushil Jajodia,et al.  Recognizing Unexplained Behavior in Network Traffic , 2014, Network Science and Cybersecurity.

[27]  Sean Chester,et al.  k-Anonymization of Social Networks by Vertex Addition , 2011, ADBIS.

[28]  Yongming Huang,et al.  Pilot scheduling schemes for multi-cell massive multiple-input-multiple-output transmission , 2015, IET Commun..

[29]  Jie Cui,et al.  Dynamic Traffic Scheduling and Congestion Control across Data Centers Based on SDN , 2018, Future Internet.

[30]  Shi Jin,et al.  A Unified Transmission Strategy for TDD/FDD Massive MIMO Systems With Spatial Basis Expansion Model , 2017, IEEE Transactions on Vehicular Technology.