Intelligent Management and Efficient Operation of Big Data

This chapter details how Big Data can be used and implemented in networking and computing infrastructures. Specifically, it addresses three main aspects: the timely extraction of relevant knowledge from heterogeneous, and very often unstructured large data sources, the enhancement on the performance of processing and networking (cloud) infrastructures that are the most important foundational pillars of Big Data applications or services, and novel ways to efficiently manage network infrastructures with high-level composed policies for supporting the transmission of large amounts of data with distinct requisites (video vs. non-video). A case study involving an intelligent management solution to route data traffic with diverse requirements in a wide area Internet Exchange Point is presented, discussed in the context of Big Data, and evaluated.

[1]  Bram Naudts,et al.  Techno-economic Analysis of Software Defined Networking as Architecture for the Virtualization of a Mobile Network , 2012, 2012 European Workshop on Software Defined Networking.

[2]  Tao Li,et al.  Leveraging phase change memory to achieve efficient virtual machine execution , 2013, VEE '13.

[3]  Ananth Balashankar,et al.  Software Defined Networking , 2019, 2019 19th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA).

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  Keith Kirkpatrick,et al.  Software-defined networking , 2013, CACM.

[6]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[7]  R. Nejabati,et al.  Optical FlowVisor: An OpenFlow-based optical network virtualization approach , 2012, OFC/NFOEC.

[8]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[9]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[10]  Valerie Daggett,et al.  DIVE: A Graph-Based Visual-Analytics Framework for Big Data , 2014, IEEE Computer Graphics and Applications.

[11]  Francis X. Diebold,et al.  A Personal Perspective on the Origin(s) and Development of 'Big Data': The Phenomenon, the Term, and the Discipline, Second Version , 2012 .

[12]  Martín Casado,et al.  Network Virtualization in Multi-tenant Datacenters , 2014, NSDI.

[13]  Devavrat Shah,et al.  Fastpass , 2014, SIGCOMM.

[14]  Michael Cox,et al.  Application-controlled demand paging for out-of-core visualization , 1997 .

[15]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[16]  Frederick Jelinek,et al.  Some of my Best Friends are Linguists , 2005, Lang. Resour. Evaluation.

[17]  David Walker,et al.  Languages for software-defined networks , 2013, IEEE Communications Magazine.

[18]  David Ellsworth,et al.  Application-controlled demand paging for out-of-core visualization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[19]  Nick Feamster,et al.  Detecting BGP configuration faults with static analysis , 2005 .

[20]  Mourad Debbabi,et al.  A Survey and a Layered Taxonomy of Software-Defined Networking , 2014, IEEE Communications Surveys & Tutorials.

[21]  Nick Feamster,et al.  Broadband internet performance: a view from the gateway , 2011, SIGCOMM.

[22]  Yan Wang,et al.  Mobileflow: Toward software-defined mobile networks , 2013, IEEE Communications Magazine.

[23]  Nando de Freitas,et al.  A Deep Architecture for Semantic Parsing , 2014, ACL 2014.

[24]  Vijay Sivaraman,et al.  User control of quality of experience in home networks using SDN , 2013, 2013 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS).

[25]  Keith W. Miller,et al.  Big Data: New Opportunities and New Challenges [Guest editors' introduction] , 2013, Computer.

[26]  Mitch Waldrop,et al.  Big data: Wikiomics , 2008, Nature.

[27]  Thomas H. Davenport,et al.  Analytics at Work: Smarter Decisions, Better Results , 2010 .

[28]  Rob Sherwood,et al.  Can the Production Network Be the Testbed? , 2010, OSDI.

[29]  Thierry Turletti,et al.  A Survey of Software-Defined Networking: Past, Present, and Future of Programmable Networks , 2014, IEEE Communications Surveys & Tutorials.

[30]  Alan L. Cox,et al.  Hyper-Switch: A Scalable Software Virtual Switching Architecture , 2013, USENIX Annual Technical Conference.

[31]  Ben Kenwright Gastropod Mollusc (or Slug) Optimisation Algorithm Technical Report on Optimization Techniques for Problem Solving in Uncertainty , 2018 .

[32]  George Varghese,et al.  Usenix Association 10th Usenix Symposium on Networked Systems Design and Implementation (nsdi '13) 99 Real Time Network Policy Checking Using Header Space Analysis , 2022 .

[33]  Adam Barker,et al.  Undefined By Data: A Survey of Big Data Definitions , 2013, ArXiv.

[34]  Thomas J. Steenburgh,et al.  Motivating Salespeople: What Really Works , 2012, Harvard business review.

[35]  Russell J. Clark,et al.  SDX , 2014, SIGCOMM.

[36]  José Costa-Requena SDN integration in LTE mobile backhaul networks , 2014, The International Conference on Information Networking 2014 (ICOIN2014).

[37]  Peter A. Dinda,et al.  Dynamic adaptive virtual core mapping to improve power, energy, and performance in multi-socket multicores , 2012, HPDC '12.

[38]  Jeffrey M. Voas,et al.  Big Data, Networked Worlds , 2014, Computer.

[39]  Martín Casado,et al.  Fabric: a retrospective on evolving SDN , 2012, HotSDN '12.

[40]  Byrav Ramamurthy,et al.  Network Innovation using OpenFlow: A Survey , 2014, IEEE Communications Surveys & Tutorials.

[41]  It Informatics,et al.  Border Gateway Protocol , 2013 .

[42]  M. Waldrop,et al.  Community cleverness required , 2008, Nature.

[43]  Nawaf N. Hamadneh Grey Optimization Problems Using Prey-Predator Algorithm , 2018 .

[44]  Yong Qi,et al.  A lightweight VMM on many core for high performance computing , 2013, VEE '13.

[45]  Akshat Verma,et al.  Estimating Application Cache Requirement for Provisioning Caches in Virtualized Systems , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[46]  H Mohamed Saleem,et al.  P2P service discovery in clouds with message level intelligence , 2011, 2011 National Postgraduate Conference.

[47]  V. Marx Biology: The big challenges of big data , 2013, Nature.

[48]  Walter Goralski Border Gateway Protocol , 2017 .

[49]  Peter A. Dinda,et al.  Minimal-overhead virtualization of a large scale supercomputer , 2011, VEE '11.

[50]  David Walker,et al.  Composing Software Defined Networks , 2013, NSDI.

[51]  Andrew Y. Ng,et al.  Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[52]  Quoc V. Le,et al.  Grounded Compositional Semantics for Finding and Describing Images with Sentences , 2014, TACL.

[53]  Olivier Bonaventure,et al.  Opportunities and research challenges of hybrid software defined networks , 2014, CCRV.

[54]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[55]  Wei Liu,et al.  Accessing Big Data in the Cloud Using Mobile Devices , 2014 .

[56]  Shriram Krishnamurthi,et al.  Tierless Programming and Reasoning for Software-Defined Networks , 2014, NSDI.

[57]  Tiantian Ren,et al.  Analysis of the New Features of OpenFlow 1.4 , 2014 .

[58]  T. Davenport,et al.  Data scientist: the sexiest job of the 21st century. , 2012, Harvard business review.

[59]  Russell J. Clark,et al.  SDX , 2014 .

[60]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[61]  Wendi Heinzelman,et al.  Accelerating Mobile-Cloud Computing: A Survey , 2014 .

[62]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[63]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[64]  Jonathan M. Smith,et al.  USENIX Association , 2000 .

[65]  Kok-Kiong Yap,et al.  Slicing home networks , 2011, HomeNets '11.

[66]  Ganesh Chandra Deka,et al.  Handbook of Research on Cloud Infrastructures for Big Data Analytics , 2014 .