QoS-Aware Orchestration of Network Intensive Software Utilities within Software Defined Data Centres

Although the cloud computing domain is progressing rapidly, the deployment of various network intensive software utilities in the cloud is still a challenging task. The Quality of Service (QoS) for various gaming, simulations, videoconferencing, video streaming or even file uploading tasks may be significantly affected by the quality and geolocation of the selected underlying computing resources, which are available only when the specific functionality is required. This study presents a new architecture for geographic orchestration of network intensive software components which is designed for high QoS. Key elements of this architecture are a Global Cluster Manager operating within Software-Defined Data Centres (SDDCs), a runtime QoS Monitoring System, and a QoS Modeller and Decision Maker for automated orchestration of software utilities. The implemented system automatically selects the best geographically available computing resource within the SDDC according to the developed QoS model of the software component. This architecture is event-driven as the services are deployed and destroyed in real-time for every usage event. The utility of the implemented orchestration technology is verified qualitatively and in relation to the potential gains of selected QoS metrics by using two network intensive software utilities implemented as containers: an HTTP(S) File Upload service and a Jitsi Meet videoconferencing service. The study shows potential for QoS improvements in comparison to existing orchestration systems.

[1]  Martin Gogolla,et al.  Using Models at Runtime to Address Assurance for Self-Adaptive Systems , 2015, Models@run.time@Dagstuhl.

[2]  Julie A. McCann,et al.  A survey of autonomic computing—degrees, models, and applications , 2008, CSUR.

[3]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[4]  Elena Kornyshova,et al.  Using an Ontology for Modeling Decision-Making Knowledge , 2012, KES.

[5]  Raouf Boutaba,et al.  A survey of network virtualization , 2010, Comput. Networks.

[6]  Valentin Kulyk,et al.  Subjective quality assessment of video conferences and telemeetings , 2012, 2012 19th International Packet Video Workshop (PV).

[7]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[8]  Jifeng He,et al.  Component-Based Software Engineering , 2005, ICTAC.

[9]  Ivan Bratko,et al.  Q2 Prediction of ozone concentrations , 2006 .

[10]  Muthu Ramachandran,et al.  Financial Modeling and Prediction as a Service , 2017, Journal of Grid Computing.

[11]  Cees T. A. M. de Laat,et al.  Planning virtual infrastructures for time critical applications with multiple deadline constraints , 2017, Future Gener. Comput. Syst..

[12]  Jarmo J. Ahonen,et al.  On qualitative modelling , 2005, AI & SOCIETY.

[13]  Inderveer Chana,et al.  A Survey on Resource Scheduling in Cloud Computing: Issues and Challenges , 2016, Journal of Grid Computing.

[14]  Jacobus E. van der Merwe,et al.  Cloud Resource Orchestration: A Data-Centric Approach , 2011, CIDR.

[15]  Vlado Stankovski,et al.  Quality of Service Assurance for Internet of Things Time-Critical Cloud Applications: Experience with the Switch and Entice Projects , 2017, 2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[16]  Thomas Magedanz,et al.  Towards Container Orchestration in Fog Computing Infrastructures , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[17]  Jan Lunze,et al.  Qualitative modelling of linear dynamical systems with quantized state measurements , 1994, Autom..

[18]  Ivan Bratko,et al.  Learning Qualitative Models , 2004, AI Mag..

[19]  Rajiv Ranjan,et al.  A Taxonomy and Survey of Cloud Resource Orchestration Techniques , 2017, ACM Comput. Surv..

[20]  Vlado Stankovski,et al.  A Network Edge Monitoring Approach for Real-Time Data Streaming Applications , 2016, GECON.

[21]  Benjamín Barán,et al.  Many-Objective Virtual Machine Placement , 2017, Journal of Grid Computing.

[22]  Xiaohua Tian,et al.  AMCloud: Toward a Secure Autonomic Mobile Ad Hoc Cloud Computing System , 2017, IEEE Wireless Communications.

[23]  Chrystalla Sofokleous,et al.  Managing and Monitoring Elastic Cloud Applications , 2014, ICWE.

[24]  Kenneth D. Forbus.  Handbook of Knowledge Representation Edited Qualitative Modeling , 2022 .

[25]  Yves Lemieux,et al.  QoS Assurance with Light Virtualization - A Survey , 2016, 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[26]  Calton Pu,et al.  vPerfGuard: an automated model-driven framework for application performance diagnosis in consolidated cloud environments , 2013, ICPE '13.

[27]  Jiang Zhu,et al.  Fog Computing: A Platform for Internet of Things and Analytics , 2014, Big Data and Internet of Things.

[28]  Rajkumar Buyya,et al.  Interconnected Cloud Computing Environments , 2014, ACM Comput. Surv..

[29]  Salim Hariri,et al.  A component-based programming model for autonomic applications , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[30]  Rajkumar Buyya,et al.  Software-Defined Cloud Computing: Architectural elements and open challenges , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[31]  Claus Pahl,et al.  Containers and Clusters for Edge Cloud Architectures -- A Technology Review , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[32]  Raouf Boutaba,et al.  PolicyCop: An Autonomic QoS Policy Enforcement Framework for Software Defined Networks , 2013, 2013 IEEE SDN for Future Networks and Services (SDN4FNS).

[33]  Claus Pahl,et al.  Managing Uncertainty in Autonomic Cloud Elasticity Controllers , 2016, IEEE Cloud Computing.

[34]  Ivan Bratko,et al.  Modelling Lake Glumsø with Q2 learning , 2006 .

[35]  João Paulo Carvalho,et al.  Qualitative modelling of an economic system using rule-based fuzzy cognitive maps , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[36]  Albert Y. Zomaya,et al.  CA-DAG: Modeling Communication-Aware Applications for Scheduling in Cloud Computing , 2015, Journal of Grid Computing.

[37]  Péter Kacsuk,et al.  Infrastructure Aware Scientific Workflows and Infrastructure Aware Workflow Managers in Science Gateways , 2016, Journal of Grid Computing.

[38]  Douglas C. Schmidt,et al.  ROAR: A QoS-oriented modeling framework for automated cloud resource allocation and optimization , 2016, J. Syst. Softw..

[39]  Dejan S. Milojicic,et al.  Open Cirrus: A Global Cloud Computing Testbed , 2010, Computer.

[40]  Yunsong Lu,et al.  Centrifugal compressor fault diagnosis based on qualitative simulation and thermal parameters , 2016 .

[41]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[42]  Radu Prodan,et al.  Semantic approach for multi‐objective optimisation of the ENTICE distributed Virtual Machine and container images repository , 2019, Concurr. Comput. Pract. Exp..