Optimization and Prediction Techniques for Self-Healing and Self-Learning Applications in a Trustworthy Cloud Continuum

The current IT market is more and more dominated by the “cloud continuum”. In the “traditional” cloud, computing resources are typically homogeneous in order to facilitate economies of scale. In contrast, in edge computing, computational resources are widely diverse, commonly with scarce capacities and must be managed very efficiently due to battery constraints or other limitations. A combination of resources and services at the edge (edge computing), in the core (cloud computing), and along the data path (fog computing) is needed through a trusted cloud continuum. This requires novel solutions for the creation, optimization, management, and automatic operation of such infrastructure through new approaches such as infrastructure as code (IaC). In this paper, we analyze how artificial intelligence (AI)-based techniques and tools can enhance the operation of complex applications to support the broad and multi-stage heterogeneity of the infrastructural layer in the “computing continuum” through the enhancement of IaC optimization, IaC self-learning, and IaC self-healing. To this extent, the presented work proposes a set of tools, methods, and techniques for applications’ operators to seamlessly select, combine, configure, and adapt computation resources all along the data path and support the complete service lifecycle covering: (1) optimized distributed application deployment over heterogeneous computing resources; (2) monitoring of execution platforms in real time including continuous control and trust of the infrastructural services; (3) application deployment and adaptation while optimizing the execution; and (4) application self-recovery to avoid compromising situations that may lead to an unexpected failure.

[1]  Jesús López Lobo New perspectives and methods for stream learning in the presence of concept drift. , 2018 .

[2]  Enrique Alba,et al.  SMPSO: A new PSO-based metaheuristic for multi-objective optimization , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[3]  Javier Del Ser,et al.  Evolutionary Multitask Optimization: a Methodological Overview, Challenges, and Future Research Directions , 2021, Cognitive Computation.

[4]  N. B. Anuar,et al.  The rise of "big data" on cloud computing: Review and open research issues , 2015, Inf. Syst..

[5]  Nicolas Jouandeau,et al.  Towards a Reference Architecture for Swarm Intelligence-Based Internet of Things , 2017, IDCS.

[6]  Irina Kakanakova,et al.  Outlier Detection via Deep Learning Architecture , 2017, CompSysTech.

[7]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[8]  Radu Marculescu,et al.  Multi-Scale Compositionality: Identifying the Compositional Structures of Social Dynamics Using Deep Learning , 2015, PloS one.

[9]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[10]  Roberto Souto Maior de Barros,et al.  A large-scale comparison of concept drift detectors , 2018, Inf. Sci..

[11]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[12]  João Gama,et al.  Machine learning for streaming data: state of the art, challenges, and opportunities , 2019, SKDD.

[13]  Andrew Zisserman,et al.  Multi-task Self-Supervised Visual Learning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Yucong Duan,et al.  Toward service selection for workflow reconfiguration: An interface-based computing solution , 2018, Future Gener. Comput. Syst..

[15]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[16]  Ashraf Darwish,et al.  A survey of swarm and evolutionary computing approaches for deep learning , 2019, Artificial Intelligence Review.

[17]  Boualem Benatallah,et al.  Self-adapting cloud services orchestration for fulfilling intensive sensory data-driven IoT workflows , 2020, Future Gener. Comput. Syst..

[18]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[19]  Heitor Murilo Gomes,et al.  Data stream analysis: Foundations, major tasks and tools , 2021, WIREs Data Mining Knowl. Discov..

[20]  Mansoor Alam,et al.  A Deep Learning Approach for Network Intrusion Detection System , 2016, EAI Endorsed Trans. Security Safety.

[21]  Guangquan Zhang,et al.  Data-driven decision support under concept drift in streamed big data , 2019, Complex & Intelligent Systems.

[22]  Geeta Sikka,et al.  Multi-agent architecture for fault recovery in self-healing systems , 2020, Journal of Ambient Intelligence and Humanized Computing.

[23]  Frank Leymann,et al.  Portable Cloud Services Using TOSCA , 2012, IEEE Internet Computing.

[24]  Geoff Holmes,et al.  Evaluation methods and decision theory for classification of streaming data with temporal dependence , 2015, Machine Learning.

[25]  Dana Petcu,et al.  CLOUDLIGHTNING: A Framework for a Self-organising and Self-managing Heterogeneous Cloud , 2016, CLOSER.

[26]  Kumarjit Pathak,et al.  Reinforcement Evolutionary Learning Method for self-learning , 2018, ArXiv.

[27]  Michael A. Rappa,et al.  The utility business model and the future of computing services , 2004, IBM Syst. J..

[28]  Elena Baralis,et al.  Automating concept-drift detection by self-evaluating predictive model degradation , 2019, ArXiv.

[29]  Jose A. Lozano,et al.  Analyzing rare event, anomaly, novelty and outlier detection terms under the supervised classification framework , 2019, Artificial Intelligence Review.

[30]  Maude Manouvrier,et al.  An Agent Architecture to Enable Self-healing and Context-aware Web of Things Applications , 2016, IoTBD.

[31]  Josef Spillner,et al.  Self-managing cloud-native applications: Design, implementation, and experience , 2017, Future Gener. Comput. Syst..

[32]  Naveen K. Chilamkurti,et al.  Self-evolving intelligent algorithms for facilitating data interoperability in IoT environments , 2018, Future Gener. Comput. Syst..

[33]  Gorka Benguria,et al.  DECIDE: DevOps for Trusted, Portable and Interoperable Multi-Cloud Applications towards the Digital Single Market , 2017, CLOSER.

[34]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[35]  Enrique Alba,et al.  MOCell: A cellular genetic algorithm for multiobjective optimization , 2009, Int. J. Intell. Syst..

[36]  Rajkumar Buyya,et al.  RADAR: Self‐configuring and self‐healing in resource management for enhancing quality of cloud services , 2018, Concurr. Comput. Pract. Exp..

[37]  Tie Luo,et al.  Distributed Anomaly Detection Using Autoencoder Neural Networks in WSN for IoT , 2018, 2018 IEEE International Conference on Communications (ICC).

[38]  Yolande Berbers,et al.  Enabling Self-learning in Dynamic and Open IoT Environments , 2014, ANT/SEIT.

[39]  Xin-She Yang,et al.  Bio-inspired computation: Where we stand and what's next , 2019, Swarm Evol. Comput..

[40]  Javier Del Ser,et al.  A heuristic approach to the multicriteria design of IaaS cloud infrastructures for Big Data applications , 2018, Expert Syst. J. Knowl. Eng..

[41]  Kyriakos Stefanidis,et al.  DECIDE: An Extended DevOps Framework for Multi-cloud Applications , 2019, ICCBDC.

[42]  Mohamed Adel Serhani,et al.  Trust enforcement through self-adapting cloud workflow orchestration , 2019, Future Gener. Comput. Syst..

[43]  Angshul Majumdar,et al.  Semi Supervised Autoencoder , 2016, ICONIP.

[44]  Lamjed Ben Said,et al.  Many-objective Optimization Using Evolutionary Algorithms: A Survey , 2017, Recent Advances in Evolutionary Multi-objective Optimization.

[45]  Herodotos Herodotou,et al.  No one (cluster) size fits all: automatic cluster sizing for data-intensive analytics , 2011, SoCC.

[46]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[47]  Jörg Domaschka,et al.  The cloud application modelling and execution language (CAMEL) , 2017 .

[48]  Alan M. Davis,et al.  Software Requirements: Objects, Functions and States , 1993 .

[49]  A. Madansky Identification of Outliers , 1988 .

[50]  Carsten Maple,et al.  Future developments in standardisation of cyber risk in the Internet of Things (IoT) , 2019 .

[51]  Albert Bifet Classifier Concept Drift Detection and the Illusion of Progress , 2017, ICAISC.

[52]  Geoff Hulten,et al.  A General Framework for Mining Massive Data Streams , 2003 .

[53]  Mehmed Kantardzic,et al.  No Free Lunch Theorem for concept drift detection in streaming data classification: A review , 2019, WIREs Data Mining Knowl. Discov..