The Concept of Applying Lifelong Learning Paradigm to Cybersecurity

One of the current challenges in machine learning is to develop intelligent systems that are able to learn consecutive tasks, and to transfer knowledge from previously learnt basis to learn new tasks. Such capability is termed as lifelong learning and, as we believe, it matches very well to counter current problems in cybersecurity domain, where each new cyber attack can be considered as a new task. One of the main motivations for our research is the fact that many cybersecurity solutions adapting machine learning are concerned as STL (Single Task Learning problem), which in our opinion is not the optimal approach (particularly in the area of malware detection) to solve the classification problem. Therefore, in this paper we present the concept applying the lifelong learning approach to cybersecurity (attack detection).

[1]  Ben Paechter,et al.  A Lifelong Learning Hyper-heuristic Method for Bin Packing , 2015, Evolutionary Computation.

[2]  Bing Liu,et al.  Topic Modeling using Topics from Many Domains, Lifelong Learning and Big Data , 2014, ICML.

[3]  Michal Choras,et al.  Ontology Applied in Decision Support System for Critical Infrastructures Protection , 2010, IEA/AIE.

[4]  Adrian Groza,et al.  Improving remote sensing crop classification by argumentation-based conflict resolution in ensemble learning , 2016, Expert Syst. Appl..

[5]  Gerhard Widmer,et al.  Learning in the Presence of Concept Drift and Hidden Contexts , 1996, Machine Learning.

[6]  Guillermo Sapiro,et al.  Learning transformations for clustering and classification , 2013, J. Mach. Learn. Res..

[7]  Marcelo R. Campo,et al.  Survey on network-based botnet detection methods , 2014, Secur. Commun. Networks.

[8]  Santosh S. Vempala,et al.  Efficient Representations for Lifelong Learning and Autoencoding , 2014, COLT.

[9]  Michal Choras,et al.  Evolutionary-based packets classification for anomaly detection in web layer , 2016, Secur. Commun. Networks.

[10]  Jonathan Baxter,et al.  A Model of Inductive Bias Learning , 2000, J. Artif. Intell. Res..

[11]  Eric Eaton,et al.  Safe Policy Search for Lifelong Reinforcement Learning with Sublinear Regret , 2015, ICML.

[12]  Michal Choras,et al.  Cyber Security of the Application Layer of Mission Critical Industrial Systems , 2016, CISIM.

[13]  Guillermo Ricardo Simari,et al.  A generalized abstract argumentation framework for inconsistency-tolerant ontology reasoning , 2016, Expert Syst. Appl..

[14]  Melba M. Crawford,et al.  Domain Adaptation With Preservation of Manifold Geometry for Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Guillermo Ricardo Simari,et al.  ONTOarg: A decision support framework for ontology integration based on argumentation , 2013, Expert Syst. Appl..

[16]  Christoph H. Lampert,et al.  Lifelong Learning with Non-i.i.d. Tasks , 2015, NIPS.

[17]  Bernard Moulin,et al.  A taxonomy of argumentation models used for knowledge representation , 2010, Artificial Intelligence Review.

[18]  Rafał Renk,et al.  Cyber Threats Impacting Critical Infrastructures , 2016 .

[19]  Melba M. Crawford,et al.  Spectral and Spatial Proximity-Based Manifold Alignment for Multitemporal Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Bing Liu,et al.  Lifelong machine learning: a paradigm for continuous learning , 2017, Frontiers of Computer Science.

[21]  Maayan Harel,et al.  Learn on Source, Refine on Target: A Model Transfer Learning Framework with Random Forests , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Michal Choras,et al.  Correlation Approach for SQL Injection Attacks Detection , 2012, CISIS/ICEUTE/SOCO Special Sessions.

[23]  Andreas Maurer,et al.  Algorithmic Stability and Meta-Learning , 2005, J. Mach. Learn. Res..

[24]  Michal Choras,et al.  Comprehensive Approach to Increase Cyber Security and Resilience , 2015, 2015 10th International Conference on Availability, Reliability and Security.

[25]  Christoph H. Lampert,et al.  A PAC-Bayesian bound for Lifelong Learning , 2013, ICML.