Adaptive Anomaly Detection Strategy Based on Reinforcement Learning

In complex and changeable cloud environment, the monitoring and anomaly detection of cloud platform become very important. Good anomaly detection can help cloud platform managers to make quick adjustments to ensure a good user experience. Although many anomaly detection models have been put forward by researchers in recent years, the application of these anomaly detection models to a given service still faces the challenge of parameter adjustment, which is time-consuming and exhausting, and still fails. In order to solve the problem of parameter adjusting, in this paper, an adaptive anomaly detection framework is proposed, the process of parameter adjustment is transformed into a general Markov decision process by means of reinforcement learning, which realized the automation of parameter adjustment, reducing the workload of operator and the effective detection rate of the anomaly detection model is improved, we compared it on three typical KPI (Key Performance Indicator) curves with artificial adjustment mode and other optimization strategies, in the end, we verified the effectiveness of the strategy used in this paper.

[1]  Daniel Massey,et al.  G-RCA: A Generic Root Cause Analysis Platform for Service Quality Management in Large IP Networks , 2010, IEEE/ACM Transactions on Networking.

[2]  Dan Pei,et al.  Opprentice: Towards Practical and Automatic Anomaly Detection Through Machine Learning , 2015, Internet Measurement Conference.

[3]  Witold Kinsner,et al.  Anomaly detection in a smart grid using wavelet transform, variance fractal dimension and an artificial neural network , 2016, 2016 IEEE Electrical Power and Energy Conference (EPEC).

[4]  Jun Chen,et al.  Outlier Detection in Energy Disaggregation Using Subspace Learning and Gaussian Mixture Model , 2015 .

[5]  Jalal Al-Muhtadi,et al.  Anomaly detection using Wavelet-based estimation of LRD in packet and byte count of control traffic , 2016, 2016 7th International Conference on Information and Communication Systems (ICICS).

[6]  Marcos V. O. de Assis,et al.  Anomaly Detection Using Forecasting Methods ARIMA and HWDS , 2013, 2013 32nd International Conference of the Chilean Computer Science Society (SCCC).

[7]  Hui Yu,et al.  Aircraft failure rate forecasting method based on Holt-Winters seasonal model , 2017, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[8]  Tomasz Wiktorski,et al.  Adaptive Anomaly Detection in Cloud Using Robust and Scalable Principal Component Analysis , 2016, 2016 15th International Symposium on Parallel and Distributed Computing (ISPDC).

[9]  Christopher Leckie,et al.  High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning , 2016, Pattern Recognit..

[10]  Hui Tian,et al.  Diffusion Wavelet-Based Anomaly Detection in Networks , 2016, 2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT).

[11]  Ashok Kumar Das,et al.  An Efficient Hybrid Anomaly Detection Scheme Using K-Means Clustering for Wireless Sensor Networks , 2016, Wirel. Pers. Commun..

[12]  Calin Belta,et al.  Q-Learning for robust satisfaction of signal temporal logic specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).