Multi-Agent-Based Unsupervised Detection of Energy Consumption Anomalies on Smart Campus

The smart campus is becoming a reality with the advancement of information and communication technologies. For energy efficiency, it is essential to detect abnormal energy consumption in a smart campus, which is important for a “smart” campus. However, the obtained data are usually continuously generated by ubiquitous sensing devices, and the abnormal patterns hidden in the data are usually unknown, which makes detecting anomalies in such a context more challenging. Moreover, evaluating the quality of anomaly detection algorithms is difficult without labeled datasets. If the data are annotated well, classical criteria such as the receiver operating characteristic or precision recall curves can be used to compare the performance of different anomaly detection algorithms. In a smart campus environment, it is difficult to acquire labeled data to train a model due to the limited capabilities of the sensing devices. Therefore, distributed intelligence is preferred. In this paper, we present a multi-agent-based unsupervised anomaly detection method. We tackle these challenges in two stages with this method. First, we label the data using ensemble models. Second, we propose a method based on deep learning techniques to detect anomalies in an unsupervised fashion. The result of the first stage is used to evaluate the performance of the proposed method. We validate the proposed method with several datasets, and the experimental results demonstrate the effectiveness of our method.

[1]  Oren Barkan,et al.  Robust mixture models for anomaly detection , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[2]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[3]  Mianxiong Dong,et al.  Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing , 2018, IEEE Network.

[4]  W. Marsden.  I and J , 2012 .

[5]  Arthur Zimek,et al.  Ensembles for unsupervised outlier detection: challenges and research questions a position paper , 2014, SKDD.

[6]  Andreas Dengel,et al.  Histogram-based Outlier Score (HBOS): A fast Unsupervised Anomaly Detection Algorithm , 2012 .

[7]  Charu C. Aggarwal,et al.  An Introduction to Outlier Analysis , 2013 .

[8]  Bo Zong,et al.  Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection , 2018, ICLR.

[9]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[10]  Hans-Peter Kriegel,et al.  Angle-based outlier detection in high-dimensional data , 2008, KDD.

[11]  Mohiuddin Ahmed,et al.  A survey of network anomaly detection techniques , 2016, J. Netw. Comput. Appl..

[12]  Hao Wang,et al.  A New Anomaly Detection System for School Electricity Consumption Data , 2017, Inf..

[13]  Jun Yang,et al.  Improved traffic detection with support vector machine based on restricted Boltzmann machine , 2017, Soft Comput..

[14]  Le Thanh Sach,et al.  An anomaly-based network intrusion detection system using Deep learning , 2017, 2017 International Conference on System Science and Engineering (ICSSE).

[15]  B. Ravi Kiran,et al.  An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos , 2018, J. Imaging.

[16]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Hamza O. Salami,et al.  Detecting Anomalies in Students" Results Using Decision Trees , 2016 .

[19]  V. Rao Vemuri,et al.  Use of K-Nearest Neighbor classifier for intrusion detection , 2002, Comput. Secur..

[20]  J. Ma,et al.  Time-series novelty detection using one-class support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[21]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[22]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[23]  Christopher Leckie,et al.  High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning , 2016, Pattern Recognit..

[24]  Vipin Kumar,et al.  Feature bagging for outlier detection , 2005, KDD '05.

[25]  Zengyou He,et al.  Discovering cluster-based local outliers , 2003, Pattern Recognit. Lett..

[26]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[27]  Jinoh Kim,et al.  A survey of deep learning-based network anomaly detection , 2017, Cluster Computing.

[28]  Fred Popowich,et al.  Electricity, water, and natural gas consumption of a residential house in Canada from 2012 to 2014 , 2016, Scientific Data.

[29]  Nicolas Goix,et al.  How to Evaluate the Quality of Unsupervised Anomaly Detection Algorithms? , 2016, ArXiv.

[30]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[31]  Tomoharu Iwata,et al.  Multi-view Anomaly Detection via Robust Probabilistic Latent Variable Models , 2016, NIPS.

[32]  Subutai Ahmad,et al.  Unsupervised real-time anomaly detection for streaming data , 2017, Neurocomputing.

[33]  David M. Rocke,et al.  Outlier detection in the multiple cluster setting using the minimum covariance determinant estimator , 2004, Comput. Stat. Data Anal..

[34]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[35]  Adriano J. C. Moreira,et al.  Anomaly detection in university campus WiFi zones , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).