Aggregate density-based concept drift identification for dynamic sensor data models

The reduced costs of embedded systems and sensor technology coupled with the increased speed in communication enables businesses and consumers to deploy a large number of sensing devices. This conjunction of technologies has come to be known as the Internet of Things (IoT). Data collected from IoT devices are continuously increasing, and many approaches have been proposed to deal with the big data that is now generated. Multiple artificial intelligent techniques have been proposed and used to extract knowledge out of these continuously growing datasets. In this paper, we demonstrate that a better understanding of data can be achieved through dynamic modeling. This dynamic behavior is observed in many practical scenarios and needs to be taken into account to have a higher accuracy in prediction and analysis for policy making and business-related decisions. We propose and test a novel methodology to detect the dynamic nature of data over time. Machine learning models have been known to suffer from changes in streaming data over time which is defined as concept drift and therefore by detecting this phenomena such models can be improved.

[1]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[2]  João Gama,et al.  Data Stream Classification Guided by Clustering on Nonstationary Environments and Extreme Verification Latency , 2015, SDM.

[3]  Richard J. Povinelli,et al.  Probabilistic anomaly detection in natural gas time series data , 2016 .

[4]  Gerhard Widmer,et al.  Learning in the Presence of Concept Drift and Hidden Contexts , 1996, Machine Learning.

[5]  A. Bifet,et al.  Early Drift Detection Method , 2005 .

[6]  João Gama,et al.  Learning with Drift Detection , 2004, SBIA.

[7]  Vincent Lemaire,et al.  A Survey on Supervised Classification on Data Streams , 2014, eBISS.

[8]  Cosimo Distante,et al.  Drift counteraction with multiple self-organising maps for an electronic nose , 2004 .

[9]  Jie Lu,et al.  Accumulating regional density dissimilarity for concept drift detection in data streams , 2018, Pattern Recognit..

[10]  Ning Lu,et al.  Concept drift detection via competence models , 2014, Artif. Intell..

[11]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[12]  G. Niklas Norén,et al.  Assessment of the Utility of Social Media for Broad-Ranging Statistical Signal Detection in Pharmacovigilance: Results from the WEB-RADR Project , 2018, Drug Safety.

[13]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[14]  H. Troy Nagle,et al.  Handbook of Machine Olfaction: Electronic Nose Technology , 2003 .

[15]  L. F. Delph,et al.  Sexual Dimorphism in Flower Size , 1996, The American Naturalist.

[16]  H. Shimodaira,et al.  Improving predictive inference under covariate shift by weighting the log-likelihood function , 2000 .

[17]  Ricard Gavaldà,et al.  Learning from Time-Changing Data with Adaptive Windowing , 2007, SDM.

[18]  Naoyuki Kubota,et al.  Reinforcement Learning in non-stationary environments: An intrinsically motivated stress based memory retrieval performance (SBMRP) model , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[19]  José del Campo-Ávila,et al.  Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds , 2015, IEEE Transactions on Knowledge and Data Engineering.

[20]  Anton Dries,et al.  Adaptive concept drift detection , 2009, SDM.

[21]  Shankar Vembu,et al.  Chemical gas sensor drift compensation using classifier ensembles , 2012 .

[22]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[23]  Masashi Sugiyama,et al.  Learning under nonstationarity: covariate shift and class‐balance change , 2013 .

[24]  M. Holmberg,et al.  Drift Compensation, Standards, and Calibration Methods , 2004 .

[25]  Ivo Bukovsky,et al.  Concept drift robust adaptive novelty detection for data streams , 2018, Neurocomputing.

[26]  Katarzyna Musial,et al.  Next challenges for adaptive learning systems , 2012, SKDD.

[27]  Roberto Souto Maior de Barros,et al.  A comparative study on concept drift detectors , 2014, Expert Syst. Appl..